00000100:00100000:3.0:1772305808.343673:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000095ca8b47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:2994:x1858396216583616:12345-0@lo:6:osp-syn-1-0.0 Request processed in 409us (506us total) trans 4294968334 rc 0/0 00000100:00100000:3.0:1772305808.343692:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5631 00000100:00100000:3.0:1772305808.840779:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ccddc55d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216583680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1772305808.840843:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305808.840921:0:6309:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216583744 00000100:00100000:3.0:1772305808.840969:0:6309:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00100000:3.0:1772305808.840975:0:6309:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f086b207 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:2992:x1858396216583744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1772305808.840998:0:6309:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 693305344 pending 0 free 3606052864 avail 3603955712 00000100:00100000:3.0:1772305808.841045:0:6309:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f086b207 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:2992:x1858396216583744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305808.841054:0:6309:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00000100:00100000:3.0:1772305808.841223:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ccddc55d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216583680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1772305809.093147:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225295360 00000100:00100000:3.0:1772305809.093191:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 373 00000100:00100000:3.0:1772305809.093198:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f8a1bcf1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+30:88593:x1858396225295360:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1772305809.093207:0:55141:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305809.093217:0:55141:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000985f8a7b/0xa5e9c8c58c6dc94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196e767 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305809.093247:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6dc9b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305809.093258:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6dc9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305809.093267:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6dc9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1772305809.093315:0:55141:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 15872 00000004:00200000:3.0:1772305809.093318:0:55141:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 96 stripe count 1 MDT count 1 00000004:00010000:3.0:1772305809.093336:0:55141:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6dc9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305809.093354:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000985f8a7b/0xa5e9c8c58c6dc94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e767 expref: 32 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305809.093366:0:55141:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6dc9b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e767 expref: 31 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305809.093373:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:3.0:1772305809.093376:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1772305809.093379:0:55141:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f0848df9, rc 0) 00000100:00100000:3.0:1772305809.093415:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f8a1bcf1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+31:88593:x1858396225295360:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 216us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305809.093423:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 373 00000100:00100000:3.0:1772305809.353741:0:2994:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1772305809.353762:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b36dba7e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:70aae467-c860-409f-ba1b-742f4d042da6:2994:1858396216583936:0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772305809.353832:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305809.353862:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000983211d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:2994:1858396216584256:0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772305809.353896:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305809.353935:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216584000 00000100:00100000:3.0:1772305809.353975:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216584256 00000100:00100000:3.0:1772305809.354012:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1772305809.354017:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a741f30e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:2994:x1858396216584256:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772305809.354070:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a741f30e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:2994:x1858396216584256:12345-0@lo:400:kworker/u8:4.0 Request processed in 51us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305809.354085:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1772305809.354127:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305809.354164:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305809.354226:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae5186f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:2993:1858396216584000:0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772305809.354353:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007a587e26 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216584128:0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772305809.548716:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225295808 00000100:00100000:3.0:1772305809.548747:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 377 00000100:00100000:3.0:1772305809.548753:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d831f9af pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+39:88605:x1858396225295808:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1772305809.548764:0:55653:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305809.548781:0:55653:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000985f8a7b/0xa5e9c8c58c6dcb7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196e77c expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305809.548834:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000cbd7933d/0xa5e9c8c58c6dcbe lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305809.548845:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cbd7933d/0xa5e9c8c58c6dcbe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305809.548855:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cbd7933d/0xa5e9c8c58c6dcbe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305809.548865:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c6dcc5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x93f881df bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305809.548870:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c6dcc5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x93f881df bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305809.548882:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c6dcc5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x93f881df bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305809.548917:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6dccc lrc: 3/1,0 mode: --/CR res: [0x200000402:0x317:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305809.548924:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6dccc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x317:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305809.548928:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6dccc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x317:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1772305809.548934:0:55653:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x317:0x0]: returning size 1516 00010000:00010000:3.0:1772305809.549005:0:55653:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000cbd7933d/0xa5e9c8c58c6dcbe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305809.549011:0:55653:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cbd7933d/0xa5e9c8c58c6dcbe lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305809.549016:0:55653:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cbd7933d/0xa5e9c8c58c6dcbe lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305809.549020:0:55653:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cbd7933d already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305809.549022:0:55653:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cbd7933d/0xa5e9c8c58c6dcbe lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305809.549027:0:55653:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cbd7933d/0xa5e9c8c58c6dcbe lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305809.549035:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (00000000c78481f6) 00010000:00010000:3.0:1772305809.549042:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305809.549046:0:55653:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cbd7933d/0xa5e9c8c58c6dcbe lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305809.549050:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cbd7933d/0xa5e9c8c58c6dcbe lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305809.549059:0:55653:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c6dcc5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x93f881df bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305809.549063:0:55653:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c6dcc5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x93f881df bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305809.549067:0:55653:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c6dcc5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x93f881df bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305809.549070:0:55653:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a0648135 already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305809.549071:0:55653:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c6dcc5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x93f881df bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305809.549074:0:55653:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c6dcc5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x93f881df bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305809.549078:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x93f881df (000000000437a20c) 00010000:00010000:3.0:1772305809.549079:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305809.549080:0:55653:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c6dcc5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x93f881df bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305809.549084:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c6dcc5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x93f881df bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305809.549112:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000985f8a7b/0xa5e9c8c58c6dcb7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e77c expref: 42 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305809.549120:0:55653:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6dccc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x317:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e77c expref: 41 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305809.549125:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x317:0x0].0x0 (00000000147b81a3) 00010000:00010000:3.0:1772305809.549126:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1772305809.549128:0:55653:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c6c2d285, rc 0) 00000100:00100000:3.0:1772305809.549154:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d831f9af pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+41:88605:x1858396225295808:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 402us (492us total) trans 8589934722 rc 0/0 00000100:00100000:3.0:1772305809.549159:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 377 00000100:00100000:3.0:1772305809.550070:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305809.550300:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225295936 00000100:00100000:3.0:1772305809.550339:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5634 00000100:00100000:3.0:1772305809.550346:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c42ef24f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2215:x1858396225295936:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1772305809.550408:0:10520:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a5c1895c/0xa5e9c8c58c6dcda lrc: 3/1,0 mode: --/PR res: [0x1a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305809.550423:0:10520:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006493e1f8/0xa5e9c8c58c6dc63 lrc: 2/0,0 mode: PW/PW res: [0x1a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e752 expref: 227 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305809.550431:0:10520:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1772305809.550433:0:10520:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1772305809.550434:0:10520:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5c1895c/0xa5e9c8c58c6dcda lrc: 4/1,0 mode: --/PR res: [0x1a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305809.550465:0:10520:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006493e1f8/0xa5e9c8c58c6dc63 lrc: 3/0,0 mode: PW/PW res: [0x1a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e752 expref: 227 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305809.550478:0:10520:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006493e1f8/0xa5e9c8c58c6dc63 lrc: 4/0,0 mode: PW/PW res: [0x1a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e752 expref: 227 pid: 6306 timeout: 1221 lvb_type: 0 00000100:00100000:3.0:1772305809.550490:0:10520:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006b28ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:10520:1858396216584384:192.168.203.30@tcp:104: 00000100:00100000:3.0:1772305809.550528:0:10520:0:(client.c:2500:ptlrpc_set_wait()) set 000000007ceb0146 going to sleep for 6 seconds 00000100:00100000:3.0:1772305809.551268:0:10520:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006b28ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:10520:1858396216584384:192.168.203.30@tcp:104: 00010000:00010000:3.0:1772305809.551283:0:10520:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a5c1895c/0xa5e9c8c58c6dcda lrc: 3/1,0 mode: --/PR res: [0x1a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305809.552840:0:10520:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a5c1895c/0xa5e9c8c58c6dcda lrc: 3/1,0 mode: PR/PR res: [0x1a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305809.552848:0:10520:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5c1895c/0xa5e9c8c58c6dcda lrc: 3/1,0 mode: PR/PR res: [0x1a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305809.552862:0:10520:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a5c1895c/0xa5e9c8c58c6dcda lrc: 3/1,0 mode: PR/PR res: [0x1a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305809.552870:0:10520:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5c1895c/0xa5e9c8c58c6dcda lrc: 2/0,0 mode: PR/PR res: [0x1a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305809.552889:0:10520:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1772305809.552924:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c42ef24f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+228:2215:x1858396225295936:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 Request processed in 2577us (2686us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305809.552932:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5634 00000100:00100000:3.0:1772305809.553524:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225296192 00000100:00100000:3.0:1772305809.553547:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 378 00000100:00100000:3.0:1772305809.553550:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000039c4cb43 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+40:88605:x1858396225296192:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1772305809.553604:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000039c4cb43 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+40:88605:x1858396225296192:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 51us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305809.553612:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 378 00000100:00100000:3.0:1772305809.554770:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225296256 00000100:00100000:3.0:1772305809.554801:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5635 00000100:00100000:3.0:1772305809.554806:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cc0879e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+228:2216:x1858396225296256:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1772305809.554815:0:10520:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305809.554827:0:10520:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000985f8a7b/0xa5e9c8c58c6dce1 lrc: 2/0,0 mode: --/PR res: [0x1a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196e783 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1772305809.554842:0:10520:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x1a8:0x0] initial LVB size: 1516, mtime: 0x69a33d90, atime: 0x0, ctime: 0x69a33d90, blocks: 0x1 00010000:00010000:3.0:1772305809.554853:0:10520:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1772305809.554855:0:10520:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1772305809.554859:0:10520:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000985f8a7b/0xa5e9c8c58c6dce1 lrc: 3/0,0 mode: PR/PR res: [0x1a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e783 expref: 229 pid: 10520 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1772305809.554871:0:10520:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000985f8a7b/0xa5e9c8c58c6dce1 lrc: 3/0,0 mode: PR/PR res: [0x1a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e783 expref: 229 pid: 10520 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1772305809.554880:0:10520:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000985f8a7b, rc 0) 00000100:00100000:3.0:1772305809.554916:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cc0879e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+229:2216:x1858396225296256:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 109us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305809.554923:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5635 00000100:00100000:3.0:1772305809.555753:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225296384 00000100:00100000:3.0:1772305809.555780:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 379 00000100:00100000:3.0:1772305809.555784:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000afa5cf5e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+40:88605:x1858396225296384:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1772305809.555821:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000afa5cf5e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+40:88605:x1858396225296384:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 36us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305809.555826:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 379 00000100:00100000:3.0:1772305809.558187:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225296576 00000100:00100000:3.0:1772305809.558219:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 380 00000100:00100000:3.0:1772305809.558225:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000848c45a9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+40:88605:x1858396225296576:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1772305809.558234:0:55653:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305809.558246:0:55653:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c6dce8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x317:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196e78a expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305809.558267:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000cbd7933d/0xa5e9c8c58c6dcef lrc: 3/1,0 mode: --/PR res: [0x200000402:0x317:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305809.558278:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cbd7933d/0xa5e9c8c58c6dcef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x317:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305809.558287:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cbd7933d/0xa5e9c8c58c6dcef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x317:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305809.558352:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c6dce8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x317:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e78a expref: 42 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305809.558379:0:55653:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000cbd7933d/0xa5e9c8c58c6dcef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x317:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e78a expref: 41 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305809.558386:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x317:0x0].0x0 (00000000147b81a3) 00010000:00010000:3.0:1772305809.558389:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1772305809.558391:0:55653:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000cbd7933d, rc 0) 00000100:00100000:3.0:1772305809.558422:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000848c45a9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+41:88605:x1858396225296576:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 197us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305809.558430:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 380 00000100:00100000:3.0:1772305809.559682:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225296640 00000100:00100000:3.0:1772305809.559714:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 381 00000100:00100000:3.0:1772305809.559720:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000008d2aeef pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+41:88605:x1858396225296640:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1772305809.559737:0:55653:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x317:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1772305809.559789:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000008d2aeef pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+41:88605:x1858396225296640:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 69us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305809.559797:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 381 00000100:00100000:3.0:1772305809.560757:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225296704 00000100:00100000:3.0:1772305809.560780:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5636 00000100:00100000:3.0:1772305809.560784:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000015c5a7c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+229:2216:x1858396225296704:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1772305809.560800:0:10520:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000617aea8a/0xa5e9c8c58c6dcf6 lrc: 3/1,0 mode: --/PR res: [0x1a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305809.560807:0:10520:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1772305809.560809:0:10520:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1772305809.560812:0:10520:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000617aea8a/0xa5e9c8c58c6dcf6 lrc: 3/1,0 mode: PR/PR res: [0x1a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305809.560825:0:10520:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000617aea8a/0xa5e9c8c58c6dcf6 lrc: 3/1,0 mode: PR/PR res: [0x1a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305809.560836:0:10520:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000617aea8a/0xa5e9c8c58c6dcf6 lrc: 3/1,0 mode: PR/PR res: [0x1a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305809.560841:0:10520:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000617aea8a/0xa5e9c8c58c6dcf6 lrc: 2/0,0 mode: PR/PR res: [0x1a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305809.560853:0:10520:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1772305809.560882:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000015c5a7c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+229:2216:x1858396225296704:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 Request processed in 97us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305809.560890:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5636 00000100:00100000:3.0:1772305809.561554:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225296832 00000100:00100000:3.0:1772305809.561582:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 382 00000100:00100000:3.0:1772305809.561587:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d0ab861f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+41:88605:x1858396225296832:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000040:00080000:3.0:1772305809.561847:0:55653:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x13:0x0].2, 168 off8496 00000040:00080000:3.0:1772305809.561942:0:55653:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x13:0x0].3, 168 off8664 00000001:00080000:3.0:1772305809.561948:0:55653:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934723 00000040:00080000:3.0:1772305809.562007:0:55653:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305809.562011:0:55653:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305809.562069:0:55653:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 19 count 19 00000040:00080000:3.0:1772305809.562076:0:55653:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:3.0:1772305809.562126:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d0ab861f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+42:88605:x1858396225296832:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 538us (598us total) trans 8589934723 rc 0/0 00000100:00100000:3.0:1772305809.562136:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 382 00000100:00100000:3.0:1772305810.674035:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305810.676793:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305810.677640:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225297280 00000100:00100000:3.0:1772305810.677734:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 387 00000100:00100000:3.0:1772305810.677739:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000084809c1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+43:88618:x1858396225297280:12345-192.168.203.30@tcp:501:chlg_load_threa.0 00000100:00100000:3.0:1772305810.677785:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000084809c1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+43:88618:x1858396225297280:12345-192.168.203.30@tcp:501:chlg_load_threa.0 Request processed in 45us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305810.677793:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 387 00000100:00100000:3.0:1772305810.678391:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225297344 00000100:00100000:3.0:1772305810.678414:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 388 00000100:00100000:3.0:1772305810.678419:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007a587e26 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+43:88618:x1858396225297344:12345-192.168.203.30@tcp:503:chlg_load_threa.0 00000100:00100000:3.0:1772305810.678493:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007a587e26 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+43:88618:x1858396225297344:12345-192.168.203.30@tcp:503:chlg_load_threa.0 Request processed in 75us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305810.678500:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 388 00000100:00100000:3.0:1772305810.679392:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225297408 00000100:00100000:3.0:1772305810.679484:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 389 00000100:00100000:3.0:1772305810.679490:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000774de3b7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+43:88618:x1858396225297408:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1772305810.679596:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000774de3b7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+43:88618:x1858396225297408:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 105us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305810.679606:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 389 00000100:00100000:3.0:1772305810.680532:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225297472 00000100:00100000:3.0:1772305810.680573:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 390 00000100:00100000:3.0:1772305810.680578:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ae5186f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+43:88618:x1858396225297472:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1772305810.680713:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ae5186f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+43:88618:x1858396225297472:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 134us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305810.680729:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 390 00000100:00100000:3.0:1772305811.524759:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225297536 00000100:00100000:3.0:1772305811.524815:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 102 00000100:00100000:3.0:1772305811.524822:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000db950d37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2218:x1858396225297536:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:3.0:1772305811.524889:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000db950d37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2218:x1858396225297536:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 65us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305811.524905:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 102 00000100:00100000:3.0:1772305811.524952:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225297664 00000100:00100000:3.0:1772305811.524988:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225297728 00000100:00100000:3.0:1772305811.525022:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1083 00000100:00100000:3.0:1772305811.525030:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000983211d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+222:2218:x1858396225297664:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:3.0:1772305811.525124:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000983211d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+222:2218:x1858396225297664:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 88us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305811.525146:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1083 00000100:00100000:3.0:1772305812.458758:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000020:00000080:3.0:1772305812.724454:0:61193:0:(class_obd.c:302:class_handle_ioctl()) cmd = c008667f 00000020:00000080:3.0:1772305812.724461:0:61193:0:(class_obd.c:126:class_resolve_dev_name()) device name lustre-MDT0000 00000020:00000080:3.0:1772305812.724466:0:61193:0:(class_obd.c:133:class_resolve_dev_name()) device name lustre-MDT0000, dev 5 00000020:00000080:3.0:1772305812.724494:0:61193:0:(class_obd.c:302:class_handle_ioctl()) cmd = 424066b2 00000004:00000080:3.0:1772305812.724499:0:61193:0:(mdt_handler.c:7411:mdt_iocontrol()) handling ioctl cmd 0x424066b2 00000004:00000080:3.0:1772305812.724532:0:61193:0:(mdd_device.c:2125:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=1, endrec=0 00000040:00080000:3.0:1772305812.724584:0:61193:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1772305812.724587:0:61193:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x11:0x1:0x0]:0 at index 1 of catalog [0x6:0xa:0x0] 00000004:00000080:3.0:1772305812.724607:0:61193:0:(mdd_device.c:2095:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl1 endrec = 3 00000040:00080000:3.0:1772305812.724672:0:61193:0:(llog.c:789:llog_process_thread()) stop processing plain 0x11:1:0 index 2 count 2 00000040:00080000:3.0:1772305812.724677:0:61193:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x6:10:0 index 2 count 2 00000004:00000080:3.0:1772305812.724680:0:61193:0:(mdd_device.c:2173:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl1 entries up to 18446744073709551615 00000040:00080000:3.0:1772305812.724707:0:61193:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1772305812.724708:0:61193:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x13:0x1:0x0]:0 at index 1 of catalog [0x5:0xa:0x0] 00000040:00080000:3.0:1772305812.725085:0:61193:0:(llog.c:789:llog_process_thread()) stop processing plain 0x13:1:0 index 64768 count 1 00000040:00080000:3.0:1772305812.725090:0:61193:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x5:10:0 index 2 count 2 00000004:00000080:3.0:1772305812.725094:0:61193:0:(mdd_device.c:1983:mdd_changelog_user_purge()) lustre-MDD0000: Purge request: id=1 00000040:00080000:3.0:1772305812.725111:0:61193:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1772305812.725113:0:61193:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x11:0x1:0x0]:0 at index 1 of catalog [0x6:0xa:0x0] 00000040:00100000:3.0:1772305812.725126:0:61193:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 1 in log [0x11:0x1:0x0] 00000040:00080000:3.0:1772305812.725184:0:61193:0:(llog.c:789:llog_process_thread()) stop processing plain 0x11:1:0 index 1 count 1 00000040:00080000:3.0:1772305812.725187:0:61193:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x6:10:0 index 2 count 2 00000004:00000080:3.0:1772305812.725190:0:61193:0:(mdd_device.c:2005:mdd_changelog_user_purge()) turning off changelogs 00000004:02000000:3.0:1772305812.725191:0:61193:0:(mdd_device.c:483:mdd_changelog_off()) lustre-MDD0000: changelog off 00000004:00000080:3.0:1772305812.726302:0:61193:0:(mdd_device.c:2015:mdd_changelog_user_purge()) lustre-MDD0000: Purge changelog entries for user cl1 record=18446744073709551615 00000040:00080000:3.0:1772305812.726327:0:61193:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1772305812.726328:0:61193:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x13:0x1:0x0]:0 at index 1 of catalog [0x5:0xa:0x0] 00000040:00080000:3.0:1772305812.726701:0:61193:0:(llog.c:789:llog_process_thread()) stop processing plain 0x13:1:0 index 64768 count 1 00000040:00080000:3.0:1772305812.726705:0:61193:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x5:10:0 index 2 count 2 00000040:00080000:3.0:1772305812.726722:0:61193:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1772305812.726723:0:61193:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x11:0x1:0x0]:0 at index 1 of catalog [0x6:0xa:0x0] 00000040:00080000:3.0:1772305812.727078:0:61193:0:(llog.c:789:llog_process_thread()) stop processing plain 0x11:1:0 index 64768 count 1 00000040:00080000:3.0:1772305812.727080:0:61193:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x6:10:0 index 2 count 2 00000100:00100000:3.0:1772305813.043404:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305813.675587:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305813.677066:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305813.684615:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305813.686688:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305813.687768:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305813.692512:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305813.693828:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305813.698616:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305813.699782:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305813.706255:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305813.712175:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305813.713291:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305813.714528:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305814.472812:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003fdd35f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216584960:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305814.472862:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305814.472920:0:6308:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216584960 00000100:00100000:3.0:1772305814.472975:0:6308:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216585024 00000100:00100000:3.0:1772305814.473015:0:6308:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1087 00000100:00100000:3.0:1772305814.473027:0:6308:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001c27fa0f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216584960:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305814.473090:0:6308:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001c27fa0f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216584960:12345-0@lo:400:kworker/u8:0.0 Request processed in 67us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305814.473099:0:6308:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1087 00000100:00100000:3.0:1772305814.473123:0:6308:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1088 00000100:00100000:3.0:1772305814.473130:0:6308:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ccddc55d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216585024:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305814.473189:0:6308:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ccddc55d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216585024:12345-0@lo:400:kworker/u8:0.0 Request processed in 58us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305814.473205:0:6308:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1088 00000100:00100000:3.0:1772305814.473238:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1772305814.473249:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008043af1b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:2993:x1858396216584896:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305814.473296:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008043af1b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:2993:x1858396216584896:12345-0@lo:400:kworker/u8:0.0 Request processed in 51us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305814.473301:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1772305814.473352:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003fdd35f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216584960:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305814.660189:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225299712 00000100:00100000:3.0:1772305814.660243:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 407 00000100:00100000:3.0:1772305814.660248:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000053f40a87 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+33:89300:x1858396225299712:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1772305814.660265:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305814.660282:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c6de2a lrc: 2/0,0 mode: --/CR res: [0x200000408:0x79:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196e7f3 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305814.660330:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000008a734987/0xa5e9c8c58c6de31 lrc: 3/1,0 mode: --/CR res: [0x200000408:0x79:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305814.660341:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000008a734987/0xa5e9c8c58c6de31 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305814.660350:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000008a734987/0xa5e9c8c58c6de31 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305814.660359:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6de38 lrc: 3/1,0 mode: --/PR res: [0x200000408:0x79:0x0].0xe2288a63 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305814.660364:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6de38 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x79:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305814.660368:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6de38 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x79:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305814.660444:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000094970864/0xa5e9c8c58c6de3f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x318:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305814.660449:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000094970864/0xa5e9c8c58c6de3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305814.660453:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000094970864/0xa5e9c8c58c6de3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1772305814.660482:0:54697:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x318:0x0]: returning size 1516 00000004:00200000:3.0:1772305814.660486:0:54697:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1772305814.660498:0:54697:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 0000000094970864/0xa5e9c8c58c6de3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305814.660506:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000094970864/0xa5e9c8c58c6de3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305814.660512:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000008a734987/0xa5e9c8c58c6de31 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305814.660516:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000008a734987/0xa5e9c8c58c6de31 lrc: 2/0,0 mode: CR/CR res: [0x200000408:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305814.660520:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000008a734987/0xa5e9c8c58c6de31 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305814.660524:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000008a734987 already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305814.660526:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000008a734987/0xa5e9c8c58c6de31 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305814.660531:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000008a734987/0xa5e9c8c58c6de31 lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305814.660539:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x79:0x0].0x0 (0000000017feab12) 00010000:00010000:3.0:1772305814.660541:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305814.660544:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000008a734987/0xa5e9c8c58c6de31 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305814.660548:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000008a734987/0xa5e9c8c58c6de31 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305814.660560:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6de38 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x79:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305814.660564:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6de38 lrc: 2/0,0 mode: PR/PR res: [0x200000408:0x79:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305814.660568:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6de38 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x79:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305814.660571:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000051c27e8b already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305814.660572:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6de38 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x79:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305814.660575:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6de38 lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x79:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305814.660579:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x79:0x0].0xe2288a63 (000000004e66d04e) 00010000:00010000:3.0:1772305814.660581:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305814.660582:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6de38 lrc: 2/0,0 mode: --/PR res: [0x200000408:0x79:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305814.660585:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6de38 lrc: 0/0,0 mode: --/PR res: [0x200000408:0x79:0x0].0xe2288a63 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305814.660604:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c6de2a lrc: 0/0,0 mode: --/CR res: [0x200000408:0x79:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e7f3 expref: 35 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305814.660612:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000094970864/0xa5e9c8c58c6de3f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e7f3 expref: 34 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305814.660645:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x318:0x0].0x0 (00000000c10a8182) 00010000:00010000:3.0:1772305814.660648:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1772305814.660659:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000094970864, rc 0) 00000100:00100000:3.0:1772305814.660710:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000053f40a87 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+34:89300:x1858396225299712:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 460us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305814.660718:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 407 00000100:00100000:3.0:1772305814.662433:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00002000:00010000:3.0:1772305814.663719:0:6307:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x1a8:0x0:0x0] updating lvb size: 0 -> 1516 00002000:00010000:3.0:1772305814.663722:0:6307:0:(ofd_lvb.c:284:ofd_lvbo_update()) res: [0x1a8:0x0:0x0] updating lvb mtime: 0 -> 1772305813 00002000:00010000:3.0:1772305814.663724:0:6307:0:(ofd_lvb.c:290:ofd_lvbo_update()) res: [0x1a8:0x0:0x0] updating lvb atime: 0 -> 1772305813 00002000:00010000:3.0:1772305814.663725:0:6307:0:(ofd_lvb.c:296:ofd_lvbo_update()) res: [0x1a8:0x0:0x0] updating lvb ctime: 0 -> 1772305813 00000100:00100000:3.0:1772305814.663737:0:6307:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000040ceeec7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6307:1858396216585152:192.168.203.30@tcp:106: 00010000:00010000:3.0:1772305814.663756:0:6307:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000de49697e/0xa5e9c8c58c6de46 lrc: 1/0,0 mode: --/PR res: [0x1a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e7fa expref: 160 pid: 6307 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1772305814.663764:0:6307:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de49697e/0xa5e9c8c58c6de46 lrc: 0/0,0 mode: --/PR res: [0x1a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e7fa expref: 160 pid: 6307 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1772305814.663771:0:6307:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000de49697e, rc 0) 00000100:00100000:3.0:1772305814.663798:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000326ce08d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+159:2216:x1858396225299776:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 1285us (1366us total) trans 0 rc 301/301 00000100:00100000:3.0:1772305814.663803:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5639 00000100:00100000:3.0:1772305814.664791:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225299840 00000100:00100000:3.0:1772305814.664823:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 408 00000100:00100000:3.0:1772305814.664829:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000035b59d41 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+34:89300:x1858396225299840:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1772305814.664844:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305814.664854:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6de4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196e801 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305814.664884:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c6de54 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305814.664893:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c6de54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305814.664902:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c6de54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1772305814.664934:0:54697:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 15872 00000004:00200000:3.0:1772305814.664938:0:54697:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 97 stripe count 1 MDT count 1 00000004:00010000:3.0:1772305814.664951:0:54697:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c6de54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305814.664966:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6de4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e801 expref: 36 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305814.664978:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c6de54 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e801 expref: 35 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305814.664986:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:3.0:1772305814.664988:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1772305814.664990:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000617aea8a, rc 0) 00000100:00100000:3.0:1772305814.665020:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000035b59d41 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+35:89300:x1858396225299840:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 191us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305814.665027:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 408 00000100:00100000:3.0:1772305814.665887:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225299904 00000100:00100000:3.0:1772305814.665919:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 409 00000100:00100000:3.0:1772305814.665926:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006121cd31 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+35:89300:x1858396225299904:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1772305814.665934:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305814.665943:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6de5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196e808 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305814.665966:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000a5c1895c/0xa5e9c8c58c6de62 lrc: 3/1,0 mode: --/PR res: [0x200000408:0x79:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305814.665972:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a5c1895c/0xa5e9c8c58c6de62 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x79:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305814.665977:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a5c1895c/0xa5e9c8c58c6de62 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x79:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1772305814.665995:0:54697:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000408:0x79:0x0]: returning size 512 00000004:00200000:3.0:1772305814.665997:0:54697:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1772305814.666005:0:54697:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000a5c1895c/0xa5e9c8c58c6de62 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x79:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305814.666016:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6de5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e808 expref: 37 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305814.666023:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000a5c1895c/0xa5e9c8c58c6de62 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x79:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e808 expref: 36 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305814.666028:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x79:0x0].0x0 (0000000017feab12) 00010000:00010000:3.0:1772305814.666029:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1772305814.666036:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5c1895c, rc 0) 00000100:00100000:3.0:1772305814.666059:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006121cd31 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+36:89300:x1858396225299904:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 135us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305814.666064:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 409 00000100:00100000:3.0:1772305814.667065:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225299968 00000100:00100000:3.0:1772305814.667086:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5640 00000100:00100000:3.0:1772305814.667101:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000601911f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+159:2215:x1858396225299968:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1772305814.667107:0:6307:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305814.667114:0:6307:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0648135/0xa5e9c8c58c6de69 lrc: 2/0,0 mode: --/PR res: [0x1a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196e80f expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305814.667153:0:6307:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004dac6711 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6307:1858396216585216:192.168.203.30@tcp:106: 00000100:00100000:3.0:1772305814.667184:0:6307:0:(client.c:2500:ptlrpc_set_wait()) set 00000000b534c6d8 going to sleep for 6 seconds 00000100:00100000:3.0:1772305814.667937:0:6307:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004dac6711 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6307:1858396216585216:192.168.203.30@tcp:106: 00010000:00010000:3.0:1772305814.667954:0:6307:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0648135/0xa5e9c8c58c6de69 lrc: 1/0,0 mode: --/PR res: [0x1a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e80f expref: 160 pid: 6307 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1772305814.667961:0:6307:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0648135/0xa5e9c8c58c6de69 lrc: 0/0,0 mode: --/PR res: [0x1a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e80f expref: 160 pid: 6307 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1772305814.667968:0:6307:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0648135, rc 0) 00000100:00100000:3.0:1772305814.667992:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000601911f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+159:2215:x1858396225299968:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 890us (972us total) trans 0 rc 301/301 00000100:00100000:3.0:1772305814.667996:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5640 00000100:00100000:3.0:1772305814.669595:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225300096 00000100:00100000:3.0:1772305814.669618:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 410 00000100:00100000:3.0:1772305814.669657:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b250dcf6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+36:89300:x1858396225300096:12345-192.168.203.30@tcp:58:lfs.0 00000040:00080000:3.0:1772305814.669794:0:54697:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xf:0x0].19, 136 off10776 00000100:00100000:3.0:1772305814.669835:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b250dcf6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+36:89300:x1858396225300096:12345-192.168.203.30@tcp:58:lfs.0 Request processed in 181us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305814.669841:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 410 00000100:00100000:3.0:1772305816.595453:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225300864 00000100:00100000:3.0:1772305816.595493:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 416 00000100:00100000:3.0:1772305816.595499:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000035fd0397 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+46:89341:x1858396225300864:12345-192.168.203.30@tcp:503:chlg_load_threa.0 00000100:00100000:3.0:1772305816.595730:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000035fd0397 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+46:89341:x1858396225300864:12345-192.168.203.30@tcp:503:chlg_load_threa.0 Request processed in 230us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305816.595740:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 416 00000100:00100000:3.0:1772305816.596389:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225300928 00000100:00100000:3.0:1772305816.597236:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225300992 00000100:00100000:3.0:1772305816.597269:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 418 00000100:00100000:3.0:1772305816.597275:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008f2b99af pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+46:89341:x1858396225300992:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1772305816.597413:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008f2b99af pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+46:89341:x1858396225300992:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 137us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305816.597422:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 418 00000100:00100000:3.0:1772305816.598061:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225301056 00000100:00100000:3.0:1772305816.598091:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 419 00000100:00100000:3.0:1772305816.598098:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fc01b397 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+46:89341:x1858396225301056:12345-192.168.203.30@tcp:501:chlg_load_threa.0 00000100:00100000:3.0:1772305816.598166:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fc01b397 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+46:89341:x1858396225301056:12345-192.168.203.30@tcp:501:chlg_load_threa.0 Request processed in 68us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305816.598174:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 419 00000100:00100000:3.0:1772305816.598796:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225301120 00000100:00100000:3.0:1772305816.598821:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 420 00000100:00100000:3.0:1772305816.598825:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000028e6916d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+46:89341:x1858396225301120:12345-192.168.203.30@tcp:503:chlg_load_threa.0 00000100:00100000:3.0:1772305816.598896:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000028e6916d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+46:89341:x1858396225301120:12345-192.168.203.30@tcp:503:chlg_load_threa.0 Request processed in 70us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305816.598902:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 420 00000100:00100000:3.0:1772305816.600372:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225301248 00000100:00100000:3.0:1772305816.600397:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 422 00000100:00100000:3.0:1772305816.600400:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000465b750e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+46:89341:x1858396225301248:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1772305816.600492:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000465b750e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+46:89341:x1858396225301248:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 90us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305816.600499:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 422 00000100:00100000:3.0:1772305816.644047:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225301568 00000100:00100000:3.0:1772305816.644093:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1089 00000100:00100000:3.0:1772305816.644104:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002294ffc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2218:x1858396225301440:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:3.0:1772305816.644159:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002294ffc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2218:x1858396225301440:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 59us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305816.644179:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1089 00000100:00100000:3.0:1772305816.644199:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1092 00000100:00100000:3.0:1772305816.644204:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000011976c6e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+159:2218:x1858396225301504:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:3.0:1772305816.644235:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000011976c6e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+159:2218:x1858396225301504:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 29us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305816.644243:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1092 00000040:00080000:3.0:1772305818.478400:0:61783:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1772305818.478408:0:61783:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x11:0x1:0x0]:0 at index 1 of catalog [0x6:0xa:0x0] 00000040:00080000:3.0:1772305818.478441:0:61783:0:(llog.c:789:llog_process_thread()) stop processing plain 0x11:1:0 index 3 count 2 00000040:00080000:3.0:1772305818.478447:0:61783:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x6:10:0 index 2 count 2 00000100:00100000:3.0:1772305818.496049:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225301632 00000100:00100000:3.0:1772305818.496097:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 423 00000100:00100000:3.0:1772305818.496103:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000004f8c4bb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+46:89776:x1858396225301632:12345-192.168.203.30@tcp:46:lfs.0 00000004:00000080:3.0:1772305818.496154:0:54698:0:(mdt_handler.c:7411:mdt_iocontrol()) handling ioctl cmd 0x424066b3 00000004:00000080:3.0:1772305818.496186:0:54698:0:(mdd_device.c:2125:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=2, endrec=0 00000040:00080000:3.0:1772305818.496269:0:54698:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1772305818.496273:0:54698:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x11:0x1:0x0]:0 at index 1 of catalog [0x6:0xa:0x0] 00000004:00000080:3.0:1772305818.496307:0:54698:0:(mdd_device.c:2095:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl2 endrec = 6 00000040:00080000:3.0:1772305818.496352:0:54698:0:(llog.c:789:llog_process_thread()) stop processing plain 0x11:1:0 index 3 count 2 00000040:00080000:3.0:1772305818.496357:0:54698:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x6:10:0 index 2 count 2 00000004:00000080:3.0:1772305818.496360:0:54698:0:(mdd_device.c:2173:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl2 entries up to 18446744073709551615 00000040:00080000:3.0:1772305818.496391:0:54698:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1772305818.496392:0:54698:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x13:0x1:0x0]:0 at index 1 of catalog [0x5:0xa:0x0] 00000040:00100000:3.0:1772305818.496417:0:54698:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 4 in log [0x13:0x1:0x0] 00000040:00100000:3.0:1772305818.496476:0:54698:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 5 in log [0x13:0x1:0x0] 00000040:00100000:3.0:1772305818.496511:0:54698:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 6 in log [0x13:0x1:0x0] 00000040:00080000:3.0:1772305818.496541:0:54698:0:(llog.c:789:llog_process_thread()) stop processing plain 0x13:1:0 index 6 count 1 00000040:00080000:3.0:1772305818.496544:0:54698:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x5:10:0 index 2 count 2 00000100:00100000:3.0:1772305818.496673:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000004f8c4bb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+46:89776:x1858396225301632:12345-192.168.203.30@tcp:46:lfs.0 Request processed in 521us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305818.496685:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 423 00010000:00010000:3.0:1772305818.581977:0:5496:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1772305818.581984:0:5496:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e6f75d5/0xa5e9c8c58c6dea8 lrc: 2/0,0 mode: PW/PW res: [0x1a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305818.581996:0:5496:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000008e6f75d5 already unused, calling callback (00000000b5e4f3c0) 00010000:00010000:3.0:1772305818.582048:0:5496:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e6f75d5/0xa5e9c8c58c6dea8 lrc: 2/0,0 mode: PW/PW res: [0x1a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305818.582059:0:5496:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e6f75d5/0xa5e9c8c58c6dea8 lrc: 3/0,0 mode: PW/PW res: [0x1a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305818.582075:0:5496:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e6f75d5/0xa5e9c8c58c6dea8 lrc: 1/0,0 mode: --/PW res: [0x1a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305818.582083:0:5496:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e6f75d5/0xa5e9c8c58c6dea8 lrc: 0/0,0 mode: --/PW res: [0x1a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305818.582104:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1772305818.582106:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1772305818.582109:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1772305819.079663:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225301760 00000100:00100000:3.0:1772305819.079718:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 424 00000100:00100000:3.0:1772305819.079726:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000000d187c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+41:89251:x1858396225301760:12345-192.168.203.30@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1772305819.079823:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000000d187c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+41:89251:x1858396225301760:12345-192.168.203.30@tcp:60:lhsmtool_posix.0 Request processed in 97us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305819.079832:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 424 00000100:00100000:3.0:1772305819.081736:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000282b51c2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216585664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1772305819.081780:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305819.593773:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000de20b528 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:2991:1858396216585920:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305819.593833:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000099e4fbd0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:70aae467-c860-409f-ba1b-742f4d042da6:2993:1858396216585792:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305819.593889:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305819.593930:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000239dd968 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216586048:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305819.593963:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305819.594022:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216586112 00000100:00100000:3.0:1772305819.594057:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1772305819.594065:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000282b51c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:2994:x1858396216586112:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305819.594125:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000282b51c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:2994:x1858396216586112:12345-0@lo:400:kworker/u8:0.0 Request processed in 61us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305819.594132:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1772305819.594189:0:54689:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216585792 00000100:00100000:3.0:1772305819.594245:0:54689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1772305819.594255:0:54689:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000001ef4b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70aae467-c860-409f-ba1b-742f4d042da6+18:2993:x1858396216585792:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305819.594316:0:54689:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000001ef4b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70aae467-c860-409f-ba1b-742f4d042da6+18:2993:x1858396216585792:12345-0@lo:400:kworker/u8:0.0 Request processed in 58us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305819.594327:0:54689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1772305819.633957:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305819.675938:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305819.679852:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305819.771137:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000020:00000080:3.0:1772305820.630779:0:62074:0:(class_obd.c:302:class_handle_ioctl()) cmd = c008667f 00000020:00000080:3.0:1772305820.630789:0:62074:0:(class_obd.c:126:class_resolve_dev_name()) device name lustre-MDT0000 00000020:00000080:3.0:1772305820.630794:0:62074:0:(class_obd.c:133:class_resolve_dev_name()) device name lustre-MDT0000, dev 5 00000020:00000080:3.0:1772305820.630816:0:62074:0:(class_obd.c:302:class_handle_ioctl()) cmd = 424066b1 00000004:00000080:3.0:1772305820.630822:0:62074:0:(mdt_handler.c:7411:mdt_iocontrol()) handling ioctl cmd 0x424066b1 00000040:00080000:3.0:1772305820.631008:0:62074:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x11:0x0].3, 80 off8432 00000004:00000080:3.0:1772305820.631028:0:62074:0:(mdd_device.c:1821:mdd_changelog_user_register()) lustre-MDD0000: registered changelog user 'cl3', mask 0x0 00000004:02000000:3.0:1772305820.631031:0:62074:0:(mdd_device.c:460:mdd_changelog_on()) lustre-MDD0000: changelog on 00000100:00100000:3.0:1772305820.695871:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305820.700130:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305821.763964:0:54689:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225303552 00000100:00100000:3.0:1772305821.764013:0:54689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 106 00000100:00100000:3.0:1772305821.764029:0:54689:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d866bd46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2215:x1858396225303552:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:3.0:1772305821.764118:0:54689:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d866bd46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2215:x1858396225303552:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 87us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305821.764126:0:54689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 106 00000100:00100000:3.0:1772305821.764272:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1097 00000100:00100000:3.0:1772305821.764280:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002c720606 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f935b4d0-e17f-49c8-8011-4be99ba75430+159:2216:x1858396225303872:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:3.0:1772305821.764437:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002c720606 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f935b4d0-e17f-49c8-8011-4be99ba75430+159:2216:x1858396225303872:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 156us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305821.764442:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1097 00000100:00100000:3.0:1772305821.764588:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225303936 00000100:00100000:3.0:1772305821.764613:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1098 00000100:00100000:3.0:1772305821.764618:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006670e52f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f935b4d0-e17f-49c8-8011-4be99ba75430+140:2215:x1858396225303936:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:3.0:1772305821.764731:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006670e52f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f935b4d0-e17f-49c8-8011-4be99ba75430+140:2215:x1858396225303936:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 74us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305821.764737:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1098 00000040:00080000:3.0:1772305822.610219:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305822.610223:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305822.611009:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 21 00000040:00080000:3.0:1772305822.611016:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:3.0:1772305822.908272:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225305216 00000100:00100000:3.0:1772305822.908302:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 452 00000100:00100000:3.0:1772305822.908308:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bcaf406f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+51:90081:x1858396225305216:12345-192.168.203.30@tcp:503:chlg_load_threa.0 00000100:00100000:3.0:1772305822.908397:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bcaf406f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+51:90081:x1858396225305216:12345-192.168.203.30@tcp:503:chlg_load_threa.0 Request processed in 90us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305822.908403:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 452 00000100:00100000:3.0:1772305822.909008:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225305280 00000100:00100000:3.0:1772305822.909072:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 453 00000100:00100000:3.0:1772305822.909075:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008f85e4e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+51:90081:x1858396225305280:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1772305822.909160:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008f85e4e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+51:90081:x1858396225305280:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 83us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305822.909165:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 453 00000100:00100000:3.0:1772305822.909771:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225305344 00000100:00100000:3.0:1772305822.909800:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 454 00000100:00100000:3.0:1772305822.909803:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000094f3bd7e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+51:90081:x1858396225305344:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1772305822.909880:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000094f3bd7e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+51:90081:x1858396225305344:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 76us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305822.909885:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 454 00000100:00100000:3.0:1772305824.201757:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c30d8750 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216586432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1772305824.201796:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305824.712797:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f8c4abc3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:2991:1858396216586624:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305824.712879:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006f23ed77 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:2992:1858396216586688:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305824.712916:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305824.712976:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216586688 00000100:00100000:3.0:1772305824.713019:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1772305824.713028:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001c27fa0f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:2992:x1858396216586688:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305824.713111:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001c27fa0f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:2992:x1858396216586688:12345-0@lo:400:kworker/u8:0.0 Request processed in 82us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305824.713121:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1772305824.713172:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305824.713334:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f8c4abc3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:2991:1858396216586624:0@lo:400:kworker/u8:0.0 00000040:00080000:3.0:1772305824.723302:0:62476:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1772305824.723307:0:62476:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x11:0x1:0x0]:0 at index 1 of catalog [0x6:0xa:0x0] 00000040:00080000:3.0:1772305824.723341:0:62476:0:(llog.c:789:llog_process_thread()) stop processing plain 0x11:1:0 index 4 count 2 00000040:00080000:3.0:1772305824.723346:0:62476:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x6:10:0 index 2 count 2 00000100:00100000:3.0:1772305824.741730:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000040:00080000:3.0:1772305825.672767:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305825.672772:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00100000:3.0:1772305825.672801:0:54732:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 2 in log [0xf:0x1:0x0] 00000040:00100000:3.0:1772305825.672905:0:54732:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 3 in log [0xf:0x1:0x0] 00000040:00080000:3.0:1772305825.672952:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 22 count 19 00000040:00080000:3.0:1772305825.672958:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000400:00000080:3.0:1772305825.897921:0:62621:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:3.0:1772305825.897926:0:62621:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 222a: Changelog for explicit restore == 14:10:25 (1772305825) 00000100:00100000:3.0:1772305825.995898:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305826.008005:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305826.009312:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305826.146271:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225306240 00000100:00100000:3.0:1772305826.146329:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 462 00000100:00100000:3.0:1772305826.146341:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000418e3644 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+37:90756:x1858396225306240:12345-192.168.203.30@tcp:36:mkdir.0 00000100:00100000:3.0:1772305826.146525:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000418e3644 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+36:90756:x1858396225306240:12345-192.168.203.30@tcp:36:mkdir.0 Request processed in 186us (309us total) trans 0 rc -17/-17 00000100:00100000:3.0:1772305826.146534:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 462 00000100:00100000:3.0:1772305826.147592:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305826.176397:0:5494:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225306688 00010000:00010000:3.0:1772305826.176473:0:5494:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d4c26f30/0xa5e9c8c58c6e07d lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x7d:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e8a2 expref: 40 pid: 55653 timeout: 1238 lvb_type: 0 00000100:00100000:3.0:1772305826.176495:0:5494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3012 00000100:00100000:3.0:1772305826.176499:0:5494:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000870e476c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+40:2216:x1858396225306688:12345-192.168.203.30@tcp:103:ldlm_bl_05.0 00010000:00010000:3.0:1772305826.176506:0:5494:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1772305826.176510:0:5494:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000d4c26f30/0xa5e9c8c58c6e07d lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x7d:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e8a2 expref: 40 pid: 55653 timeout: 1238 lvb_type: 0 00010000:00010000:3.0:1772305826.176517:0:5494:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000d4c26f30/0xa5e9c8c58c6e07d lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x7d:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e8a2 expref: 40 pid: 55653 timeout: 1238 lvb_type: 0 00010000:00010000:3.0:1772305826.176527:0:5494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d4c26f30/0xa5e9c8c58c6e07d lrc: 0/0,0 mode: --/CR res: [0x200000408:0x7d:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e8a2 expref: 40 pid: 55653 timeout: 1238 lvb_type: 0 00010000:00010000:3.0:1772305826.176534:0:5494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x7d:0x0].0x0 (00000000273e3196) 00010000:00010000:3.0:1772305826.176536:0:5494:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: 00000000373f3efa/0xa5e9c8c58c6e092 lrc: 3/0,1 mode: --/EX res: [0x200000408:0x7d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305826.176541:0:5494:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000373f3efa/0xa5e9c8c58c6e092 lrc: 3/0,1 mode: EX/EX res: [0x200000408:0x7d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305826.176545:0:5494:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000373f3efa/0xa5e9c8c58c6e092 lrc: 4/0,1 mode: EX/EX res: [0x200000408:0x7d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305826.176560:0:5494:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1772305826.176593:0:5494:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000870e476c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+39:2216:x1858396225306688:12345-192.168.203.30@tcp:103:ldlm_bl_05.0 Request processed in 89us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305826.176608:0:5494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3012 00000100:00100000:3.0:1772305826.178731:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305826.195947:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000040:00080000:3.0:1772305826.696747:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305826.696751:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305826.696779:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 22 count 19 00000040:00080000:3.0:1772305826.696784:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:3.0:1772305826.883792:0:54689:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225307456 00000100:00100000:3.0:1772305826.883824:0:54689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 108 00000100:00100000:3.0:1772305826.883838:0:54689:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000af8f29a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2217:x1858396225307456:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:3.0:1772305826.883886:0:54689:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000af8f29a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2217:x1858396225307456:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 56us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305826.883897:0:54689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 108 00000100:00100000:3.0:1772305826.883972:0:18149:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225307584 00000100:00100000:3.0:1772305826.883998:0:18149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1100 00000100:00100000:3.0:1772305826.884003:0:18149:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000034cdda9e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+222:2217:x1858396225307584:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:3.0:1772305826.884041:0:18149:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000034cdda9e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+222:2217:x1858396225307584:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 36us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305826.884125:0:18149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1100 00000100:00100000:3.0:1772305826.884177:0:48470:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225307840 00000100:00100000:3.0:1772305826.884284:0:48470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1102 00000100:00100000:3.0:1772305826.884290:0:48470:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f30bfbdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f935b4d0-e17f-49c8-8011-4be99ba75430+140:2217:x1858396225307840:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:3.0:1772305826.884473:0:48470:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f30bfbdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f935b4d0-e17f-49c8-8011-4be99ba75430+140:2217:x1858396225307840:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 34us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305826.884611:0:48470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1102 00000100:00100000:3.0:1772305827.146592:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305827.147835:0:54697:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000301518ab pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:54697:1858396216586880:192.168.203.30@tcp:104: 00000100:00100000:3.0:1772305827.147848:0:54697:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bae12857 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:54697:1858396216586944:192.168.203.30@tcp:104: 00010000:00010000:3.0:1772305827.147869:0:54697:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 00000000b7ca0c8b/0xa5e9c8c58c6e109 lrc: 3/0,1 mode: --/EX res: [0x200000408:0x7d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305827.148013:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305827.148112:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305827.148228:0:5495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3014 00000100:00100000:3.0:1772305827.148240:0:5495:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008068be20 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+49:2216:x1858396225308224:12345-192.168.203.30@tcp:103:ldlm_bl_06.0 00010000:00010000:3.0:1772305827.148251:0:5495:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1772305827.148259:0:5495:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000cd3f7c05/0xa5e9c8c58c6e0e6 lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x7d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e8be expref: 48 pid: 55653 timeout: 1239 lvb_type: 0 00010000:00010000:3.0:1772305827.148271:0:5495:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000cd3f7c05/0xa5e9c8c58c6e0e6 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x7d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e8be expref: 48 pid: 55653 timeout: 1239 lvb_type: 0 00010000:00010000:3.0:1772305827.148282:0:5495:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cd3f7c05/0xa5e9c8c58c6e0e6 lrc: 0/0,0 mode: --/PR res: [0x200000408:0x7d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e8be expref: 48 pid: 55653 timeout: 1239 lvb_type: 0 00010000:00010000:3.0:1772305827.148293:0:5495:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x7d:0x0].0x0 (00000000922630d0) 00010000:00010000:3.0:1772305827.148298:0:5495:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: 00000000b7ca0c8b/0xa5e9c8c58c6e109 lrc: 3/0,1 mode: --/EX res: [0x200000408:0x7d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305827.148309:0:5495:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000b7ca0c8b/0xa5e9c8c58c6e109 lrc: 3/0,1 mode: EX/EX res: [0x200000408:0x7d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305827.148323:0:5495:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b7ca0c8b/0xa5e9c8c58c6e109 lrc: 4/0,1 mode: EX/EX res: [0x200000408:0x7d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305827.148347:0:5495:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1772305827.148376:0:5495:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008068be20 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+46:2216:x1858396225308224:12345-192.168.203.30@tcp:103:ldlm_bl_06.0 Request processed in 138us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305827.148386:0:5495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3014 00000040:00080000:3.0:1772305827.441802:0:62814:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305827.441806:0:62814:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305827.441869:0:62814:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 23 count 20 00000040:00080000:3.0:1772305827.441873:0:62814:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:3.0:1772305827.441890:0:62814:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305827.441892:0:62814:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305827.441950:0:62814:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 23 count 20 00000040:00080000:3.0:1772305827.441952:0:62814:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:3.0:1772305827.720766:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305827.720774:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305827.720822:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 23 count 20 00000040:00080000:3.0:1772305827.720831:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:3.0:1772305827.720915:0:54732:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001e5c0b12 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:54732:1858396216587008:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1772305827.720984:0:54732:0:(client.c:2500:ptlrpc_set_wait()) set 0000000013400323 going to sleep for 6 seconds 00000100:00100000:3.0:1772305827.722399:0:54732:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001e5c0b12 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:54732:1858396216587008:192.168.203.30@tcp:107:hsm_cdtr.0 00000040:00080000:3.0:1772305827.722464:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305827.722467:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305827.722551:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 23 count 20 00000040:00080000:3.0:1772305827.722556:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:3.0:1772305827.722915:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305827.725672:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 477 00000100:00100000:3.0:1772305827.725681:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008d72e48b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+46:90812:x1858396225308416:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1772305827.725700:0:55653:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000408:0x7d:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1772305827.725756:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008d72e48b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+46:90812:x1858396225308416:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 76us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305827.725764:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 477 00000100:00100000:3.0:1772305827.726764:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305827.731962:0:5495:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225308800 00010000:00010000:3.0:1772305827.731980:0:5495:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 000000006493e1f8/0xa5e9c8c58c6e102 lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x7b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e8cc expref: 45 pid: 54697 timeout: 1239 lvb_type: 0 00000100:00100000:3.0:1772305827.732063:0:5495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3015 00000100:00100000:3.0:1772305827.732067:0:5495:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000029464d09 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+45:2215:x1858396225308800:12345-192.168.203.30@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1772305827.732076:0:5495:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1772305827.732080:0:5495:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 000000006493e1f8/0xa5e9c8c58c6e102 lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x7b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e8cc expref: 45 pid: 54697 timeout: 1239 lvb_type: 0 00010000:00010000:3.0:1772305827.732089:0:5495:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 000000006493e1f8/0xa5e9c8c58c6e102 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x7b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e8cc expref: 45 pid: 54697 timeout: 1239 lvb_type: 0 00010000:00010000:3.0:1772305827.732099:0:5495:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006493e1f8/0xa5e9c8c58c6e102 lrc: 0/0,0 mode: --/PR res: [0x200000408:0x7b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e8cc expref: 45 pid: 54697 timeout: 1239 lvb_type: 0 00010000:00010000:3.0:1772305827.732107:0:5495:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x7b:0x0].0x0 (00000000273e3196) 00010000:00010000:3.0:1772305827.732109:0:5495:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: 000000004f0eacd6/0xa5e9c8c58c6e156 lrc: 3/0,1 mode: --/CW res: [0x200000408:0x7b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305827.732125:0:5495:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 000000004f0eacd6/0xa5e9c8c58c6e156 lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x7b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305827.732129:0:5495:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000004f0eacd6/0xa5e9c8c58c6e156 lrc: 4/0,1 mode: CW/CW res: [0x200000408:0x7b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305827.732146:0:5495:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1772305827.732171:0:5495:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000029464d09 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+44:2215:x1858396225308800:12345-192.168.203.30@tcp:103:ldlm_bl_03.0 Request processed in 101us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305827.732185:0:5495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3015 00000100:00100000:3.0:1772305827.735677:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305827.737003:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305827.738058:0:48470:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225309120 00000100:00100000:3.0:1772305827.738090:0:48470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5645 00000100:00100000:3.0:1772305827.738095:0:48470:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000301518ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:370cd859-ca07-4cc9-a865-ed970d9eaddd+222:2215:x1858396225309120:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1772305827.738299:0:48470:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000301518ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:370cd859-ca07-4cc9-a865-ed970d9eaddd+223:2215:x1858396225309120:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 Request processed in 203us (287us total) trans 4294968263 rc 0/0 00000100:00100000:3.0:1772305827.738305:0:48470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5645 00000100:00100000:3.0:1772305827.740016:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225309312 00000100:00100000:3.0:1772305827.740042:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 485 00000100:00100000:3.0:1772305827.740045:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001c01c9b0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+51:90812:x1858396225309312:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1772305827.740070:0:55653:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305827.740080:0:55653:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c6e180 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x7b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196e8ef expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305827.740110:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6e187 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x31b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305827.740127:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6e187 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x31b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305827.740136:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6e187 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x31b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1772305827.740161:0:55653:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1772305827.740175:0:55653:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6e187 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x31b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305827.740185:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6e187 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x31b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305827.740204:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c6e180 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x7b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e8ef expref: 53 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305827.740213:0:55653:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6e187 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x31b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e8ef expref: 52 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305827.740218:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31b:0x0].0x0 (00000000c10a8182) 00010000:00010000:3.0:1772305827.740220:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1772305827.740221:0:55653:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c6c2d285, rc 0) 00000100:00100000:3.0:1772305827.740246:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001c01c9b0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+52:90812:x1858396225309312:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 200us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305827.740250:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 485 00000100:00100000:3.0:1772305827.741656:0:48470:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225309376 00000100:00100000:3.0:1772305827.741681:0:48470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5646 00000100:00100000:3.0:1772305827.741685:0:48470:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005b2347ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:370cd859-ca07-4cc9-a865-ed970d9eaddd+223:2216:x1858396225309376:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1772305827.741698:0:48470:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305827.741708:0:48470:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e18e lrc: 2/0,0 mode: --/PR res: [0x1a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196e8f6 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1772305827.741722:0:48470:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x1a9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x69a33da3, blocks: 0x1 00010000:00010000:3.0:1772305827.741731:0:48470:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1772305827.741733:0:48470:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1772305827.741738:0:48470:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e18e lrc: 3/0,0 mode: PR/PR res: [0x1a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e8f6 expref: 224 pid: 48470 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1772305827.741746:0:48470:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e18e lrc: 3/0,0 mode: PR/PR res: [0x1a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e8f6 expref: 224 pid: 48470 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1772305827.741753:0:48470:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f0848df9, rc 0) 00000100:00100000:3.0:1772305827.741777:0:48470:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005b2347ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:370cd859-ca07-4cc9-a865-ed970d9eaddd+224:2216:x1858396225309376:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 92us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305827.741782:0:48470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5646 00000100:00100000:3.0:1772305827.742610:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225309504 00000100:00100000:3.0:1772305827.742649:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 486 00000100:00100000:3.0:1772305827.742654:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002b636eb5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+52:90812:x1858396225309504:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1772305827.742694:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002b636eb5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+52:90812:x1858396225309504:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 40us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305827.742700:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 486 00000100:00100000:3.0:1772305827.743613:0:48470:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225309568 00000100:00100000:3.0:1772305827.743659:0:48470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5647 00000100:00100000:3.0:1772305827.743664:0:48470:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000933d69a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:370cd859-ca07-4cc9-a865-ed970d9eaddd+224:90812:x1858396225309568:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1772305827.743678:0:48470:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305827.743687:0:48470:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e195 lrc: 2/0,0 mode: --/PW res: [0x1a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196e8fd expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305827.743714:0:48470:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e18e lrc: 2/0,0 mode: PR/PR res: [0x1a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e8f6 expref: 225 pid: 48470 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1772305827.743720:0:48470:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1772305827.743721:0:48470:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1772305827.743723:0:48470:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e195 lrc: 4/0,0 mode: --/PW res: [0x1a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e8fd expref: 225 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305827.743744:0:48470:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e18e lrc: 3/0,0 mode: PR/PR res: [0x1a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e8f6 expref: 225 pid: 48470 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1772305827.743753:0:48470:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e18e lrc: 4/0,0 mode: PR/PR res: [0x1a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e8f6 expref: 225 pid: 48470 timeout: 1239 lvb_type: 1 00000100:00100000:3.0:1772305827.743764:0:48470:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003fdd35f4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:48470:1858396216587136:192.168.203.30@tcp:104: 00000100:00100000:3.0:1772305827.743816:0:48470:0:(client.c:2500:ptlrpc_set_wait()) set 0000000099ef9cce going to sleep for 6 seconds 00000100:00100000:3.0:1772305827.744618:0:48470:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003fdd35f4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:48470:1858396216587136:192.168.203.30@tcp:104: 00010000:00010000:3.0:1772305827.744656:0:48470:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e195 lrc: 3/0,0 mode: --/PW res: [0x1a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e8fd expref: 225 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305827.744670:0:48470:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000051c27e8b, rc 0) 00000100:00100000:3.0:1772305827.744763:0:48470:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000933d69a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:370cd859-ca07-4cc9-a865-ed970d9eaddd+225:90812:x1858396225309568:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 1096us (1182us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305827.744783:0:48470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5647 00000100:00100000:3.0:1772305827.744853:0:5495:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225309632 00010000:00010000:3.0:1772305827.744948:0:5495:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e18e lrc: 4/0,0 mode: PR/PR res: [0x1a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e8f6 expref: 225 pid: 48470 timeout: 1239 lvb_type: 1 00000100:00100000:3.0:1772305827.744979:0:5495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3016 00000100:00100000:3.0:1772305827.744984:0:5495:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fb0c28f5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+225:2215:x1858396225309632:12345-192.168.203.30@tcp:103:ldlm_bl_04.0 00010000:00010000:3.0:1772305827.744994:0:5495:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1772305827.745010:0:5495:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e18e lrc: 4/0,0 mode: PR/PR res: [0x1a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e8f6 expref: 225 pid: 48470 timeout: 1239 lvb_type: 1 00010000:00010000:3.0:1772305827.745021:0:5495:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e18e lrc: 3/0,0 mode: PR/PR res: [0x1a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e8f6 expref: 225 pid: 48470 timeout: 1239 lvb_type: 1 00010000:00010000:3.0:1772305827.745038:0:5495:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e18e lrc: 0/0,0 mode: --/PR res: [0x1a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e8f6 expref: 225 pid: 48470 timeout: 1239 lvb_type: 1 00010000:00010000:3.0:1772305827.745063:0:5495:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1772305827.745065:0:5495:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1772305827.745072:0:5495:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e195 lrc: 2/0,0 mode: PW/PW res: [0x1a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e8fd expref: 224 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305827.745080:0:5495:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e195 lrc: 3/0,0 mode: PW/PW res: [0x1a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e8fd expref: 224 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305827.745110:0:5495:0:(ldlm_lockd.c:1069:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e195 lrc: 3/0,0 mode: PW/PW res: [0x1a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e8fd expref: 224 pid: 48470 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305827.745130:0:5495:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003fdd35f4 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5495:1858396216587200:192.168.203.30@tcp:105: 00000100:00100000:3.0:1772305827.745164:0:5495:0:(client.c:2500:ptlrpc_set_wait()) set 0000000099ef9cce going to sleep for 6 seconds 00000100:00100000:3.0:1772305827.745962:0:5495:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003fdd35f4 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5495:1858396216587200:192.168.203.30@tcp:105: 00010000:00010000:3.0:1772305827.745975:0:5495:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1772305827.746005:0:5495:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fb0c28f5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+224:2215:x1858396225309632:12345-192.168.203.30@tcp:103:ldlm_bl_04.0 Request processed in 1020us (1187us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305827.746014:0:5495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3016 00000100:00100000:3.0:1772305827.746659:0:6311:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225309696 00002000:00100000:3.0:1772305827.746688:0:6311:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x1a9:0x0] (0->1515) req@0000000095ca8b47 x1858396225309696/t0(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:713/0 lens 2008/0 e 0 to 0 dl 1772305833 ref 1 fl New:/0/ffffffff rc 0/-1 job:'lhsmtool_posix.0' 00002000:00100000:3.0:1772305827.746698:0:6311:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 0000000095ca8b47 with x1858396225309696 ext(0->1515) 00002000:00010000:3.0:1772305827.746702:0:6311:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000095ca8b47 00000100:00100000:3.0:1772305827.746724:0:6311:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2004 00000100:00100000:3.0:1772305827.746728:0:6311:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000095ca8b47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+224:2216:x1858396225309696:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1772305827.747029:0:6311:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000095ca8b47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+226:2216:x1858396225309696:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 Request processed in 300us (440us total) trans 4294968264 rc 0/0 00000100:00100000:3.0:1772305827.747035:0:6311:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2004 00002000:00100000:3.0:1772305827.747041:0:6311:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x1a9:0x0] (0->1515) req@0000000095ca8b47 x1858396225309696/t4294968264(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:713/0 lens 2008/448 e 0 to 0 dl 1772305833 ref 1 fl Complete:/0/0 rc 0/0 job:'lhsmtool_posix.0' 00002000:00100000:3.0:1772305827.747046:0:6311:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 0000000095ca8b47 with x1858396225309696 ext(0->1515) 00002000:00010000:3.0:1772305827.747062:0:6311:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000095ca8b47 00000100:00100000:3.0:1772305827.747728:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225309760 00000100:00100000:3.0:1772305827.747760:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 487 00000100:00100000:3.0:1772305827.747763:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bfe1381b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+52:90812:x1858396225309760:12345-192.168.203.30@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1772305827.759100:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bfe1381b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+49:90812:x1858396225309760:12345-192.168.203.30@tcp:44:lhsmtool_posix.0 Request processed in 11329us (11395us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305827.759115:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 487 00000100:00100000:3.0:1772305827.759212:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000098196c2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216587264:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1772305827.759259:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1772305827.759553:0:2993:0:(osp_sync.c:563:osp_sync_interpret()) reply req 0000000098196c2d/2, rc 0, transno 969 00000100:00100000:3.0:1772305827.759558:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000098196c2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216587264:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1772305827.769681:0:48470:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000016a92645 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:370cd859-ca07-4cc9-a865-ed970d9eaddd+223:2215:x1858396225309824:12345-192.168.203.30@tcp:16:lhsmtool_posix.0 Request processed in 8963us (9061us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305827.769695:0:48470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5649 00000100:00100000:3.0:1772305827.771080:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225309952 00000100:00100000:3.0:1772305827.771132:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 488 00000100:00100000:3.0:1772305827.771139:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000f39354b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+48:90812:x1858396225309952:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1772305827.771185:0:55653:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1772305827.771210:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6e187 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x31b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e8ef expref: 48 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305827.771228:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31b:0x0].0x0 (00000000c10a8182) 00010000:00010000:3.0:1772305827.771233:0:55653:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1772305827.771261:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e19c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x31b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305827.771276:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e19c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x31b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305827.771300:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e19c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x31b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305827.771321:0:55653:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e19c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x31b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305827.771327:0:55653:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e19c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x31b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305827.771335:0:55653:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e19c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x31b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305827.771341:0:55653:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f0848df9 already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305827.771345:0:55653:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e19c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x31b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305827.771352:0:55653:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e19c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x31b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305827.771361:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31b:0x0].0x0 (00000000c10a8182) 00010000:00010000:3.0:1772305827.771364:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305827.771367:0:55653:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e19c lrc: 2/0,0 mode: --/PW res: [0x200000402:0x31b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305827.771373:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e19c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x31b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305827.771444:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000f39354b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+47:90812:x1858396225309952:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 304us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305827.771463:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 488 00000100:00100000:3.0:1772305827.772523:0:48470:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225310016 00000100:00100000:3.0:1772305827.772557:0:48470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5650 00000100:00100000:3.0:1772305827.772565:0:48470:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a358b8a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:370cd859-ca07-4cc9-a865-ed970d9eaddd+223:2216:x1858396225310016:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1772305827.772795:0:48470:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x1a9:0x0] updating lvb size from disk: 1516 -> 1516 00002000:00010000:3.0:1772305827.772798:0:48470:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x1a9:0x0] updating lvb mtime from disk: 1772305827 -> 1645827007 00002000:00010000:3.0:1772305827.772800:0:48470:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x1a9:0x0] updating lvb atime from disk: 0 -> 1772304708 00002000:00010000:3.0:1772305827.772802:0:48470:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x1a9:0x0] updating lvb ctime from disk: 1772305827 -> 1772305826 00002000:00010000:3.0:1772305827.772805:0:48470:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x1a9:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1772305827.772840:0:48470:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a358b8a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:370cd859-ca07-4cc9-a865-ed970d9eaddd+224:2216:x1858396225310016:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 Request processed in 275us (351us total) trans 4294968266 rc 0/0 00000100:00100000:3.0:1772305827.772848:0:48470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5650 00000100:00100000:3.0:1772305827.773772:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225310144 00000100:00100000:3.0:1772305827.773819:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 489 00000100:00100000:3.0:1772305827.773824:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c42ef24f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+47:90812:x1858396225310144:12345-192.168.203.30@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1772305827.773857:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c6e1a3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x31b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305827.773872:0:55653:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000c208f6b1/0xa5e9c8c58c6e16b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x31b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e8e1 expref: 47 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305827.773880:0:55653:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c6e1a3 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x31b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305827.773927:0:55653:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000c208f6b1/0xa5e9c8c58c6e16b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x31b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e8e1 expref: 47 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305827.773953:0:55653:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000c208f6b1/0xa5e9c8c58c6e16b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x31b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e8e1 expref: 47 pid: 55653 timeout: 1239 lvb_type: 0 00000100:00100000:3.0:1772305827.773974:0:55653:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006f23ed77 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:55653:1858396216587328:192.168.203.30@tcp:104: 00000100:00100000:3.0:1772305827.774027:0:55653:0:(client.c:2500:ptlrpc_set_wait()) set 0000000026b050d3 going to sleep for 6 seconds 00000100:00100000:3.0:1772305827.774858:0:55653:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006f23ed77 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:55653:1858396216587328:192.168.203.30@tcp:104: 00010000:00010000:3.0:1772305827.774945:0:55653:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c6e1a3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x31b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305827.775077:0:5495:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225310208 00010000:00010000:3.0:1772305827.775157:0:5495:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c208f6b1/0xa5e9c8c58c6e16b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x31b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e8e1 expref: 48 pid: 55653 timeout: 1239 lvb_type: 0 00000100:00100000:3.0:1772305827.775192:0:5495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3017 00000100:00100000:3.0:1772305827.775197:0:5495:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000023b046ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+48:2216:x1858396225310208:12345-192.168.203.30@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1772305827.775209:0:5495:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1772305827.775215:0:5495:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000c208f6b1/0xa5e9c8c58c6e16b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x31b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e8e1 expref: 48 pid: 55653 timeout: 1239 lvb_type: 0 00010000:00010000:3.0:1772305827.775226:0:5495:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000c208f6b1/0xa5e9c8c58c6e16b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x31b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e8e1 expref: 48 pid: 55653 timeout: 1239 lvb_type: 0 00010000:00010000:3.0:1772305827.775241:0:5495:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c208f6b1/0xa5e9c8c58c6e16b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x31b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e8e1 expref: 48 pid: 55653 timeout: 1239 lvb_type: 0 00010000:00010000:3.0:1772305827.775253:0:5495:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31b:0x0].0x0 (00000000c10a8182) 00010000:00010000:3.0:1772305827.775264:0:5495:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c6e1a3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x31b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305827.775272:0:5495:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c6e1a3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x31b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305827.775279:0:5495:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c6e1a3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x31b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305827.775307:0:5495:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1772305827.775345:0:5495:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000023b046ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+47:2216:x1858396225310208:12345-192.168.203.30@tcp:103:ldlm_bl_01.0 Request processed in 146us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305827.775357:0:5495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3017 00000100:00100000:3.0:1772305827.776315:0:48470:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225310272 00000100:00100000:3.0:1772305827.776347:0:48470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5651 00000100:00100000:3.0:1772305827.776352:0:48470:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009c527bff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:370cd859-ca07-4cc9-a865-ed970d9eaddd+224:2216:x1858396225310272:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1772305827.776376:0:48470:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a734987/0xa5e9c8c58c6e1aa lrc: 3/1,0 mode: --/PR res: [0x1a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305827.776388:0:48470:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e195 lrc: 2/0,0 mode: PW/PW res: [0x1a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e8fd expref: 224 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305827.776394:0:48470:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1772305827.776396:0:48470:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1772305827.776397:0:48470:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a734987/0xa5e9c8c58c6e1aa lrc: 4/1,0 mode: --/PR res: [0x1a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305827.776422:0:48470:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e195 lrc: 3/0,0 mode: PW/PW res: [0x1a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e8fd expref: 224 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305827.776439:0:48470:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e195 lrc: 4/0,0 mode: PW/PW res: [0x1a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e8fd expref: 224 pid: 48470 timeout: 1239 lvb_type: 0 00000100:00100000:3.0:1772305827.776447:0:48470:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006f23ed77 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:48470:1858396216587392:192.168.203.30@tcp:104: 00000100:00100000:3.0:1772305827.776474:0:48470:0:(client.c:2500:ptlrpc_set_wait()) set 0000000026b050d3 going to sleep for 6 seconds 00000100:00100000:3.0:1772305827.777266:0:48470:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006f23ed77 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:48470:1858396216587392:192.168.203.30@tcp:104: 00010000:00010000:3.0:1772305827.777280:0:48470:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008a734987/0xa5e9c8c58c6e1aa lrc: 3/1,0 mode: --/PR res: [0x1a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305827.777510:0:5495:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225310336 00010000:00010000:3.0:1772305827.777570:0:5495:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e195 lrc: 4/0,0 mode: PW/PW res: [0x1a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e8fd expref: 225 pid: 48470 timeout: 1239 lvb_type: 0 00000100:00100000:3.0:1772305827.777600:0:5495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3018 00000100:00100000:3.0:1772305827.777605:0:5495:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000018743e89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+225:2216:x1858396225310336:12345-192.168.203.30@tcp:103:ldlm_bl_08.0 00010000:00010000:3.0:1772305827.777615:0:5495:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1772305827.777652:0:5495:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e195 lrc: 4/0,0 mode: PW/PW res: [0x1a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e8fd expref: 225 pid: 48470 timeout: 1239 lvb_type: 0 00010000:00010000:3.0:1772305827.777663:0:5495:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e195 lrc: 3/0,0 mode: PW/PW res: [0x1a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e8fd expref: 225 pid: 48470 timeout: 1239 lvb_type: 0 00010000:00010000:3.0:1772305827.777681:0:5495:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e195 lrc: 0/0,0 mode: --/PW res: [0x1a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e8fd expref: 225 pid: 48470 timeout: 1239 lvb_type: 0 00010000:00010000:3.0:1772305827.777707:0:5495:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1772305827.777708:0:5495:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1772305827.777711:0:5495:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008a734987/0xa5e9c8c58c6e1aa lrc: 3/1,0 mode: PR/PR res: [0x1a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305827.777719:0:5495:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a734987/0xa5e9c8c58c6e1aa lrc: 4/1,0 mode: PR/PR res: [0x1a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305827.777742:0:5495:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1772305827.777775:0:5495:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000018743e89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+224:2216:x1858396225310336:12345-192.168.203.30@tcp:103:ldlm_bl_08.0 Request processed in 167us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305827.777794:0:5495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3018 00010000:00010000:3.0:1772305827.777836:0:6322:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1772305827.777842:0:6322:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a734987/0xa5e9c8c58c6e1aa lrc: 2/0,0 mode: PR/PR res: [0x1a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305827.777850:0:6322:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000008a734987 already unused, calling callback (00000000b5e4f3c0) 00010000:00010000:3.0:1772305827.777853:0:6322:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a734987/0xa5e9c8c58c6e1aa lrc: 2/0,0 mode: PR/PR res: [0x1a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305827.777860:0:6322:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a734987/0xa5e9c8c58c6e1aa lrc: 3/0,0 mode: PR/PR res: [0x1a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305827.777878:0:6322:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a734987/0xa5e9c8c58c6e1aa lrc: 1/0,0 mode: --/PR res: [0x1a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305827.777891:0:6322:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a734987/0xa5e9c8c58c6e1aa lrc: 0/0,0 mode: --/PR res: [0x1a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305827.777923:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1772305827.777926:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1772305827.777928:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1772305827.780288:0:5495:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225310528 00010000:00010000:3.0:1772305827.780346:0:5495:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ce59fac1/0xa5e9c8c58c6e179 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x31b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e8e8 expref: 48 pid: 55653 timeout: 1239 lvb_type: 0 00000100:00100000:3.0:1772305827.780376:0:5495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3019 00000100:00100000:3.0:1772305827.780382:0:5495:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000601911f4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+48:2215:x1858396225310528:12345-192.168.203.30@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1772305827.780391:0:5495:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1772305827.780396:0:5495:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000ce59fac1/0xa5e9c8c58c6e179 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x31b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e8e8 expref: 48 pid: 55653 timeout: 1239 lvb_type: 0 00010000:00010000:3.0:1772305827.780407:0:5495:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000ce59fac1/0xa5e9c8c58c6e179 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x31b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e8e8 expref: 48 pid: 55653 timeout: 1239 lvb_type: 0 00010000:00010000:3.0:1772305827.780419:0:5495:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ce59fac1/0xa5e9c8c58c6e179 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x31b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e8e8 expref: 48 pid: 55653 timeout: 1239 lvb_type: 0 00010000:00010000:3.0:1772305827.780430:0:5495:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31b:0x0].0x0 (00000000c10a8182) 00010000:00010000:3.0:1772305827.780434:0:5495:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: 00000000b0b1f8ca/0xa5e9c8c58c6e1b1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x31b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305827.780441:0:5495:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000b0b1f8ca/0xa5e9c8c58c6e1b1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x31b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305827.780447:0:5495:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b0b1f8ca/0xa5e9c8c58c6e1b1 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x31b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305827.780477:0:5495:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1772305827.780510:0:5495:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000601911f4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+47:2215:x1858396225310528:12345-192.168.203.30@tcp:103:ldlm_bl_02.0 Request processed in 125us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305827.780523:0:5495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3019 00000100:00100000:3.0:1772305827.780995:0:57220:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216587520 00000100:00100000:3.0:1772305827.781019:0:57220:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1772305827.781023:0:57220:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007dab649d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:55653:x1858396216587520:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1772305827.781085:0:57220:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007dab649d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:55653:x1858396216587520:12345-0@lo:1000:mdt00_004.0 Request processed in 62us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305827.781090:0:57220:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1772305827.781445:0:57220:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216587584 00000100:00100000:3.0:1772305827.781472:0:57220:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1772305827.781476:0:57220:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000075da49fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:55653:x1858396216587584:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1772305827.781610:0:57220:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000075da49fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:55653:x1858396216587584:12345-0@lo:1000:mdt00_004.0 Request processed in 131us (203us total) trans 4294968267 rc 0/0 00000100:00100000:3.0:1772305827.781619:0:57220:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000040:00080000:3.0:1772305827.782112:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305827.782116:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305827.782690:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 20 00000040:00080000:3.0:1772305827.782696:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772305827.783427:0:5496:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1772305827.783431:0:5496:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c12bdb6b/0xa5e9c8c58c6e1bf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x31b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446631280743258432 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305827.783439:0:5496:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c12bdb6b already unused, calling callback (00000000b5e4f3c0) 00010000:00010000:3.0:1772305827.783441:0:5496:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c12bdb6b/0xa5e9c8c58c6e1bf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x31b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446631280743258432 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305827.783452:0:5496:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c12bdb6b/0xa5e9c8c58c6e1bf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x31b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446631280743258432 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305827.783460:0:5496:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31b:0x0].0x0 (00000000a1075899) 00010000:00010000:3.0:1772305827.783462:0:5496:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1772305827.783464:0:5496:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c12bdb6b/0xa5e9c8c58c6e1bf lrc: 1/0,0 mode: --/PW res: [0x200000402:0x31b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446631280743258432 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305827.783468:0:5496:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c12bdb6b/0xa5e9c8c58c6e1bf lrc: 0/0,0 mode: --/PW res: [0x200000402:0x31b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446631280743258432 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305827.783482:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1772305827.783484:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1772305827.783486:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1772305828.767153:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225310848 00000100:00100000:3.0:1772305828.767245:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 493 00000100:00100000:3.0:1772305828.767252:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b0099b15 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+47:90825:x1858396225310848:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1772305828.767387:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b0099b15 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+47:90825:x1858396225310848:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 136us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305828.767394:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 493 00000100:00100000:3.0:1772305828.768165:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225310912 00000100:00100000:3.0:1772305828.768191:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 494 00000100:00100000:3.0:1772305828.768196:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002294ffc2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+47:90825:x1858396225310912:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1772305828.768317:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002294ffc2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+47:90825:x1858396225310912:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 120us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305828.768331:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 494 00000100:00100000:3.0:1772305828.769080:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225310976 00000100:00100000:3.0:1772305828.769154:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 495 00000100:00100000:3.0:1772305828.769161:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001bcee677 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+47:90825:x1858396225310976:12345-192.168.203.30@tcp:501:chlg_load_threa.0 00000100:00100000:3.0:1772305828.769210:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001bcee677 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+47:90825:x1858396225310976:12345-192.168.203.30@tcp:501:chlg_load_threa.0 Request processed in 48us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305828.769218:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 495 00000100:00100000:3.0:1772305828.769872:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225311040 00000100:00100000:3.0:1772305828.769908:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 496 00000100:00100000:3.0:1772305828.769914:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000edabdca1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+47:90825:x1858396225311040:12345-192.168.203.30@tcp:503:chlg_load_threa.0 00000100:00100000:3.0:1772305828.769988:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000edabdca1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+47:90825:x1858396225311040:12345-192.168.203.30@tcp:503:chlg_load_threa.0 Request processed in 74us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305828.769996:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 496 00000100:00100000:3.0:1772305829.320772:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006f23ed77 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216587648:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1772305829.320872:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305829.321165:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006f23ed77 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216587648:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1772305829.832766:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000036040640 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:70aae467-c860-409f-ba1b-742f4d042da6:2992:1858396216587776:0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772305829.832833:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305829.832920:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305829.832996:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1772305829.833009:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a7de87ba pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:2993:x1858396216587840:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772305829.833073:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a7de87ba pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:2993:x1858396216587840:12345-0@lo:400:kworker/u8:4.0 Request processed in 69us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305829.833096:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1772305829.833147:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b975fc8d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2991:1858396216587968:0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772305830.610556:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225311232 00000100:00100000:3.0:1772305830.610619:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 499 00000100:00100000:3.0:1772305830.610654:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f842a169 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+47:91256:x1858396225311232:12345-192.168.203.30@tcp:46:lfs.0 00000004:00000080:3.0:1772305830.610697:0:54698:0:(mdt_handler.c:7411:mdt_iocontrol()) handling ioctl cmd 0x424066b3 00000004:00000080:3.0:1772305830.610732:0:54698:0:(mdd_device.c:2125:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=4, endrec=0 00000040:00080000:3.0:1772305830.610834:0:54698:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1772305830.610839:0:54698:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x11:0x1:0x0]:0 at index 1 of catalog [0x6:0xa:0x0] 00000004:00000080:3.0:1772305830.610891:0:54698:0:(mdd_device.c:2095:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl4 endrec = 11 00000040:00080000:3.0:1772305830.610980:0:54698:0:(llog.c:789:llog_process_thread()) stop processing plain 0x11:1:0 index 5 count 2 00000040:00080000:3.0:1772305830.610988:0:54698:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x6:10:0 index 2 count 2 00000004:00000080:3.0:1772305830.610993:0:54698:0:(mdd_device.c:2173:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl4 entries up to 18446744073709551615 00000040:00080000:3.0:1772305830.611046:0:54698:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1772305830.611048:0:54698:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x13:0x1:0x0]:0 at index 1 of catalog [0x5:0xa:0x0] 00000040:00100000:3.0:1772305830.611080:0:54698:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 9 in log [0x13:0x1:0x0] 00000040:00100000:3.0:1772305830.611161:0:54698:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 10 in log [0x13:0x1:0x0] 00000040:00100000:3.0:1772305830.611223:0:54698:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 11 in log [0x13:0x1:0x0] 00000040:00080000:3.0:1772305830.611280:0:54698:0:(llog.c:789:llog_process_thread()) stop processing plain 0x13:1:0 index 11 count 1 00000040:00080000:3.0:1772305830.611287:0:54698:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x5:10:0 index 2 count 2 00000100:00100000:3.0:1772305830.611380:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f842a169 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+47:91256:x1858396225311232:12345-192.168.203.30@tcp:46:lfs.0 Request processed in 751us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305830.611390:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 499 00000040:00080000:3.0:1772305831.192684:0:63159:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1772305831.192690:0:63159:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x11:0x1:0x0]:0 at index 1 of catalog [0x6:0xa:0x0] 00000040:00080000:3.0:1772305831.193088:0:63159:0:(llog.c:789:llog_process_thread()) stop processing plain 0x11:1:0 index 64768 count 1 00000040:00080000:3.0:1772305831.193095:0:63159:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x6:10:0 index 2 count 2 00000100:00100000:3.0:1772305831.266543:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225311296 00000100:00100000:3.0:1772305831.266584:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 500 00000100:00100000:3.0:1772305831.266590:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c84b7376 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+47:90718:x1858396225311296:12345-192.168.203.30@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1772305831.266695:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c84b7376 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+47:90718:x1858396225311296:12345-192.168.203.30@tcp:60:lhsmtool_posix.0 Request processed in 105us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305831.266702:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 500 00010000:00010000:3.0:1772305831.625785:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:3.0:1772305831.836614:0:63207:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:3.0:1772305831.836619:0:63207:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 222b: Changelog for implicit restore == 14:10:31 (1772305831) 00000100:00100000:3.0:1772305831.953086:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225311424 00000100:00100000:3.0:1772305831.953135:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 501 00000100:00100000:3.0:1772305831.953141:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000453faf57 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+47:91470:x1858396225311424:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1772305831.953158:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305831.953179:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000008a734987/0xa5e9c8c58c6e1c6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196e904 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.953246:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e1cd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.953270:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e1cd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.953277:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e1cd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.953289:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e1d4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.953293:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e1d4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.953310:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e1d4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1772305831.953403:0:54698:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 10752 00010000:00010000:3.0:1772305831.953503:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e1cd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.953510:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e1cd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.953533:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e1cd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.953537:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000051c27e8b already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305831.953540:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e1cd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.953545:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e1cd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.953556:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (000000006b52a2ed) 00010000:00010000:3.0:1772305831.953559:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305831.953562:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e1cd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.953566:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e1cd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.953575:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e1d4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.953584:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e1d4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.953588:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e1d4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.953591:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f0848df9 already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305831.953592:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e1d4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.953596:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e1d4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.953600:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (00000000a6deaf5e) 00010000:00010000:3.0:1772305831.953601:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305831.953603:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e1d4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.953606:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e1d4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.953660:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000008a734987/0xa5e9c8c58c6e1c6 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e904 expref: 49 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.953666:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000008a734987/0xa5e9c8c58c6e1c6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e904 expref: 49 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.953672:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008a734987, rc 0) 00000100:00100000:3.0:1772305831.953716:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000453faf57 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+48:91470:x1858396225311424:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 576us (705us total) trans 8589934753 rc 301/301 00000100:00100000:3.0:1772305831.953723:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 501 00000100:00100000:3.0:1772305831.955726:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225311616 00000100:00100000:3.0:1772305831.955751:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 502 00000100:00100000:3.0:1772305831.955756:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000004a705af pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+49:91470:x1858396225311616:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1772305831.955799:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000004a705af pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+49:91470:x1858396225311616:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 Request processed in 43us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305831.955804:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 502 00000100:00100000:3.0:1772305831.962744:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225311680 00000100:00100000:3.0:1772305831.962786:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 503 00000100:00100000:3.0:1772305831.962792:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000024c17032 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+37:91471:x1858396225311680:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1772305831.962806:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305831.962820:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000008a734987/0xa5e9c8c58c6e1e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196e90b expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.962857:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e1e9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.962868:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e1e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.962876:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e1e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.962940:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e1f0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfa119335 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.962964:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e1f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfa119335 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.962971:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e1f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfa119335 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.963034:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e1e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.963043:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e1e9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.963049:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e1e9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.963055:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f0848df9 already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305831.963057:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e1e9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.963064:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e1e9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.963073:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:3.0:1772305831.963076:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305831.963079:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e1e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.963085:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e1e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.963107:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e1f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfa119335 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.963114:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e1f0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfa119335 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.963120:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e1f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfa119335 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.963126:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000051c27e8b already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305831.963128:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e1f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfa119335 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.963134:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e1f0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfa119335 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.963142:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfa119335 (00000000a6deaf5e) 00010000:00010000:3.0:1772305831.963144:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305831.963146:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e1f0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfa119335 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.963152:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e1f0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfa119335 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.963175:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000008a734987/0xa5e9c8c58c6e1e2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e90b expref: 38 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.963183:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000008a734987/0xa5e9c8c58c6e1e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e90b expref: 38 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.963202:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008a734987, rc 0) 00000100:00100000:3.0:1772305831.963238:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000024c17032 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+37:91471:x1858396225311680:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 444us (547us total) trans 0 rc 301/301 00000100:00100000:3.0:1772305831.963245:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 503 00000100:00100000:3.0:1772305831.965220:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225311808 00000100:00100000:3.0:1772305831.965251:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 504 00000100:00100000:3.0:1772305831.965257:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000773e607e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+37:91471:x1858396225311808:12345-192.168.203.30@tcp:36:lfs.0 00010000:00010000:3.0:1772305831.965283:0:54698:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1772305831.965296:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000046ff413b/0xa5e9c8c58c6e0f4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e8c5 expref: 37 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.965308:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:3.0:1772305831.965311:0:54698:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1772305831.965349:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6e1f7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.965361:0:54698:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000349659bf/0xa5e9c8c58c6e061 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e89b expref: 48 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.965369:0:54698:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6e1f7 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.965401:0:54698:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000349659bf/0xa5e9c8c58c6e061 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e89b expref: 48 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.965413:0:54698:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000349659bf/0xa5e9c8c58c6e061 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e89b expref: 48 pid: 55653 timeout: 1243 lvb_type: 0 00000100:00100000:3.0:1772305831.965441:0:54698:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003bce9793 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:54698:1858396216588032:192.168.203.30@tcp:104: 00000100:00100000:3.0:1772305831.965490:0:54698:0:(client.c:2500:ptlrpc_set_wait()) set 00000000d1a2df19 going to sleep for 6 seconds 00000100:00100000:3.0:1772305831.966342:0:54698:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003bce9793 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:54698:1858396216588032:192.168.203.30@tcp:104: 00010000:00010000:3.0:1772305831.966356:0:54698:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6e1f7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.966703:0:54698:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6e1f7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.966710:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6e1f7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.966722:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6e1fe lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfa119335 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.966734:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6e1fe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfa119335 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.966743:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6e1fe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfa119335 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1772305831.967254:0:54698:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000408:0x7e:0x0]: returning size 512 00010000:00010000:3.0:1772305831.967260:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6e1f7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.967268:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6e1f7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.967287:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6e1f7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.967293:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c6c2d285 already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305831.967295:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6e1f7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.967302:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6e1f7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.967311:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:3.0:1772305831.967314:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305831.967316:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6e1f7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305831.967322:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6e1f7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1772305831.967332:0:54698:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000773e607e reply state 00000000c93edc36 transno 8589934755 ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6e1fe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfa119335 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305831.967379:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000773e607e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+38:91471:x1858396225311808:12345-192.168.203.30@tcp:36:lfs.0 Request processed in 2122us (2200us total) trans 8589934755 rc 0/0 00000100:00100000:3.0:1772305831.967385:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 504 00000100:00100000:3.0:1772305831.970834:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225311936 00000100:00100000:3.0:1772305832.004585:0:54689:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225312896 00000100:00100000:3.0:1772305832.004660:0:54689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 110 00000100:00100000:3.0:1772305832.004671:0:54689:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f6e86c39 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2218:x1858396225312896:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1772305832.004736:0:54689:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f6e86c39 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2218:x1858396225312896:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 65us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305832.004755:0:54689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 110 00000100:00100000:3.0:1772305832.889849:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225313216 00000100:00100000:3.0:1772305832.889881:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5654 00000100:00100000:3.0:1772305832.889886:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d6661384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f935b4d0-e17f-49c8-8011-4be99ba75430+140:2216:x1858396225313216:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1772305832.889893:0:21400:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305832.889905:0:21400:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6e301 lrc: 2/0,0 mode: --/PR res: [0x1aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196e966 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305832.889945:0:21400:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003bce9793 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:21400:1858396216588224:192.168.203.30@tcp:106: 00000100:00100000:3.0:1772305832.889991:0:21400:0:(client.c:2500:ptlrpc_set_wait()) set 000000004a1bab96 going to sleep for 6 seconds 00000100:00100000:3.0:1772305832.892057:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225313280 00000100:00100000:3.0:1772305832.892086:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 515 00000100:00100000:3.0:1772305832.892090:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e634e198 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+39:91511:x1858396225313280:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1772305832.892098:0:55141:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305832.892107:0:55141:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000008a734987/0xa5e9c8c58c6e308 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196e96d expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305832.892132:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e30f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305832.892140:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e30f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305832.892146:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e30f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1772305832.892192:0:55141:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:3.0:1772305832.892196:0:55141:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 100 stripe count 1 MDT count 1 00000004:00010000:3.0:1772305832.892215:0:55141:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e30f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305832.892233:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000008a734987/0xa5e9c8c58c6e308 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e96d expref: 41 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305832.892246:0:55141:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e30f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e96d expref: 40 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305832.892252:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:3.0:1772305832.892254:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1772305832.892256:0:55141:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000051c27e8b, rc 0) 00000100:00100000:3.0:1772305832.892283:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e634e198 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+40:91511:x1858396225313280:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 192us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305832.892288:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 515 00000100:00100000:3.0:1772305832.893045:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305832.894662:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225313408 00000100:00100000:3.0:1772305832.894710:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5655 00000100:00100000:3.0:1772305832.894716:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000068687bb0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f935b4d0-e17f-49c8-8011-4be99ba75430+140:2215:x1858396225313408:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1772305832.894727:0:21400:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305832.894738:0:21400:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e324 lrc: 2/0,0 mode: --/PR res: [0x1aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196e97b expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305832.894772:0:21400:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000870e476c pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:21400:1858396216588288:192.168.203.30@tcp:106: 00000100:00100000:3.0:1772305832.894820:0:21400:0:(client.c:2500:ptlrpc_set_wait()) set 000000004f9214ed going to sleep for 6 seconds 00000100:00100000:3.0:1772305832.895471:0:21400:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000870e476c pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:21400:1858396216588288:192.168.203.30@tcp:106: 00010000:00010000:3.0:1772305832.895499:0:21400:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e324 lrc: 1/0,0 mode: --/PR res: [0x1aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e97b expref: 141 pid: 21400 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1772305832.895511:0:21400:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e324 lrc: 0/0,0 mode: --/PR res: [0x1aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e97b expref: 141 pid: 21400 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1772305832.895524:0:21400:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f0848df9, rc 0) 00000100:00100000:3.0:1772305832.895556:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000068687bb0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f935b4d0-e17f-49c8-8011-4be99ba75430+140:2215:x1858396225313408:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 839us (958us total) trans 0 rc 301/301 00000100:00100000:3.0:1772305832.895564:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5655 00000100:00100000:3.0:1772305832.896962:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225313536 00000100:00100000:3.0:1772305832.896994:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 517 00000100:00100000:3.0:1772305832.896998:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008d141ae1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+41:91511:x1858396225313536:12345-192.168.203.30@tcp:58:lfs.0 00000040:00080000:3.0:1772305832.897215:0:55141:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xf:0x0].23, 136 off11320 00000100:00100000:3.0:1772305832.897277:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008d141ae1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+41:91511:x1858396225313536:12345-192.168.203.30@tcp:58:lfs.0 Request processed in 276us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305832.897287:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 517 00000100:00100000:3.0:1772305832.926831:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000001:00080000:3.0:1772305832.927687:0:6332:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-OST0000: transno 4294968267 is committed 00000001:00080000:3.0:1772305832.927708:0:6332:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-OST0000: transno 4294968266 is committed 00000100:00100000:3.0:1772305832.935966:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00010000:3.0:1772305832.937334:0:6322:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1772305832.937338:0:6322:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6e36a lrc: 2/0,0 mode: PR/PR res: [0x1aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305832.937356:0:6322:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000043f9fbca already unused, calling callback (00000000b5e4f3c0) 00010000:00010000:3.0:1772305832.937358:0:6322:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6e36a lrc: 2/0,0 mode: PR/PR res: [0x1aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305832.937364:0:6322:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6e36a lrc: 3/0,0 mode: PR/PR res: [0x1aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305832.937376:0:6322:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6e36a lrc: 1/0,0 mode: --/PR res: [0x1aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305832.937386:0:6322:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6e36a lrc: 0/0,0 mode: --/PR res: [0x1aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305832.937406:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1772305832.937410:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1772305832.937411:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1772305832.938785:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305832.938789:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305832.939312:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 21 00000040:00080000:3.0:1772305832.939320:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:3.0:1772305833.197559:0:5495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3025 00000100:00100000:3.0:1772305833.197567:0:5495:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b7ea6417 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+52:2216:x1858396225315520:12345-192.168.203.30@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1772305833.197576:0:5495:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1772305833.197584:0:5495:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 0000000016b42150/0xa5e9c8c58c6e2d0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x31c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e94a expref: 52 pid: 55141 timeout: 1245 lvb_type: 0 00010000:00010000:3.0:1772305833.197621:0:5495:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 0000000016b42150/0xa5e9c8c58c6e2d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x31c:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e94a expref: 52 pid: 55141 timeout: 1245 lvb_type: 0 00010000:00010000:3.0:1772305833.197690:0:5495:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000016b42150/0xa5e9c8c58c6e2d0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x31c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e94a expref: 52 pid: 55141 timeout: 1245 lvb_type: 0 00010000:00010000:3.0:1772305833.197712:0:5495:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31c:0x0].0x0 (0000000060b58ddc) 00010000:00010000:3.0:1772305833.197717:0:5495:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: 000000007c4072b2/0xa5e9c8c58c6e394 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x31c:0x0].0x0 bits 0x28/0x0 rrc: 10 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305833.197730:0:5495:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: 000000007c4072b2/0xa5e9c8c58c6e394 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x31c:0x0].0x0 bits 0x28/0x0 rrc: 8 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305833.197735:0:5495:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1772305833.197764:0:5495:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b7ea6417 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+50:2216:x1858396225315520:12345-192.168.203.30@tcp:103:ldlm_bl_01.0 Request processed in 194us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305833.197776:0:5495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3025 00000100:00100000:3.0:1772305833.197855:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00010000:1.0:1772305833.210058:0:6323:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 0000000008260c3b/0xa5e9c8c58c6e3c5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x31c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e9ac expref: 46 pid: 54698 timeout: 1245 lvb_type: 0 00000100:00100000:1.0:1772305833.210112:0:6323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3030 00000100:00100000:1.0:1772305833.210122:0:6323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003e43a9e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+46:2216:x1858396225316032:12345-192.168.203.30@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1772305833.210134:0:6323:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1772305833.210140:0:6323:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 0000000008260c3b/0xa5e9c8c58c6e3c5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x31c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e9ac expref: 45 pid: 54698 timeout: 1245 lvb_type: 0 00010000:00010000:1.0:1772305833.210151:0:6323:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 0000000008260c3b/0xa5e9c8c58c6e3c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x31c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e9ac expref: 45 pid: 54698 timeout: 1245 lvb_type: 0 00010000:00010000:1.0:1772305833.210161:0:6323:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000008260c3b/0xa5e9c8c58c6e3c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x31c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e9ac expref: 45 pid: 54698 timeout: 1245 lvb_type: 0 00010000:00010000:1.0:1772305833.210171:0:6323:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31c:0x0].0x0 (0000000099e9a59a) 00010000:00010000:1.0:1772305833.210176:0:6323:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: 0000000081644fa4/0xa5e9c8c58c6e3cc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x31c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305833.210185:0:6323:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 0000000081644fa4/0xa5e9c8c58c6e3cc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x31c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305833.210190:0:6323:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000081644fa4/0xa5e9c8c58c6e3cc lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x31c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305833.210217:0:6323:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1772305833.210244:0:6323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003e43a9e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+43:2216:x1858396225316032:12345-192.168.203.30@tcp:103:ldlm_bl_02.0 Request processed in 123us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305833.210255:0:6323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3030 00010000:00010000:1.0:1772305833.672813:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1772305833.994134:0:54732:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007df68401 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:54732:1858396216589120:192.168.203.30@tcp:107:hsm_cdtr.0 00000040:00080000:3.0:1772305833.994181:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305833.994183:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305833.994249:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 25 count 22 00000040:00080000:3.0:1772305833.994253:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:3.0:1772305833.997072:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305834.001569:0:6323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225316672 00010000:00010000:1.0:1772305834.001591:0:6323:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e3a63400/0xa5e9c8c58c6e31d lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x7e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e974 expref: 43 pid: 55141 timeout: 1245 lvb_type: 0 00000100:00100000:1.0:1772305834.001619:0:6323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3031 00000100:00100000:1.0:1772305834.001656:0:6323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a43237bf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+43:2215:x1858396225316672:12345-192.168.203.30@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1772305834.001668:0:6323:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1772305834.001674:0:6323:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000e3a63400/0xa5e9c8c58c6e31d lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x7e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e974 expref: 43 pid: 55141 timeout: 1245 lvb_type: 0 00010000:00010000:1.0:1772305834.001687:0:6323:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000e3a63400/0xa5e9c8c58c6e31d lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x7e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e974 expref: 43 pid: 55141 timeout: 1245 lvb_type: 0 00010000:00010000:1.0:1772305834.001702:0:6323:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e3a63400/0xa5e9c8c58c6e31d lrc: 0/0,0 mode: --/PR res: [0x200000408:0x7e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e974 expref: 43 pid: 55141 timeout: 1245 lvb_type: 0 00010000:00010000:1.0:1772305834.001716:0:6323:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x7e:0x0].0x0 (000000001a996125) 00010000:00010000:1.0:1772305834.001719:0:6323:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6e404 lrc: 3/0,1 mode: --/CW res: [0x200000408:0x7e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305834.001729:0:6323:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6e404 lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x7e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305834.001736:0:6323:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6e404 lrc: 4/0,1 mode: CW/CW res: [0x200000408:0x7e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305834.001760:0:6323:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1772305834.001793:0:6323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a43237bf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+42:2215:x1858396225316672:12345-192.168.203.30@tcp:103:ldlm_bl_03.0 Request processed in 166us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305834.001829:0:6323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3031 00000100:00100000:3.0:1772305834.003714:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305834.004803:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305834.007607:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305834.008873:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305834.008926:0:6323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225317312 00010000:00010000:1.0:1772305834.008945:0:6323:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cd95bdab/0xa5e9c8c58c6e427 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e9c8 expref: 54 pid: 54698 timeout: 1245 lvb_type: 0 00000100:00100000:1.0:1772305834.008976:0:6323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3032 00000100:00100000:1.0:1772305834.008983:0:6323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000eeae7eda pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+54:2215:x1858396225317312:12345-192.168.203.30@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1772305834.008993:0:6323:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1772305834.008998:0:6323:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000cd95bdab/0xa5e9c8c58c6e427 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e9c8 expref: 54 pid: 54698 timeout: 1245 lvb_type: 0 00010000:00010000:1.0:1772305834.009023:0:6323:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000cd95bdab/0xa5e9c8c58c6e427 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e9c8 expref: 54 pid: 54698 timeout: 1245 lvb_type: 0 00010000:00010000:1.0:1772305834.009037:0:6323:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cd95bdab/0xa5e9c8c58c6e427 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e9c8 expref: 54 pid: 54698 timeout: 1245 lvb_type: 0 00010000:00010000:1.0:1772305834.009048:0:6323:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31d:0x0].0x0 (00000000aa411403) 00010000:00010000:1.0:1772305834.009052:0:6323:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6e435 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305834.009070:0:6323:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6e435 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305834.009077:0:6323:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6e435 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305834.009099:0:6323:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1772305834.009137:0:6323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000eeae7eda pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+53:2215:x1858396225317312:12345-192.168.203.30@tcp:103:ldlm_bl_04.0 Request processed in 153us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305834.009148:0:6323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3032 00000100:00100000:3.0:1772305834.010493:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305834.013822:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305834.016269:0:6323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225317824 00010000:00010000:1.0:1772305834.016303:0:6323:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006493e1f8/0xa5e9c8c58c6e451 lrc: 4/0,0 mode: PR/PR res: [0x1aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e9dd expref: 224 pid: 21400 timeout: 1245 lvb_type: 1 00000100:00100000:1.0:1772305834.016335:0:6323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3033 00000100:00100000:1.0:1772305834.016341:0:6323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000029164250 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+224:2216:x1858396225317824:12345-192.168.203.30@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1772305834.016355:0:6323:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1772305834.016370:0:6323:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006493e1f8/0xa5e9c8c58c6e451 lrc: 4/0,0 mode: PR/PR res: [0x1aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e9dd expref: 224 pid: 21400 timeout: 1245 lvb_type: 1 00010000:00010000:1.0:1772305834.016381:0:6323:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006493e1f8/0xa5e9c8c58c6e451 lrc: 3/0,0 mode: PR/PR res: [0x1aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e9dd expref: 224 pid: 21400 timeout: 1245 lvb_type: 1 00010000:00010000:1.0:1772305834.016398:0:6323:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006493e1f8/0xa5e9c8c58c6e451 lrc: 0/0,0 mode: --/PR res: [0x1aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e9dd expref: 224 pid: 21400 timeout: 1245 lvb_type: 1 00010000:00010000:1.0:1772305834.016411:0:6323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305834.016413:0:6323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305834.016418:0:6323:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bc6e3b0a/0xa5e9c8c58c6e458 lrc: 2/0,0 mode: PW/PW res: [0x1aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e9e4 expref: 223 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305834.016426:0:6323:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc6e3b0a/0xa5e9c8c58c6e458 lrc: 3/0,0 mode: PW/PW res: [0x1aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e9e4 expref: 223 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305834.016450:0:6323:0:(ldlm_lockd.c:1069:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000bc6e3b0a/0xa5e9c8c58c6e458 lrc: 3/0,0 mode: PW/PW res: [0x1aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e9e4 expref: 223 pid: 21400 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305834.016470:0:6323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007b492542 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6323:1858396216589376:192.168.203.30@tcp:105: 00000100:00100000:1.0:1772305834.016509:0:6323:0:(client.c:2500:ptlrpc_set_wait()) set 000000007d86e065 going to sleep for 6 seconds 00000100:00100000:1.0:1772305834.017463:0:6323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007b492542 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6323:1858396216589376:192.168.203.30@tcp:105: 00010000:00010000:1.0:1772305834.017476:0:6323:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1772305834.017514:0:6323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000029164250 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+223:2216:x1858396225317824:12345-192.168.203.30@tcp:103:ldlm_bl_01.0 Request processed in 1172us (1301us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305834.017523:0:6323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3033 00000100:00100000:1.0:1772305834.018097:0:21399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225317888 00002000:00100000:1.0:1772305834.018124:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1aa:0x0] (0->1515) req@000000006898b97b x1858396225317888/t0(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:720/0 lens 2008/0 e 0 to 0 dl 1772305840 ref 1 fl New:/0/ffffffff rc 0/-1 job:'lhsmtool_posix.0' 00002000:00100000:1.0:1772305834.018135:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 000000006898b97b with x1858396225317888 ext(0->1515) 00002000:00010000:1.0:1772305834.018140:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000006898b97b 00000100:00100000:1.0:1772305834.018165:0:21399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2006 00000100:00100000:1.0:1772305834.018172:0:21399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006898b97b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+223:2215:x1858396225317888:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1772305834.018620:0:21399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006898b97b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+225:2215:x1858396225317888:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 Request processed in 447us (571us total) trans 4294968268 rc 0/0 00000100:00100000:1.0:1772305834.018660:0:21399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2006 00002000:00100000:1.0:1772305834.018668:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1aa:0x0] (0->1515) req@000000006898b97b x1858396225317888/t4294968268(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:720/0 lens 2008/448 e 0 to 0 dl 1772305840 ref 1 fl Complete:/0/0 rc 0/0 job:'lhsmtool_posix.0' 00002000:00100000:1.0:1772305834.018678:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 000000006898b97b with x1858396225317888 ext(0->1515) 00002000:00010000:1.0:1772305834.018681:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000006898b97b 00000100:00100000:3.0:1772305834.019446:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000020:00080000:1.0:1772305834.029568:0:54735:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4295052951 committed batchid 4295052950 00000100:00100000:3.0:1772305834.029572:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d72a5614 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+47:91525:x1858396225317952:12345-192.168.203.30@tcp:44:lhsmtool_posix.0 Request processed in 10050us (10122us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305834.029586:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 542 00000020:00080000:1.0:1772305834.029760:0:54735:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4295052950 00010000:00010000:1.0:1772305834.029913:0:5497:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1772305834.029920:0:5497:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd3f7c05/0xa5e9c8c58c6e45f lrc: 2/0,0 mode: PW/PW res: [0x1aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305834.029930:0:5497:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cd3f7c05 already unused, calling callback (00000000b5e4f3c0) 00010000:00010000:1.0:1772305834.029934:0:5497:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd3f7c05/0xa5e9c8c58c6e45f lrc: 2/0,0 mode: PW/PW res: [0x1aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305834.029942:0:5497:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd3f7c05/0xa5e9c8c58c6e45f lrc: 3/0,0 mode: PW/PW res: [0x1aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305834.029963:0:5497:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd3f7c05/0xa5e9c8c58c6e45f lrc: 1/0,0 mode: --/PW res: [0x1aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305834.029970:0:5497:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd3f7c05/0xa5e9c8c58c6e45f lrc: 0/0,0 mode: --/PW res: [0x1aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305834.029988:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1772305834.029991:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1772305834.029994:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1772305834.038787:0:6332:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-OST0000: transno 4294968268 is committed 00000100:00100000:3.0:1772305834.039903:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305834.040804:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305834.042615:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305834.043773:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305834.043811:0:6323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225318464 00010000:00010000:1.0:1772305834.043827:0:6323:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 0000000046ff413b/0xa5e9c8c58c6e419 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x31d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e9c1 expref: 48 pid: 54698 timeout: 1245 lvb_type: 0 00000100:00100000:1.0:1772305834.043849:0:6323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3034 00000100:00100000:1.0:1772305834.043853:0:6323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ecbbf8d3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+48:2216:x1858396225318464:12345-192.168.203.30@tcp:103:ldlm_bl_08.0 00010000:00010000:1.0:1772305834.043861:0:6323:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1772305834.043871:0:6323:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 0000000046ff413b/0xa5e9c8c58c6e419 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x31d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e9c1 expref: 48 pid: 54698 timeout: 1245 lvb_type: 0 00010000:00010000:1.0:1772305834.043878:0:6323:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 0000000046ff413b/0xa5e9c8c58c6e419 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x31d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e9c1 expref: 48 pid: 54698 timeout: 1245 lvb_type: 0 00010000:00010000:1.0:1772305834.043887:0:6323:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000046ff413b/0xa5e9c8c58c6e419 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x31d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e9c1 expref: 48 pid: 54698 timeout: 1245 lvb_type: 0 00010000:00010000:1.0:1772305834.043894:0:6323:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31d:0x0].0x0 (00000000aa411403) 00010000:00010000:1.0:1772305834.043897:0:6323:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: 00000000dd98d4fa/0xa5e9c8c58c6e474 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x31d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305834.043902:0:6323:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000dd98d4fa/0xa5e9c8c58c6e474 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x31d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305834.043906:0:6323:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000dd98d4fa/0xa5e9c8c58c6e474 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x31d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305834.043919:0:6323:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1772305834.043947:0:6323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ecbbf8d3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+47:2216:x1858396225318464:12345-192.168.203.30@tcp:103:ldlm_bl_08.0 Request processed in 91us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305834.043961:0:6323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3034 00000100:00100000:3.0:1772305834.044735:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305834.045761:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305834.045791:0:6323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225318592 00010000:00010000:1.0:1772305834.045805:0:6323:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bc6e3b0a/0xa5e9c8c58c6e458 lrc: 4/0,0 mode: PW/PW res: [0x1aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e9e4 expref: 225 pid: 21400 timeout: 1245 lvb_type: 0 00000100:00100000:1.0:1772305834.045827:0:6323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3035 00000100:00100000:1.0:1772305834.045831:0:6323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b54c40cb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+225:2216:x1858396225318592:12345-192.168.203.30@tcp:103:ldlm_bl_05.0 00010000:00010000:1.0:1772305834.045846:0:6323:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1772305834.045854:0:6323:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bc6e3b0a/0xa5e9c8c58c6e458 lrc: 4/0,0 mode: PW/PW res: [0x1aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e9e4 expref: 225 pid: 21400 timeout: 1245 lvb_type: 0 00010000:00010000:1.0:1772305834.045861:0:6323:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bc6e3b0a/0xa5e9c8c58c6e458 lrc: 3/0,0 mode: PW/PW res: [0x1aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e9e4 expref: 225 pid: 21400 timeout: 1245 lvb_type: 0 00010000:00010000:1.0:1772305834.045873:0:6323:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc6e3b0a/0xa5e9c8c58c6e458 lrc: 0/0,0 mode: --/PW res: [0x1aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e9e4 expref: 225 pid: 21400 timeout: 1245 lvb_type: 0 00010000:00010000:1.0:1772305834.045880:0:6323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305834.045881:0:6323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305834.045883:0:6323:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e235ac0b/0xa5e9c8c58c6e47b lrc: 3/1,0 mode: PR/PR res: [0x1aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305834.045896:0:6323:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e235ac0b/0xa5e9c8c58c6e47b lrc: 4/1,0 mode: PR/PR res: [0x1aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305834.045914:0:6323:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1772305834.045941:0:6323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b54c40cb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+224:2216:x1858396225318592:12345-192.168.203.30@tcp:103:ldlm_bl_05.0 Request processed in 108us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305834.045956:0:6323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3035 00010000:00010000:3.0:1772305834.046025:0:6322:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1772305834.046030:0:6322:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e235ac0b/0xa5e9c8c58c6e47b lrc: 2/0,0 mode: PR/PR res: [0x1aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305834.046044:0:6322:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e235ac0b already unused, calling callback (00000000b5e4f3c0) 00010000:00010000:3.0:1772305834.046047:0:6322:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e235ac0b/0xa5e9c8c58c6e47b lrc: 2/0,0 mode: PR/PR res: [0x1aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305834.046055:0:6322:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e235ac0b/0xa5e9c8c58c6e47b lrc: 3/0,0 mode: PR/PR res: [0x1aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305834.046131:0:6322:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e235ac0b/0xa5e9c8c58c6e47b lrc: 1/0,0 mode: --/PR res: [0x1aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305834.046146:0:6322:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e235ac0b/0xa5e9c8c58c6e47b lrc: 0/0,0 mode: --/PR res: [0x1aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305834.046155:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1772305834.046156:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1772305834.046157:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1772305834.046610:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305834.047769:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305834.047794:0:6323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225318784 00010000:00010000:1.0:1772305834.047809:0:6323:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6e46d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e9eb expref: 48 pid: 54698 timeout: 1245 lvb_type: 0 00000100:00100000:1.0:1772305834.047829:0:6323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3036 00000100:00100000:1.0:1772305834.047833:0:6323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c8b2fa89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+48:2215:x1858396225318784:12345-192.168.203.30@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1772305834.047846:0:6323:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1772305834.047850:0:6323:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6e46d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e9eb expref: 48 pid: 54698 timeout: 1245 lvb_type: 0 00010000:00010000:1.0:1772305834.047856:0:6323:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6e46d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e9eb expref: 48 pid: 54698 timeout: 1245 lvb_type: 0 00010000:00010000:1.0:1772305834.047865:0:6323:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6e46d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e9eb expref: 48 pid: 54698 timeout: 1245 lvb_type: 0 00010000:00010000:1.0:1772305834.047881:0:6323:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31d:0x0].0x0 (00000000aa411403) 00010000:00010000:1.0:1772305834.047883:0:6323:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: 00000000349659bf/0xa5e9c8c58c6e482 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305834.047888:0:6323:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000349659bf/0xa5e9c8c58c6e482 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305834.047892:0:6323:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000349659bf/0xa5e9c8c58c6e482 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305834.047904:0:6323:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1772305834.047926:0:6323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c8b2fa89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+47:2215:x1858396225318784:12345-192.168.203.30@tcp:103:ldlm_bl_02.0 Request processed in 91us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305834.047932:0:6323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3036 00000100:00100000:3.0:1772305834.050248:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305834.050288:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225318848 00000100:00100000:1.0:1772305834.050318:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 69 00000100:00100000:1.0:1772305834.050325:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000133430f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+39:91524:x1858396225318848:12345-192.168.203.30@tcp:49:md5sum.0 00000100:00100000:1.0:1772305834.050383:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000133430f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+39:91524:x1858396225318848:12345-192.168.203.30@tcp:49:md5sum.0 Request processed in 58us (136us total) trans 0 rc 0/0 00000040:00080000:3.0:1772305834.050384:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305834.050387:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000100:00100000:1.0:1772305834.050400:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 69 00000040:00080000:3.0:1772305834.050931:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 22 00000040:00080000:3.0:1772305834.050939:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:3.0:1772305834.051161:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305834.051196:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225318976 00000100:00100000:1.0:1772305834.051220:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 70 00000100:00100000:1.0:1772305834.051224:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004db6797f pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+46:91525:x1858396225318976:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1772305834.051374:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000004:00080000:1.0:1772305834.051550:0:57054:0:(mdd_object.c:3529:mdd_close()) Object [0x200000402:0x31d:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1772305834.051619:0:57054:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934769 00010000:00010000:1.0:1772305834.051673:0:57054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000008260c3b/0xa5e9c8c58c6e497 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305834.051695:0:57054:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000008260c3b/0xa5e9c8c58c6e497 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x31d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446631280743258432 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305834.051702:0:57054:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000008260c3b/0xa5e9c8c58c6e497 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x31d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446631280743258432 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305834.051707:0:57054:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000008260c3b/0xa5e9c8c58c6e497 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x31d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446631280743258432 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305834.051712:0:57054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000008260c3b/0xa5e9c8c58c6e497 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x31d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446631280743258432 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305834.051715:0:57054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000008260c3b/0xa5e9c8c58c6e497 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x31d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446631280743258432 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305834.051727:0:57054:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1772305834.051815:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004db6797f pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+47:91525:x1858396225318976:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 587us (653us total) trans 8589934769 rc 0/0 00000100:00100000:1.0:1772305834.051837:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 70 00000100:00100000:3.0:1772305834.052557:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305834.052599:0:21399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225319168 00002000:00100000:1.0:1772305834.052619:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1aa:0x0] (0->4095) req@00000000d43cbca5 x1858396225319168/t0(0) o3->f935b4d0-e17f-49c8-8011-4be99ba75430@192.168.203.30@tcp:720/0 lens 488/0 e 0 to 0 dl 1772305840 ref 1 fl New:/0/ffffffff rc 0/-1 job:'md5sum.0' 00002000:00100000:1.0:1772305834.052703:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 00000000d43cbca5 with x1858396225319168 ext(0->4095) 00002000:00010000:1.0:1772305834.052707:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000d43cbca5 00000100:00100000:1.0:1772305834.052725:0:21399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2007 00000100:00100000:1.0:1772305834.052729:0:21399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d43cbca5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+160:2216:x1858396225319168:12345-192.168.203.30@tcp:3:md5sum.0 00000100:00100000:1.0:1772305834.052852:0:21399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d43cbca5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+160:2216:x1858396225319168:12345-192.168.203.30@tcp:3:md5sum.0 Request processed in 122us (297us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1772305834.052857:0:21399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2007 00002000:00100000:1.0:1772305834.052861:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1aa:0x0] (0->4095) req@00000000d43cbca5 x1858396225319168/t0(0) o3->f935b4d0-e17f-49c8-8011-4be99ba75430@192.168.203.30@tcp:720/0 lens 488/4536 e 0 to 0 dl 1772305840 ref 1 fl Complete:/0/0 rc 4096/4096 job:'md5sum.0' 00002000:00100000:1.0:1772305834.052867:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 00000000d43cbca5 with x1858396225319168 ext(0->4095) 00002000:00010000:1.0:1772305834.052870:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000d43cbca5 00000100:00100000:3.0:1772305834.054039:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305834.054075:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225319296 00000100:00100000:1.0:1772305834.054103:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 71 00000100:00100000:1.0:1772305834.054108:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000eeae7eda pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+39:91524:x1858396225319296:12345-192.168.203.30@tcp:35:md5sum.0 00000100:00100000:1.0:1772305834.054218:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000eeae7eda pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+40:91524:x1858396225319296:12345-192.168.203.30@tcp:35:md5sum.0 Request processed in 108us (178us total) trans 8589934770 rc 0/0 00000100:00100000:1.0:1772305834.054226:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 71 00000040:00080000:1.0:1772305834.333609:0:63458:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305834.333614:0:63458:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305834.333721:0:63458:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 25 count 22 00000040:00080000:1.0:1772305834.333730:0:63458:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:1.0:1772305834.333753:0:63458:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305834.333754:0:63458:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305834.333812:0:63458:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 25 count 22 00000040:00080000:1.0:1772305834.333814:0:63458:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:3.0:1772305834.360480:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305834.361501:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225319488 00000100:00100000:1.0:1772305834.362560:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225319552 00000100:00100000:1.0:1772305834.362589:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 550 00000100:00100000:1.0:1772305834.362594:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fe03945a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+47:91540:x1858396225319552:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1772305834.362743:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fe03945a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+47:91540:x1858396225319552:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 146us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305834.362754:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 550 00000100:00100000:3.0:1772305834.363363:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305834.363398:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225319616 00000100:00100000:1.0:1772305834.363423:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 551 00000100:00100000:1.0:1772305834.363428:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d8dbdab2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+47:91540:x1858396225319616:12345-192.168.203.30@tcp:501:chlg_load_threa.0 00000100:00100000:1.0:1772305834.363470:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d8dbdab2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+47:91540:x1858396225319616:12345-192.168.203.30@tcp:501:chlg_load_threa.0 Request processed in 42us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305834.363475:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 551 00000100:00100000:3.0:1772305834.364103:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305834.364137:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225319680 00000100:00100000:1.0:1772305834.364162:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 552 00000100:00100000:1.0:1772305834.364167:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000004c96b79 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+47:91540:x1858396225319680:12345-192.168.203.30@tcp:503:chlg_load_threa.0 00000100:00100000:1.0:1772305834.364237:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000004c96b79 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+47:91540:x1858396225319680:12345-192.168.203.30@tcp:503:chlg_load_threa.0 Request processed in 68us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305834.364243:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 552 00000100:00100000:1.0:1772305834.364921:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225319744 00000100:00100000:1.0:1772305834.364972:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 553 00000100:00100000:1.0:1772305834.364978:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000036f569f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+47:91540:x1858396225319744:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1772305834.365094:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000036f569f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+47:91540:x1858396225319744:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 115us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305834.365104:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 553 00000100:00100000:3.0:1772305834.365787:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305834.365827:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225319808 00000100:00100000:1.0:1772305834.365865:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 554 00000100:00100000:1.0:1772305834.365872:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e2fd14bd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+47:91540:x1858396225319808:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1772305834.365983:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e2fd14bd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+47:91540:x1858396225319808:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 111us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305834.365993:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 554 00000100:00100000:1.0:1772305834.440772:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002a43cdb5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216589888:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1772305834.440855:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305834.440965:0:6309:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:3.0:1772305834.440973:0:6309:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007b492542 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:2993:x1858396216589888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1772305834.440996:0:6309:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 741277696 pending 0 free 3829399552 avail 3826253824 00000100:00100000:3.0:1772305834.441066:0:6309:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007b492542 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:2993:x1858396216589888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305834.441089:0:6309:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00000100:00100000:1.0:1772305834.441118:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002a43cdb5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216589888:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1772305834.696775:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1772305834.952812:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000de1a3306 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:2993:1858396216590144:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1772305834.952828:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000036040640 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:2994:1858396216590208:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305834.952897:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216590080 00000100:00100000:1.0:1772305834.952901:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305834.952954:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216590208 00000100:00100000:1.0:1772305834.952960:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216590144 00000100:00100000:3.0:1772305834.952990:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1772305834.953012:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000085b92210 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:2992:x1858396216590080:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1772305834.953012:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1772305834.953022:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fb0c28f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:2994:x1858396216590208:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305834.953084:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000085b92210 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:2992:x1858396216590080:12345-0@lo:400:kworker/u8:0.0 Request processed in 88us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305834.953095:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1772305834.953098:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fb0c28f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:2994:x1858396216590208:12345-0@lo:400:kworker/u8:0.0 Request processed in 74us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305834.953116:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1772305834.953154:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004ab5c349 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:70aae467-c860-409f-ba1b-742f4d042da6:2991:1858396216590016:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1772305834.953176:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000036040640 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:2994:1858396216590208:0@lo:400:kworker/u8:0.0 00000040:00080000:3.0:1772305835.080813:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305835.080821:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00100000:3.0:1772305835.080856:0:54732:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 4 in log [0xf:0x1:0x0] 00000040:00100000:3.0:1772305835.080939:0:54732:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 5 in log [0xf:0x1:0x0] 00000040:00080000:3.0:1772305835.080967:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 25 count 20 00000040:00080000:3.0:1772305835.080974:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:1.0:1772305835.720752:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1772305836.217713:0:63655:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1772305836.217717:0:63655:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x11:0x1:0x0]:0 at index 1 of catalog [0x6:0xa:0x0] 00000040:00080000:3.0:1772305836.217758:0:63655:0:(llog.c:789:llog_process_thread()) stop processing plain 0x11:1:0 index 6 count 2 00000040:00080000:3.0:1772305836.217766:0:63655:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x6:10:0 index 2 count 2 00010000:00010000:3.0:1772305836.744801:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1772305836.800507:0:63751:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1772305836.800512:0:63751:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x11:0x1:0x0]:0 at index 1 of catalog [0x6:0xa:0x0] 00000040:00080000:3.0:1772305836.800952:0:63751:0:(llog.c:789:llog_process_thread()) stop processing plain 0x11:1:0 index 64768 count 1 00000040:00080000:3.0:1772305836.800963:0:63751:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x6:10:0 index 2 count 2 00000100:00100000:3.0:1772305836.832931:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225319936 00000100:00100000:3.0:1772305836.833000:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 556 00000100:00100000:3.0:1772305836.833018:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000029164250 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+47:91470:x1858396225319936:12345-192.168.203.30@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1772305836.833112:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000029164250 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+47:91470:x1858396225319936:12345-192.168.203.30@tcp:60:lhsmtool_posix.0 Request processed in 96us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305836.833119:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 556 00000100:00100000:1.0:1772305837.124701:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305837.124749:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305837.124784:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305837.124787:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225320000 00000100:00100000:1.0:1772305837.124818:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305837.124840:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 112 00000100:00100000:3.0:1772305837.124847:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000094ded96f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2218:x1858396225320000:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:1.0:1772305837.124858:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305837.124905:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305837.124911:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000094ded96f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2218:x1858396225320000:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 61us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305837.124919:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 112 00000100:00100000:3.0:1772305837.124969:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225320192 00000100:00100000:3.0:1772305837.125021:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 79 00000100:00100000:3.0:1772305837.125028:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a17edbba pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+40:2218:x1858396225320192:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1772305837.125126:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a17edbba pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+40:2218:x1858396225320192:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 38us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305837.125137:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 79 00000400:00000080:3.0:1772305837.372087:0:63799:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:3.0:1772305837.372093:0:63799:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 222c: Changelog for failed explicit restore ========================================================== 14:10:36 (1772305836) 00000100:00100000:1.0:1772305837.455154:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225320384 00000100:00100000:1.0:1772305837.455208:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 557 00000100:00100000:1.0:1772305837.455216:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000556f98b0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+47:92179:x1858396225320384:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1772305837.455238:0:54696:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305837.455257:0:54696:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6e49e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196e9f9 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.455313:0:54696:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6e4a5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.455328:0:54696:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6e4a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.455342:0:54696:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6e4a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1772305837.455405:0:54696:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:1.0:1772305837.455409:0:54696:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 100 stripe count 1 MDT count 1 00000004:00010000:1.0:1772305837.455432:0:54696:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6e4a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.455462:0:54696:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6e49e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e9f9 expref: 49 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.455488:0:54696:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6e4a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e9f9 expref: 48 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.455497:0:54696:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:1.0:1772305837.455500:0:54696:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1772305837.455502:0:54696:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000748ac5ea, rc 0) 00000100:00100000:1.0:1772305837.455553:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000556f98b0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+48:92179:x1858396225320384:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 337us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305837.455560:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 557 00000100:00100000:1.0:1772305837.458083:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305837.459389:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225320640 00000100:00100000:1.0:1772305837.459415:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 72 00000100:00100000:1.0:1772305837.459418:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003132ee1a pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+49:92180:x1858396225320640:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1772305837.459523:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003132ee1a pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+50:92180:x1858396225320640:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 104us (181us total) trans 8589934772 rc 0/0 00000100:00100000:1.0:1772305837.459529:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 72 00000100:00100000:3.0:1772305837.467137:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305837.469418:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305837.470559:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305837.470613:0:6323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225320960 00010000:00010000:1.0:1772305837.470659:0:6323:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6e4a5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e9f9 expref: 50 pid: 54696 timeout: 1249 lvb_type: 0 00000100:00100000:1.0:1772305837.470691:0:6323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3037 00000100:00100000:1.0:1772305837.470696:0:6323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000fd7c6d4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+50:2215:x1858396225320960:12345-192.168.203.30@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1772305837.470705:0:6323:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1772305837.470708:0:6323:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6e4a5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e9f9 expref: 50 pid: 54696 timeout: 1249 lvb_type: 0 00010000:00010000:1.0:1772305837.470730:0:6323:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6e4a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e9f9 expref: 50 pid: 54696 timeout: 1249 lvb_type: 0 00010000:00010000:1.0:1772305837.470740:0:6323:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6e4a5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196e9f9 expref: 50 pid: 54696 timeout: 1249 lvb_type: 0 00010000:00010000:1.0:1772305837.470748:0:6323:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:1.0:1772305837.470750:0:6323:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: 00000000e235ac0b/0xa5e9c8c58c6e4dd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.470756:0:6323:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000e235ac0b/0xa5e9c8c58c6e4dd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.470759:0:6323:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e235ac0b/0xa5e9c8c58c6e4dd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.470774:0:6323:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1772305837.470798:0:6323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000fd7c6d4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+49:2215:x1858396225320960:12345-192.168.203.30@tcp:103:ldlm_bl_04.0 Request processed in 100us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305837.470813:0:6323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3037 00000004:00200000:1.0:1772305837.471741:0:54696:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000408:0x80:0x0]: returning size 512 00010000:00010000:1.0:1772305837.471746:0:54696:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000e235ac0b/0xa5e9c8c58c6e4dd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.471752:0:54696:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e235ac0b/0xa5e9c8c58c6e4dd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.471756:0:54696:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000e235ac0b/0xa5e9c8c58c6e4dd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.471765:0:54696:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e235ac0b already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305837.471767:0:54696:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e235ac0b/0xa5e9c8c58c6e4dd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.471772:0:54696:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e235ac0b/0xa5e9c8c58c6e4dd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.471778:0:54696:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:1.0:1772305837.471779:0:54696:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305837.471781:0:54696:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000e235ac0b/0xa5e9c8c58c6e4dd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.471785:0:54696:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e235ac0b/0xa5e9c8c58c6e4dd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1772305837.471791:0:54696:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000faca0d01 reply state 00000000f6ecf991 transno 8589934773 ns: mdt-lustre-MDT0000_UUID lock: 00000000cd3f7c05/0xa5e9c8c58c6e4e4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4b3ca3f3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305837.471835:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000faca0d01 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+41:92181:x1858396225320896:12345-192.168.203.30@tcp:36:lfs.0 Request processed in 2355us (2419us total) trans 8589934773 rc 0/0 00000100:00100000:1.0:1772305837.471843:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 561 00010000:00010000:1.0:1772305837.472358:0:2977:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cd3f7c05/0xa5e9c8c58c6e4e4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4b3ca3f3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.472365:0:2977:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cd3f7c05/0xa5e9c8c58c6e4e4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4b3ca3f3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.472369:0:2977:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cd3f7c05/0xa5e9c8c58c6e4e4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4b3ca3f3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.472379:0:2977:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cd3f7c05 already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305837.472380:0:2977:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cd3f7c05/0xa5e9c8c58c6e4e4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4b3ca3f3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.472384:0:2977:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cd3f7c05/0xa5e9c8c58c6e4e4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4b3ca3f3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.472390:0:2977:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4b3ca3f3 (000000007f5f418e) 00010000:00010000:1.0:1772305837.472392:0:2977:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305837.472393:0:2977:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cd3f7c05/0xa5e9c8c58c6e4e4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x4b3ca3f3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.472397:0:2977:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cd3f7c05/0xa5e9c8c58c6e4e4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x4b3ca3f3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305837.582523:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305837.582601:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225321088 00000100:00100000:1.0:1772305837.582671:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 562 00000100:00100000:1.0:1772305837.582683:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000700bb73d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+40:92218:x1858396225321088:12345-192.168.203.30@tcp:36:mkdir.0 00000100:00100000:1.0:1772305837.582861:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000700bb73d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+40:92218:x1858396225321088:12345-192.168.203.30@tcp:36:mkdir.0 Request processed in 182us (343us total) trans 0 rc -17/-17 00000100:00100000:1.0:1772305837.582869:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 562 00000100:00100000:3.0:1772305837.583647:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305837.583694:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225321152 00000100:00100000:1.0:1772305837.583721:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 563 00000100:00100000:1.0:1772305837.583727:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000091b2c0c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+40:92218:x1858396225321152:12345-192.168.203.30@tcp:101:mkdir.0 00010000:00010000:1.0:1772305837.583738:0:54696:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305837.583758:0:54696:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6e4eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ea0e expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.583810:0:54696:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6e4f2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.583822:0:54696:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6e4f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.583830:0:54696:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6e4f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.583840:0:54696:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6e4f9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4b3ca3f3 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.583844:0:54696:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6e4f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4b3ca3f3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.583848:0:54696:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6e4f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4b3ca3f3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.583882:0:54696:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6e500 lrc: 3/1,0 mode: --/PR res: [0x200000408:0x80:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.583887:0:54696:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6e500 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x80:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.583891:0:54696:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6e500 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x80:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1772305837.583918:0:54696:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000408:0x80:0x0]: returning size 512 00000004:00200000:1.0:1772305837.583920:0:54696:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1772305837.583935:0:54696:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6e500 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x80:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.583948:0:54696:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6e4f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.583953:0:54696:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6e4f2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.583957:0:54696:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6e4f2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.583961:0:54696:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000089168eb already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305837.583963:0:54696:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6e4f2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.583968:0:54696:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6e4f2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.583976:0:54696:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:1.0:1772305837.583978:0:54696:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305837.583998:0:54696:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6e4f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.584004:0:54696:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6e4f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.584016:0:54696:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6e4f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4b3ca3f3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.584022:0:54696:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6e4f9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4b3ca3f3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.584038:0:54696:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6e4f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4b3ca3f3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.584041:0:54696:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c609f04e already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305837.584043:0:54696:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6e4f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4b3ca3f3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.584047:0:54696:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6e4f9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4b3ca3f3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.584052:0:54696:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4b3ca3f3 (000000004dada68c) 00010000:00010000:1.0:1772305837.584053:0:54696:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305837.584054:0:54696:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6e4f9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4b3ca3f3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.584058:0:54696:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6e4f9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4b3ca3f3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.584078:0:54696:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6e4eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ea0e expref: 42 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.584085:0:54696:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6e500 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x80:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ea0e expref: 41 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.584090:0:54696:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x80:0x0].0x0 (00000000a61c25fb) 00010000:00010000:1.0:1772305837.584091:0:54696:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1772305837.584092:0:54696:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006a4f0137, rc 0) 00000100:00100000:1.0:1772305837.584119:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000091b2c0c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+41:92218:x1858396225321152:12345-192.168.203.30@tcp:101:mkdir.0 Request processed in 392us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305837.584133:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 563 00000100:00100000:1.0:1772305837.605832:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225321216 00000100:00100000:1.0:1772305837.605874:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 564 00000100:00100000:1.0:1772305837.605883:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000026617907 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+49:92224:x1858396225321216:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1772305837.605900:0:54696:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305837.605914:0:54696:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6e507 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ea15 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.605954:0:54696:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6e50e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.605964:0:54696:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6e50e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.605972:0:54696:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6e50e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1772305837.606034:0:54696:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:1.0:1772305837.606038:0:54696:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 101 stripe count 1 MDT count 1 00000004:00010000:1.0:1772305837.606064:0:54696:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6e50e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.606089:0:54696:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6e507 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ea15 expref: 51 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.606106:0:54696:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6e50e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ea15 expref: 50 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.606115:0:54696:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:1.0:1772305837.606128:0:54696:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1772305837.606130:0:54696:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c609f04e, rc 0) 00000100:00100000:1.0:1772305837.606186:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000026617907 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+50:92224:x1858396225321216:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 305us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305837.606194:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 564 00000100:00100000:3.0:1772305837.607956:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305837.608002:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225321344 00000100:00100000:1.0:1772305837.608027:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 565 00000100:00100000:1.0:1772305837.608031:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ee92c34a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+41:92224:x1858396225321344:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1772305837.608039:0:54696:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305837.608040:0:54696:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1772305837.608051:0:54696:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6e500 lrc: 0/0,0 mode: --/PR res: [0x200000408:0x80:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ea0e expref: 41 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.608060:0:54696:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x80:0x0].0x0 (00000000a61c25fb) 00010000:00010000:1.0:1772305837.608065:0:54696:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1772305837.608071:0:54696:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6e515 lrc: 2/0,0 mode: --/CW res: [0x200000408:0x80:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ea1c expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.608134:0:54696:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000949f0123/0xa5e9c8c58c6e51c lrc: 3/0,1 mode: --/CW res: [0x200000408:0x80:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.608140:0:54696:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000949f0123/0xa5e9c8c58c6e51c lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x80:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.608145:0:54696:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000949f0123/0xa5e9c8c58c6e51c lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x80:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.608153:0:54696:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000e326753f/0xa5e9c8c58c6e523 lrc: 3/0,1 mode: --/PW res: [0x200000408:0x80:0x0].0xe3b444b9 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.608167:0:54696:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e326753f/0xa5e9c8c58c6e523 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x80:0x0].0xe3b444b9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.608171:0:54696:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e326753f/0xa5e9c8c58c6e523 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x80:0x0].0xe3b444b9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.608556:0:54696:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6e52a lrc: 3/1,0 mode: --/CR res: [0x200000408:0x82:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.608564:0:54696:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6e52a lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x82:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.608569:0:54696:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6e52a lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x82:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1772305837.608575:0:54696:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000408:0x82:0x0]: returning size 0 00010000:00010000:1.0:1772305837.608591:0:54696:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000949f0123/0xa5e9c8c58c6e51c lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x80:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.608596:0:54696:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000949f0123/0xa5e9c8c58c6e51c lrc: 2/0,0 mode: CW/CW res: [0x200000408:0x80:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.608600:0:54696:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000949f0123/0xa5e9c8c58c6e51c lrc: 3/0,0 mode: CW/CW res: [0x200000408:0x80:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.608603:0:54696:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000949f0123 already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305837.608605:0:54696:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000949f0123/0xa5e9c8c58c6e51c lrc: 3/0,0 mode: CW/CW res: [0x200000408:0x80:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.608610:0:54696:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000949f0123/0xa5e9c8c58c6e51c lrc: 4/0,0 mode: CW/CW res: [0x200000408:0x80:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.608621:0:54696:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x80:0x0].0x0 (000000004dada68c) 00010000:00010000:1.0:1772305837.608623:0:54696:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305837.608643:0:54696:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000949f0123/0xa5e9c8c58c6e51c lrc: 2/0,0 mode: --/CW res: [0x200000408:0x80:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.608648:0:54696:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000949f0123/0xa5e9c8c58c6e51c lrc: 0/0,0 mode: --/CW res: [0x200000408:0x80:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1772305837.608654:0:54696:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000ee92c34a reply state 00000000cebebe4b transno 8589934774 ns: mdt-lustre-MDT0000_UUID lock: 00000000e326753f/0xa5e9c8c58c6e523 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x80:0x0].0xe3b444b9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.608671:0:54696:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6e515 lrc: 0/0,0 mode: --/CW res: [0x200000408:0x80:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ea1c expref: 43 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.608679:0:54696:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6e52a lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x82:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ea1c expref: 42 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.608684:0:54696:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x82:0x0].0x0 (0000000088b0560f) 00010000:00010000:1.0:1772305837.608685:0:54696:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1772305837.608686:0:54696:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d142a9ac, rc 0) 00000100:00100000:1.0:1772305837.608721:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ee92c34a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+43:92224:x1858396225321344:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 688us (766us total) trans 8589934774 rc 0/0 00000100:00100000:1.0:1772305837.608728:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 565 00000100:00100000:3.0:1772305837.609858:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305837.609900:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225321472 00000100:00100000:1.0:1772305837.609929:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 566 00000100:00100000:1.0:1772305837.609933:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000010b5ceff pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+42:92224:x1858396225321472:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1772305837.609945:0:54696:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305837.609961:0:54696:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000367b2753/0xa5e9c8c58c6e538 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x80:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ea23 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.610015:0:54696:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6e53f lrc: 3/0,1 mode: --/EX res: [0x200000408:0x82:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.610025:0:54696:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6e52a lrc: 2/0,0 mode: CR/CR res: [0x200000408:0x82:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ea1c expref: 43 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.610030:0:54696:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6e53f lrc: 4/0,1 mode: --/EX res: [0x200000408:0x82:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.610054:0:54696:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6e52a lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x82:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ea1c expref: 43 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.610062:0:54696:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6e52a lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x82:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ea1c expref: 43 pid: 54696 timeout: 1249 lvb_type: 0 00000100:00100000:1.0:1772305837.610071:0:54696:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008c6fef83 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:54696:1858396216590336:192.168.203.30@tcp:104: 00000100:00100000:1.0:1772305837.610111:0:54696:0:(client.c:2500:ptlrpc_set_wait()) set 000000005e5103aa going to sleep for 6 seconds 00000100:00100000:1.0:1772305837.610779:0:54696:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008c6fef83 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:54696:1858396216590336:192.168.203.30@tcp:104: 00010000:00010000:1.0:1772305837.610796:0:54696:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6e53f lrc: 3/0,1 mode: --/EX res: [0x200000408:0x82:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305837.610975:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305837.611017:0:6323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225321536 00010000:00010000:1.0:1772305837.611034:0:6323:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6e52a lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x82:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ea1c expref: 44 pid: 54696 timeout: 1249 lvb_type: 0 00000100:00100000:1.0:1772305837.611062:0:6323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3038 00000100:00100000:1.0:1772305837.611074:0:6323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d8f6a4e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+44:2215:x1858396225321536:12345-192.168.203.30@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1772305837.611085:0:6323:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1772305837.611090:0:6323:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6e52a lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x82:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ea1c expref: 44 pid: 54696 timeout: 1249 lvb_type: 0 00010000:00010000:1.0:1772305837.611100:0:6323:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6e52a lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x82:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ea1c expref: 44 pid: 54696 timeout: 1249 lvb_type: 0 00010000:00010000:1.0:1772305837.611111:0:6323:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6e52a lrc: 0/0,0 mode: --/CR res: [0x200000408:0x82:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ea1c expref: 44 pid: 54696 timeout: 1249 lvb_type: 0 00010000:00010000:1.0:1772305837.611121:0:6323:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x82:0x0].0x0 (0000000088b0560f) 00010000:00010000:1.0:1772305837.611124:0:6323:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6e53f lrc: 3/0,1 mode: --/EX res: [0x200000408:0x82:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.611132:0:6323:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6e53f lrc: 3/0,1 mode: EX/EX res: [0x200000408:0x82:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.611138:0:6323:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6e53f lrc: 4/0,1 mode: EX/EX res: [0x200000408:0x82:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.611156:0:6323:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1772305837.611180:0:6323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d8f6a4e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+43:2215:x1858396225321536:12345-192.168.203.30@tcp:103:ldlm_bl_01.0 Request processed in 104us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305837.611200:0:6323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3038 00000100:00100000:3.0:1772305837.612081:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305837.612117:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225321664 00000100:00100000:1.0:1772305837.612150:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 73 00000100:00100000:1.0:1772305837.612155:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d46ead63 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+42:92224:x1858396225321664:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1772305837.612301:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d46ead63 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+43:92224:x1858396225321664:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 146us (221us total) trans 8589934776 rc 0/0 00000100:00100000:1.0:1772305837.612308:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 73 00000100:00100000:3.0:1772305837.612870:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305837.614549:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305837.614652:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 569 00000100:00100000:3.0:1772305837.614658:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000082a20edb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+45:92224:x1858396225321984:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1772305837.614757:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e55b lrc: 3/0,1 mode: --/PW res: [0x200000408:0x82:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305837.614765:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e55b lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x82:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305837.614771:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e55b lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x82:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1772305837.614824:0:54698:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934778 00000004:00010000:3.0:1772305837.614838:0:54698:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000082a20edb reply state 00000000c2af62f8 transno 8589934778 ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e55b lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x82:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305837.614886:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000082a20edb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+47:92224:x1858396225321984:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 228us (339us total) trans 8589934778 rc 0/0 00000100:00100000:3.0:1772305837.614891:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 569 00010000:00010000:1.0:1772305837.615387:0:2977:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e55b lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x82:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.615394:0:2977:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e55b lrc: 2/0,0 mode: PW/PW res: [0x200000408:0x82:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.615398:0:2977:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e55b lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x82:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.615402:0:2977:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f0848df9 already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305837.615404:0:2977:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e55b lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x82:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.615407:0:2977:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e55b lrc: 4/0,0 mode: PW/PW res: [0x200000408:0x82:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.615414:0:2977:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x82:0x0].0x0 (0000000088c8ea8b) 00010000:00010000:1.0:1772305837.615417:0:2977:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1772305837.615418:0:2977:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e55b lrc: 2/0,0 mode: --/PW res: [0x200000408:0x82:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305837.615422:0:2977:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e55b lrc: 0/0,0 mode: --/PW res: [0x200000408:0x82:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305837.615522:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305837.615556:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225322112 00000100:00100000:1.0:1772305837.615589:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 74 00000100:00100000:1.0:1772305837.615604:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002a43cdb5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+46:92224:x1858396225322112:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1772305837.615738:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002a43cdb5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+47:92224:x1858396225322112:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 136us (216us total) trans 8589934779 rc 0/0 00000100:00100000:1.0:1772305837.615746:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 74 00000100:00100000:3.0:1772305837.628360:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305837.630046:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225322240 00000100:00100000:3.0:1772305837.630079:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 571 00000100:00100000:3.0:1772305837.630086:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009811a663 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+48:92226:x1858396225322240:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1772305837.630097:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305837.630115:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000008a734987/0xa5e9c8c58c6e57e lrc: 2/0,0 mode: --/CR res: [0x200000408:0x80:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ea38 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305837.630149:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e585 lrc: 3/1,0 mode: --/CR res: [0x200000408:0x80:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305837.630160:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e585 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x80:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305837.630169:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e585 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x80:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305837.630182:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e58c lrc: 3/1,0 mode: --/PR res: [0x200000408:0x80:0x0].0xe3b444b9 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305837.630190:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e58c lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x80:0x0].0xe3b444b9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305837.630197:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e58c lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x80:0x0].0xe3b444b9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305837.630249:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6e593 lrc: 3/1,0 mode: --/PR res: [0x200000408:0x82:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305837.630258:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6e593 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x82:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305837.630265:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6e593 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x82:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1772305837.630286:0:54698:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000408:0x82:0x0]: returning size 1516 00000004:00200000:3.0:1772305837.630294:0:54698:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1772305837.630306:0:54698:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6e593 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x82:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305837.630316:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6e593 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x82:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305837.630322:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e585 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x80:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305837.630329:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e585 lrc: 2/0,0 mode: CR/CR res: [0x200000408:0x80:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305837.630335:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e585 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x80:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305837.630341:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f0848df9 already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305837.630343:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e585 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x80:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305837.630349:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e585 lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x80:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305837.630358:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x80:0x0].0x0 (000000009a06949c) 00010000:00010000:3.0:1772305837.630361:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305837.630363:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e585 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x80:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305837.630369:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e585 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x80:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305837.630379:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e58c lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x80:0x0].0xe3b444b9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305837.630392:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e58c lrc: 2/0,0 mode: PR/PR res: [0x200000408:0x80:0x0].0xe3b444b9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305837.630398:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e58c lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x80:0x0].0xe3b444b9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305837.630404:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000051c27e8b already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305837.630406:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e58c lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x80:0x0].0xe3b444b9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305837.630413:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e58c lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x80:0x0].0xe3b444b9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305837.630420:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x80:0x0].0xe3b444b9 (000000005333691a) 00010000:00010000:3.0:1772305837.630423:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305837.630425:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e58c lrc: 2/0,0 mode: --/PR res: [0x200000408:0x80:0x0].0xe3b444b9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305837.630430:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e58c lrc: 0/0,0 mode: --/PR res: [0x200000408:0x80:0x0].0xe3b444b9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305837.630453:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000008a734987/0xa5e9c8c58c6e57e lrc: 0/0,0 mode: --/CR res: [0x200000408:0x80:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ea38 expref: 50 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305837.630465:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6e593 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x82:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ea38 expref: 49 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305837.630471:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x82:0x0].0x0 (0000000088c8ea8b) 00010000:00010000:3.0:1772305837.630480:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1772305837.630482:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c6c2d285, rc 0) 00000100:00100000:3.0:1772305837.630520:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009811a663 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+49:92226:x1858396225322240:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 434us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305837.630527:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 571 00000040:00080000:3.0:1772305838.152806:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305838.152813:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305838.153589:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 20 00000040:00080000:3.0:1772305838.153598:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:3.0:1772305838.564227:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305838.568790:0:6323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225322624 00010000:00010000:1.0:1772305838.568811:0:6323:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6e593 lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x82:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ea38 expref: 52 pid: 54698 timeout: 1250 lvb_type: 0 00000100:00100000:1.0:1772305838.568844:0:6323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3039 00000100:00100000:1.0:1772305838.568853:0:6323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003132ee1a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+53:2215:x1858396225322624:12345-192.168.203.30@tcp:103:ldlm_bl_05.0 00010000:00010000:1.0:1772305838.568863:0:6323:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1772305838.568871:0:6323:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6e593 lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x82:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ea38 expref: 53 pid: 54698 timeout: 1250 lvb_type: 0 00010000:00010000:1.0:1772305838.568882:0:6323:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6e593 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x82:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ea38 expref: 53 pid: 54698 timeout: 1250 lvb_type: 0 00010000:00010000:1.0:1772305838.568906:0:6323:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6e593 lrc: 0/0,0 mode: --/PR res: [0x200000408:0x82:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ea38 expref: 53 pid: 54698 timeout: 1250 lvb_type: 0 00010000:00010000:1.0:1772305838.568929:0:6323:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x82:0x0].0x0 (0000000088c8ea8b) 00010000:00010000:1.0:1772305838.568936:0:6323:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: 00000000e3a63400/0xa5e9c8c58c6e5b6 lrc: 3/0,1 mode: --/EX res: [0x200000408:0x82:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305838.568943:0:6323:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000e3a63400/0xa5e9c8c58c6e5b6 lrc: 3/0,1 mode: EX/EX res: [0x200000408:0x82:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305838.568946:0:6323:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e3a63400/0xa5e9c8c58c6e5b6 lrc: 4/0,1 mode: EX/EX res: [0x200000408:0x82:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305838.568990:0:6323:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1772305838.569028:0:6323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003132ee1a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+51:2215:x1858396225322624:12345-192.168.203.30@tcp:103:ldlm_bl_05.0 Request processed in 167us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305838.569039:0:6323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3039 00010000:00010000:1.0:1772305838.792739:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1772305838.845053:0:63992:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305838.845059:0:63992:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305838.845160:0:63992:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 26 count 21 00000040:00080000:3.0:1772305838.845167:0:63992:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:3.0:1772305838.845199:0:63992:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305838.845202:0:63992:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305838.845293:0:63992:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 26 count 21 00000040:00080000:3.0:1772305838.845298:0:63992:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000001:00080000:1.0:1772305839.067157:0:7114:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-OST0001: transno 4294968338 is committed 00000020:00080000:1.0:1772305839.067750:0:54735:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4295052951 00000020:00080000:1.0:1772305839.067761:0:54735:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4295052951 00000020:00080000:1.0:1772305839.067765:0:54735:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4295052952 committed batchid 4295052951 00000020:00080000:1.0:1772305839.067902:0:54735:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4295052951 00000040:00080000:3.0:1772305839.176817:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305839.176824:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305839.176857:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 26 count 21 00000040:00080000:3.0:1772305839.176865:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:3.0:1772305839.176952:0:54732:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000af42919f pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:54732:1858396216590528:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1772305839.177043:0:54732:0:(client.c:2500:ptlrpc_set_wait()) set 00000000dbb93bd8 going to sleep for 6 seconds 00000100:00100000:1.0:1772305839.560811:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004ca53634 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216590656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1772305839.560948:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305839.561035:0:6309:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 424 00000100:00100000:3.0:1772305839.561043:0:6309:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008c6fef83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216590656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1772305839.561065:0:6309:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 741277696 pending 0 free 3829399552 avail 3827302400 00000100:00100000:3.0:1772305839.561126:0:6309:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008c6fef83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216590656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305839.561163:0:6309:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 424 00000100:00100000:1.0:1772305839.561163:0:2992:0:(client.c:2868:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968270 gen 2 00000004:00080000:1.0:1772305839.561171:0:2992:0:(osp_trans.c:1044:osp_request_commit_cb()) trans no 4294968270 committed transno 4294968270 00000100:00100000:1.0:1772305839.561197:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004ca53634 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216590656:0@lo:13:osp-pre-0-0.0 00000040:00100000:3.0:1772305839.561220:0:54721:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 7 in log [0xd:0x1:0x0] 00010000:00010000:1.0:1772305839.816830:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772305840.072859:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fbb012e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:2992:1858396216590912:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1772305840.072922:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305840.073011:0:54689:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216590720 00000100:00100000:1.0:1772305840.073014:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216590912 00000100:00100000:3.0:1772305840.073050:0:54689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1772305840.073057:0:54689:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007468e6da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70aae467-c860-409f-ba1b-742f4d042da6+18:2993:x1858396216590720:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1772305840.073060:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1772305840.073068:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000018f22afe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:2991:x1858396216590848:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305840.073115:0:54689:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007468e6da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70aae467-c860-409f-ba1b-742f4d042da6+18:2993:x1858396216590720:12345-0@lo:400:kworker/u8:0.0 Request processed in 58us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305840.073121:0:54689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1772305840.073157:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000018f22afe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:2991:x1858396216590848:12345-0@lo:400:kworker/u8:0.0 Request processed in 87us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305840.073166:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000040:00080000:1.0:1772305840.130205:0:64047:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305840.130210:0:64047:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305840.130287:0:64047:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 26 count 21 00000040:00080000:1.0:1772305840.130291:0:64047:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:1.0:1772305840.130319:0:64047:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305840.130320:0:64047:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305840.130383:0:64047:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 26 count 21 00000040:00080000:1.0:1772305840.130386:0:64047:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:3.0:1772305840.145705:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305840.147667:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00010000:3.0:1772305840.148445:0:6322:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1772305840.148452:0:6322:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000008fd35de5/0xa5e9c8c58c6e5ee lrc: 2/0,0 mode: PW/PW res: [0x200000408:0x82:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 18446631284783364544 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305840.148461:0:6322:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000008fd35de5 already unused, calling callback (00000000b5e4f3c0) 00010000:00010000:3.0:1772305840.148465:0:6322:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000008fd35de5/0xa5e9c8c58c6e5ee lrc: 2/0,0 mode: PW/PW res: [0x200000408:0x82:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 18446631284783364544 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305840.148474:0:6322:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000008fd35de5/0xa5e9c8c58c6e5ee lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x82:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 18446631284783364544 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305840.148489:0:6322:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x82:0x0].0x0 (0000000088c8ea8b) 00010000:00010000:3.0:1772305840.148498:0:6322:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1772305840.148502:0:6322:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000008fd35de5/0xa5e9c8c58c6e5ee lrc: 1/0,0 mode: --/PW res: [0x200000408:0x82:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 18446631284783364544 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305840.148517:0:6322:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000008fd35de5/0xa5e9c8c58c6e5ee lrc: 0/0,0 mode: --/PW res: [0x200000408:0x82:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 18446631284783364544 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305840.148572:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1772305840.148576:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1772305840.148578:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772305840.187249:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00010000:1.0:1772305840.187427:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6e5f5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305840.187447:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6e5f5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305840.187460:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6e5f5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305840.187477:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6e5fc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x682f6642 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305840.187485:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6e5fc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x682f6642 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305840.187492:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6e5fc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x682f6642 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305840.187537:0:55141:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6e5f5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305840.187542:0:55141:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6e5f5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305840.187553:0:55141:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6e5f5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305840.187557:0:55141:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d142a9ac already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305840.187560:0:55141:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6e5f5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305840.187564:0:55141:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6e5f5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305840.187573:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (00000000c78481f6) 00010000:00010000:1.0:1772305840.187575:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305840.187578:0:55141:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6e5f5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305840.187582:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6e5f5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305840.187587:0:55141:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6e5fc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x682f6642 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305840.187591:0:55141:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6e5fc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x682f6642 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305840.187597:0:55141:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6e5fc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x682f6642 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305840.187603:0:55141:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000089168eb already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305840.187605:0:55141:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6e5fc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x682f6642 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305840.187617:0:55141:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6e5fc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x682f6642 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305840.187663:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x682f6642 (00000000663af6c8) 00010000:00010000:1.0:1772305840.187667:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305840.187671:0:55141:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6e5fc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x682f6642 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305840.187678:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6e5fc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x682f6642 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305840.187746:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000133430f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+46:92296:x1858396225322944:12345-192.168.203.30@tcp:34:lhsmtool_posix.0 Request processed in 400us (498us total) trans 0 rc -2/-2 00000100:00100000:1.0:1772305840.187752:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 578 00000100:00100000:3.0:1772305840.188542:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305840.188586:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225323072 00000100:00100000:1.0:1772305840.188617:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 579 00000100:00100000:1.0:1772305840.188624:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009531bf01 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+46:92296:x1858396225323072:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000040:00080000:1.0:1772305840.188857:0:55141:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x13:0x0].23, 168 off11960 00010000:00010000:1.0:1772305840.188904:0:55141:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000e3a63400/0xa5e9c8c58c6e5b6 lrc: 3/0,1 mode: EX/EX res: [0x200000408:0x82:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305840.188913:0:55141:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e3a63400/0xa5e9c8c58c6e5b6 lrc: 2/0,0 mode: EX/EX res: [0x200000408:0x82:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305840.188919:0:55141:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000e3a63400/0xa5e9c8c58c6e5b6 lrc: 3/0,0 mode: EX/EX res: [0x200000408:0x82:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305840.188925:0:55141:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e3a63400 already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305840.188934:0:55141:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e3a63400/0xa5e9c8c58c6e5b6 lrc: 3/0,0 mode: EX/EX res: [0x200000408:0x82:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305840.188941:0:55141:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e3a63400/0xa5e9c8c58c6e5b6 lrc: 4/0,0 mode: EX/EX res: [0x200000408:0x82:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305840.188949:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x82:0x0].0x0 (0000000088c8ea8b) 00010000:00010000:1.0:1772305840.188952:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1772305840.188954:0:55141:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000e3a63400/0xa5e9c8c58c6e5b6 lrc: 2/0,0 mode: --/EX res: [0x200000408:0x82:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305840.188960:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e3a63400/0xa5e9c8c58c6e5b6 lrc: 0/0,0 mode: --/EX res: [0x200000408:0x82:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1772305840.189041:0:55141:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305840.189045:0:55141:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305840.189104:0:55141:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 26 count 21 00000040:00080000:1.0:1772305840.189110:0:55141:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:1.0:1772305840.189164:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009531bf01 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+47:92296:x1858396225323072:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 539us (622us total) trans 8589934781 rc 0/0 00000100:00100000:1.0:1772305840.189173:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 579 00000040:00080000:1.0:1772305840.467831:0:64098:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305840.467838:0:64098:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305840.467974:0:64098:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 26 count 21 00000040:00080000:1.0:1772305840.467982:0:64098:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:1.0:1772305840.468014:0:64098:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305840.468015:0:64098:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305840.468075:0:64098:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 26 count 21 00000040:00080000:1.0:1772305840.468077:0:64098:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:1.0:1772305840.495346:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225323136 00000100:00100000:1.0:1772305840.495408:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 580 00000100:00100000:1.0:1772305840.495414:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bbac71e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+47:92311:x1858396225323136:12345-192.168.203.30@tcp:501:chlg_load_threa.0 00000100:00100000:1.0:1772305840.495559:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bbac71e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+47:92311:x1858396225323136:12345-192.168.203.30@tcp:501:chlg_load_threa.0 Request processed in 144us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305840.495569:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 580 00000100:00100000:1.0:1772305840.496590:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225323200 00000100:00100000:1.0:1772305840.496618:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 581 00000100:00100000:1.0:1772305840.496622:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b7ea6417 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+47:92311:x1858396225323200:12345-192.168.203.30@tcp:503:chlg_load_threa.0 00000100:00100000:1.0:1772305840.496927:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b7ea6417 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+47:92311:x1858396225323200:12345-192.168.203.30@tcp:503:chlg_load_threa.0 Request processed in 304us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305840.496934:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 581 00000100:00100000:1.0:1772305840.497670:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225323264 00000100:00100000:1.0:1772305840.497703:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 582 00000100:00100000:1.0:1772305840.497708:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003e43a9e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+47:92311:x1858396225323264:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1772305840.497839:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003e43a9e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+47:92311:x1858396225323264:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 131us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305840.497845:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 582 00000100:00100000:3.0:1772305840.498482:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305840.498524:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225323328 00000100:00100000:1.0:1772305840.498551:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 583 00000100:00100000:1.0:1772305840.498557:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002982a7a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+47:92311:x1858396225323328:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1772305840.498718:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002982a7a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+47:92311:x1858396225323328:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 161us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305840.498725:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 583 00000100:00100000:3.0:1772305840.499470:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305840.499510:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225323392 00000100:00100000:1.0:1772305840.499543:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 584 00000100:00100000:1.0:1772305840.499546:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000100f06cf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+47:92311:x1858396225323392:12345-192.168.203.30@tcp:501:chlg_load_threa.0 00000100:00100000:1.0:1772305840.499595:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000100f06cf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+47:92311:x1858396225323392:12345-192.168.203.30@tcp:501:chlg_load_threa.0 Request processed in 46us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305840.499604:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 584 00000100:00100000:3.0:1772305840.500210:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305840.500241:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225323456 00000100:00100000:1.0:1772305840.500261:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 585 00000100:00100000:1.0:1772305840.500265:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000029210a42 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+47:92311:x1858396225323456:12345-192.168.203.30@tcp:503:chlg_load_threa.0 00000100:00100000:1.0:1772305840.500330:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000029210a42 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+47:92311:x1858396225323456:12345-192.168.203.30@tcp:503:chlg_load_threa.0 Request processed in 63us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305840.500335:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 585 00000100:00100000:3.0:1772305840.500918:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305840.500946:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225323520 00000100:00100000:1.0:1772305840.500981:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 586 00000100:00100000:1.0:1772305840.500985:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000911e7fcc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+47:92311:x1858396225323520:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1772305840.501052:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000911e7fcc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+47:92311:x1858396225323520:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 66us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305840.501059:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 586 00000100:00100000:3.0:1772305840.501650:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305840.501684:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225323584 00000100:00100000:1.0:1772305840.501706:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 587 00000100:00100000:1.0:1772305840.501710:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000052c29410 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+47:92311:x1858396225323584:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1772305840.501782:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000052c29410 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+47:92311:x1858396225323584:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 71us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305840.501787:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 587 00010000:00010000:1.0:1772305841.864758:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772305842.243832:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225323712 00000100:00100000:1.0:1772305842.243882:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 83 00000100:00100000:1.0:1772305842.243889:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008a3f3626 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+47:2215:x1858396225323712:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:1.0:1772305842.243977:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008a3f3626 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+47:2215:x1858396225323712:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 85us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305842.244003:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 83 00000100:00100000:1.0:1772305842.244029:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225323904 00000100:00100000:1.0:1772305842.244066:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 84 00000100:00100000:1.0:1772305842.244071:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000601911f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+41:2216:x1858396225323904:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:1.0:1772305842.244116:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000601911f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+41:2216:x1858396225323904:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 42us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305842.244129:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 84 00000100:00100000:1.0:1772305842.244169:0:6308:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1112 00000100:00100000:1.0:1772305842.244181:0:6308:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000018743e89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+160:2215:x1858396225323968:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:1.0:1772305842.244213:0:6308:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000018743e89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+160:2215:x1858396225323968:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 37us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305842.244221:0:6308:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1112 00000100:00100000:1.0:1772305842.244264:0:6308:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225324032 00000100:00100000:1.0:1772305842.244288:0:6308:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1113 00000100:00100000:1.0:1772305842.244291:0:6308:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000830ec897 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+140:2216:x1858396225324032:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:1.0:1772305842.244311:0:6308:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000830ec897 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+140:2216:x1858396225324032:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 18us (75us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305842.244315:0:6308:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1113 00000100:00100000:3.0:1772305842.466484:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00010000:1.0:1772305842.888771:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1772305843.042767:0:64390:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1772305843.042772:0:64390:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x11:0x1:0x0]:0 at index 1 of catalog [0x6:0xa:0x0] 00000040:00080000:3.0:1772305843.043311:0:64390:0:(llog.c:789:llog_process_thread()) stop processing plain 0x11:1:0 index 64768 count 1 00000040:00080000:3.0:1772305843.043321:0:64390:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x6:10:0 index 2 count 2 00000100:00100000:3.0:1772305843.117609:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000400:00000080:3.0:1772305843.646104:0:64438:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:3.0:1772305843.646110:0:64438:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 222d: Changelog for failed implicit restore ========================================================== 14:10:43 (1772305843) 00000100:00100000:1.0:1772305843.763059:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305843.765086:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305843.765133:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225324416 00000100:00100000:1.0:1772305843.765160:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 75 00000100:00100000:1.0:1772305843.765164:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004ca53634 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+48:92960:x1858396225324416:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1772305843.765290:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004ca53634 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+49:92960:x1858396225324416:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 125us (207us total) trans 8589934783 rc 0/0 00000100:00100000:1.0:1772305843.765296:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 75 00000100:00100000:3.0:1772305843.766028:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305843.775909:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305843.777184:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00010000:1.0:1772305843.778750:0:2977:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000003bb10b1c/0xa5e9c8c58c6e63b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x17321ebd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305843.778757:0:2977:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000003bb10b1c/0xa5e9c8c58c6e63b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x17321ebd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305843.778761:0:2977:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000003bb10b1c/0xa5e9c8c58c6e63b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x17321ebd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305843.778764:0:2977:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000003bb10b1c already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305843.778766:0:2977:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000003bb10b1c/0xa5e9c8c58c6e63b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x17321ebd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305843.778769:0:2977:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000003bb10b1c/0xa5e9c8c58c6e63b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x17321ebd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305843.778776:0:2977:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x17321ebd (00000000a1075899) 00010000:00010000:1.0:1772305843.778778:0:2977:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305843.778779:0:2977:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000003bb10b1c/0xa5e9c8c58c6e63b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x17321ebd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305843.778783:0:2977:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000003bb10b1c/0xa5e9c8c58c6e63b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x17321ebd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305843.782294:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305843.783663:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305843.788364:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305843.789710:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305843.790833:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305843.796873:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305843.798163:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305843.799364:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305843.801753:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305843.802971:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305843.803014:0:6308:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225325440 00000100:00100000:1.0:1772305843.803044:0:6308:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5668 00000100:00100000:1.0:1772305843.803048:0:6308:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000077dbbbf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2216:x1858396225325440:12345-192.168.203.30@tcp:101:cp.0 00010000:00010000:1.0:1772305843.803056:0:6308:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305843.803068:0:6308:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000089168eb/0xa5e9c8c58c6e714 lrc: 2/0,0 mode: --/PR res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196eaa1 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1772305843.803084:0:6308:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x1ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1772305843.803094:0:6308:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305843.803096:0:6308:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305843.803100:0:6308:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000089168eb/0xa5e9c8c58c6e714 lrc: 3/0,0 mode: PR/PR res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eaa1 expref: 228 pid: 6308 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1772305843.803111:0:6308:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000089168eb/0xa5e9c8c58c6e714 lrc: 3/0,0 mode: PR/PR res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eaa1 expref: 228 pid: 6308 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1772305843.803118:0:6308:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000089168eb, rc 0) 00000100:00100000:1.0:1772305843.803143:0:6308:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000077dbbbf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+228:2216:x1858396225325440:12345-192.168.203.30@tcp:101:cp.0 Request processed in 95us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305843.803148:0:6308:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5668 00000100:00100000:1.0:1772305843.804242:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305843.805575:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305843.806937:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305843.806990:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225325696 00000100:00100000:1.0:1772305843.807015:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 76 00000100:00100000:1.0:1772305843.807026:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e6635d8a pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+52:92964:x1858396225325696:12345-192.168.203.30@tcp:35:cp.0 00000100:00100000:1.0:1772305843.807212:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e6635d8a pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+53:92964:x1858396225325696:12345-192.168.203.30@tcp:35:cp.0 Request processed in 185us (275us total) trans 8589934786 rc 0/0 00000100:00100000:1.0:1772305843.807220:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 76 00010000:00010000:3.0:1772305843.912754:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772305844.680768:0:2994:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1772305844.680790:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003fc0ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216591168:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1772305844.680846:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305844.680960:0:55611:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216591232 00000100:00100000:1.0:1772305844.681186:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003fc0ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216591168:0@lo:13:osp-pre-0-0.0 00000020:00000080:3.0:1772305844.683478:0:64586:0:(class_obd.c:302:class_handle_ioctl()) cmd = c008667f 00000020:00000080:3.0:1772305844.683484:0:64586:0:(class_obd.c:126:class_resolve_dev_name()) device name lustre-MDT0000 00000020:00000080:3.0:1772305844.683488:0:64586:0:(class_obd.c:133:class_resolve_dev_name()) device name lustre-MDT0000, dev 5 00000020:00000080:3.0:1772305844.683509:0:64586:0:(class_obd.c:302:class_handle_ioctl()) cmd = 424066b1 00000004:00000080:3.0:1772305844.683513:0:64586:0:(mdt_handler.c:7411:mdt_iocontrol()) handling ioctl cmd 0x424066b1 00000040:00080000:3.0:1772305844.683780:0:64586:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x11:0x0].7, 80 off8752 00000004:00000080:3.0:1772305844.683796:0:64586:0:(mdd_device.c:1821:mdd_changelog_user_register()) lustre-MDD0000: registered changelog user 'cl7', mask 0x0 00000004:02000000:3.0:1772305844.683799:0:64586:0:(mdd_device.c:460:mdd_changelog_on()) lustre-MDD0000: changelog on 00000100:00100000:3.0:1772305844.712077:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305844.716503:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305844.719011:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000040:00080000:1.0:1772305845.031900:0:64635:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305845.031906:0:64635:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305845.032001:0:64635:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 27 count 22 00000040:00080000:1.0:1772305845.032007:0:64635:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:1.0:1772305845.032030:0:64635:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305845.032032:0:64635:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305845.032095:0:64635:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 27 count 22 00000040:00080000:1.0:1772305845.032098:0:64635:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:1.0:1772305845.192846:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007cf7287e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:2993:1858396216591552:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305845.192893:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e0d19a66 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216591616:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305845.192961:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305845.193007:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216591488 00000100:00100000:3.0:1772305845.193029:0:54689:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216591424 00000100:00100000:1.0:1772305845.193102:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216591744 00000100:00100000:3.0:1772305845.193107:0:54689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1772305845.193118:0:54689:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003e7a15e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70aae467-c860-409f-ba1b-742f4d042da6+18:2991:x1858396216591424:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1772305845.193143:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1772305845.193158:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c8b2fa89 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:2992:x1858396216591488:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305845.193189:0:54689:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003e7a15e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70aae467-c860-409f-ba1b-742f4d042da6+18:2991:x1858396216591424:12345-0@lo:400:kworker/u8:0.0 Request processed in 71us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305845.193199:0:54689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1772305845.193242:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c8b2fa89 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:2992:x1858396216591488:12345-0@lo:400:kworker/u8:0.0 Request processed in 87us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305845.193251:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1772305845.193268:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1772305845.193269:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000fd7c6d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:2992:x1858396216591744:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1772305845.193299:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216591552 00000100:00100000:3.0:1772305845.193316:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000fd7c6d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:2992:x1858396216591744:12345-0@lo:400:kworker/u8:0.0 Request processed in 54us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305845.193327:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1772305845.193362:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1772305845.193371:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d8f6a4e6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:2993:x1858396216591552:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305845.193423:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d8f6a4e6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:2993:x1858396216591552:12345-0@lo:400:kworker/u8:0.0 Request processed in 52us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305845.193432:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1772305845.193455:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007cf7287e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:2993:1858396216591552:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305845.322814:0:54732:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fbb012e1 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:54732:1858396216591808:192.168.203.30@tcp:107:hsm_cdtr.0 00000040:00080000:3.0:1772305845.322910:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305845.322913:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305845.323000:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 27 count 19 00000040:00080000:3.0:1772305845.323009:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:3.0:1772305845.323364:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225326208 00000100:00100000:3.0:1772305845.323408:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 607 00000100:00100000:3.0:1772305845.323412:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009965df7c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+48:93013:x1858396225326208:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1772305845.323439:0:55141:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x31e:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1772305845.323516:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009965df7c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+48:93013:x1858396225326208:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 104us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305845.323525:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 607 00000100:00100000:3.0:1772305845.324650:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225326336 00000100:00100000:3.0:1772305845.324676:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 608 00000100:00100000:3.0:1772305845.324679:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a584233c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+48:93013:x1858396225326336:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1772305845.324688:0:55141:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305845.324704:0:55141:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000008a734987/0xa5e9c8c58c6e768 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ead2 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305845.324749:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e76f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305845.324771:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e76f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305845.324782:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e76f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305845.324793:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e776 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xf67f971f bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305845.324798:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e776 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xf67f971f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305845.324802:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e776 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xf67f971f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305845.324835:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6e77d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x31e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305845.324841:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6e77d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x31e:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305845.324845:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6e77d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x31e:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1772305845.324850:0:55141:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x31e:0x0]: returning size 1516 00010000:00010000:3.0:1772305845.324946:0:55141:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e76f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305845.324953:0:55141:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e76f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305845.324966:0:55141:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e76f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305845.324971:0:55141:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000051c27e8b already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305845.324973:0:55141:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e76f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305845.324977:0:55141:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e76f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305845.324986:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (00000000c78481f6) 00010000:00010000:3.0:1772305845.324988:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305845.324991:0:55141:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e76f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305845.324996:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e76f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305845.325008:0:55141:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e776 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xf67f971f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305845.325014:0:55141:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e776 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xf67f971f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305845.325020:0:55141:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e776 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xf67f971f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305845.325025:0:55141:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f0848df9 already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305845.325027:0:55141:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e776 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xf67f971f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305845.325041:0:55141:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e776 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xf67f971f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305845.325050:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xf67f971f (0000000050807621) 00010000:00010000:3.0:1772305845.325052:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305845.325055:0:55141:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e776 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xf67f971f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305845.325061:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e776 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xf67f971f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305845.325089:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000008a734987/0xa5e9c8c58c6e768 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ead2 expref: 51 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305845.325101:0:55141:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6e77d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x31e:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ead2 expref: 50 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305845.325108:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31e:0x0].0x0 (000000002ab31ac6) 00010000:00010000:3.0:1772305845.325110:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1772305845.325112:0:55141:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000403929b5, rc 0) 00000100:00100000:3.0:1772305845.325145:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a584233c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+50:93013:x1858396225326336:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 464us (529us total) trans 8589934787 rc 0/0 00000100:00100000:3.0:1772305845.325151:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 608 00000100:00100000:1.0:1772305845.326278:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225326464 00000100:00100000:1.0:1772305845.326324:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5672 00000100:00100000:1.0:1772305845.326330:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002552c440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+228:2215:x1858396225326464:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1772305845.326360:0:10520:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6e78b lrc: 3/1,0 mode: --/PR res: [0x1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305845.326383:0:10520:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000046ff413b/0xa5e9c8c58c6e71b lrc: 2/0,0 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eaa8 expref: 228 pid: 6308 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305845.326392:0:10520:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1772305845.326394:0:10520:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1772305845.326396:0:10520:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6e78b lrc: 4/1,0 mode: --/PR res: [0x1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305845.326426:0:10520:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000046ff413b/0xa5e9c8c58c6e71b lrc: 3/0,0 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eaa8 expref: 228 pid: 6308 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305845.326439:0:10520:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000046ff413b/0xa5e9c8c58c6e71b lrc: 4/0,0 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eaa8 expref: 228 pid: 6308 timeout: 1257 lvb_type: 0 00000100:00100000:1.0:1772305845.326452:0:10520:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003fc0ed40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:10520:1858396216591872:192.168.203.30@tcp:104: 00000100:00100000:1.0:1772305845.326492:0:10520:0:(client.c:2500:ptlrpc_set_wait()) set 0000000093cf2f95 going to sleep for 6 seconds 00000100:00100000:1.0:1772305845.327270:0:10520:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003fc0ed40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:10520:1858396216591872:192.168.203.30@tcp:104: 00010000:00010000:1.0:1772305845.327286:0:10520:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6e78b lrc: 3/1,0 mode: --/PR res: [0x1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305845.327551:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00010000:1.0:1772305845.329038:0:10520:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6e78b lrc: 3/1,0 mode: PR/PR res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305845.329047:0:10520:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6e78b lrc: 3/1,0 mode: PR/PR res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305845.329063:0:10520:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6e78b lrc: 3/1,0 mode: PR/PR res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305845.329071:0:10520:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6e78b lrc: 2/0,0 mode: PR/PR res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305845.329089:0:10520:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1772305845.329143:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002552c440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+229:2215:x1858396225326464:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 Request processed in 2809us (2924us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305845.329158:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5672 00000100:00100000:3.0:1772305845.329848:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225326720 00000100:00100000:3.0:1772305845.329880:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 609 00000100:00100000:3.0:1772305845.329883:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000042fe330 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+49:93013:x1858396225326720:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1772305845.329952:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000042fe330 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+49:93013:x1858396225326720:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 67us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305845.329958:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 609 00000100:00100000:3.0:1772305845.331212:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305845.331246:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225326784 00000100:00100000:1.0:1772305845.331272:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5673 00000100:00100000:1.0:1772305845.331276:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000083531784 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+229:2216:x1858396225326784:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1772305845.331282:0:10520:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305845.331292:0:10520:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000949f0123/0xa5e9c8c58c6e792 lrc: 2/0,0 mode: --/PR res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ead9 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1772305845.331304:0:10520:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x1ab:0x0] initial LVB size: 1516, mtime: 0x69a33db3, atime: 0x0, ctime: 0x69a33db3, blocks: 0x1 00010000:00010000:1.0:1772305845.331312:0:10520:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305845.331319:0:10520:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305845.331323:0:10520:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000949f0123/0xa5e9c8c58c6e792 lrc: 3/0,0 mode: PR/PR res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ead9 expref: 230 pid: 10520 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1772305845.331333:0:10520:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000949f0123/0xa5e9c8c58c6e792 lrc: 3/0,0 mode: PR/PR res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ead9 expref: 230 pid: 10520 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1772305845.331341:0:10520:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000949f0123, rc 0) 00000100:00100000:1.0:1772305845.331366:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000083531784 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2216:x1858396225326784:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 89us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305845.331371:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5673 00000100:00100000:3.0:1772305845.332345:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225326912 00000100:00100000:3.0:1772305845.332369:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 610 00000100:00100000:3.0:1772305845.332373:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000454a81c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+49:93013:x1858396225326912:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1772305845.332413:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000454a81c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+49:93013:x1858396225326912:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 39us (105us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305845.332418:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 610 00000100:00100000:3.0:1772305845.334852:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225327104 00000100:00100000:3.0:1772305845.334888:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 611 00000100:00100000:3.0:1772305845.334892:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ee429faf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+49:93013:x1858396225327104:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1772305845.334899:0:55141:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305845.334909:0:55141:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000008a734987/0xa5e9c8c58c6e799 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x31e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196eae0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305845.334942:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e7a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x31e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305845.334953:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e7a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x31e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305845.334960:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e7a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x31e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305845.335027:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000008a734987/0xa5e9c8c58c6e799 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x31e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eae0 expref: 51 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305845.335041:0:55141:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e7a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x31e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eae0 expref: 50 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305845.335046:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31e:0x0].0x0 (000000002ab31ac6) 00010000:00010000:3.0:1772305845.335048:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1772305845.335050:0:55141:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f0848df9, rc 0) 00000100:00100000:3.0:1772305845.335074:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ee429faf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+50:93013:x1858396225327104:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 181us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305845.335079:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 611 00000100:00100000:3.0:1772305845.336292:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225327168 00000100:00100000:3.0:1772305845.336315:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 612 00000100:00100000:3.0:1772305845.336318:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fcb0beee pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+50:93013:x1858396225327168:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1772305845.336331:0:55141:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x31e:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1772305845.336377:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fcb0beee pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+50:93013:x1858396225327168:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 57us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305845.336382:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 612 00000100:00100000:1.0:1772305845.337275:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225327232 00000100:00100000:1.0:1772305845.337302:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5674 00000100:00100000:1.0:1772305845.337307:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000530131fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2215:x1858396225327232:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1772305845.337330:0:10520:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006a4f0137/0xa5e9c8c58c6e7a7 lrc: 3/1,0 mode: --/PR res: [0x1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305845.337341:0:10520:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305845.337342:0:10520:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305845.337345:0:10520:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a4f0137/0xa5e9c8c58c6e7a7 lrc: 3/1,0 mode: PR/PR res: [0x1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305845.337352:0:10520:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a4f0137/0xa5e9c8c58c6e7a7 lrc: 3/1,0 mode: PR/PR res: [0x1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305845.337365:0:10520:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006a4f0137/0xa5e9c8c58c6e7a7 lrc: 3/1,0 mode: PR/PR res: [0x1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305845.337370:0:10520:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a4f0137/0xa5e9c8c58c6e7a7 lrc: 2/0,0 mode: PR/PR res: [0x1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305845.337392:0:10520:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1772305845.337427:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000530131fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2215:x1858396225327232:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 Request processed in 119us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305845.337434:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5674 00000100:00100000:3.0:1772305845.338066:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225327360 00000100:00100000:3.0:1772305845.338094:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 613 00000100:00100000:3.0:1772305845.338097:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fb724402 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+50:93013:x1858396225327360:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000040:00080000:3.0:1772305845.338266:0:55141:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x13:0x0].25, 168 off12264 00000040:00080000:3.0:1772305845.338333:0:55141:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x13:0x0].26, 168 off12432 00000001:00080000:3.0:1772305845.338336:0:55141:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934788 00000040:00080000:3.0:1772305845.338375:0:55141:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305845.338378:0:55141:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305845.338413:0:55141:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 27 count 19 00000040:00080000:3.0:1772305845.338424:0:55141:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:3.0:1772305845.338467:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fb724402 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+51:93013:x1858396225327360:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 368us (438us total) trans 8589934788 rc 0/0 00000100:00100000:3.0:1772305845.338474:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 613 00010000:00010000:3.0:1772305845.960838:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772305846.330506:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305846.333295:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225327680 00000100:00100000:1.0:1772305846.333337:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 614 00000100:00100000:1.0:1772305846.333345:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b74b7ed1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+43:93021:x1858396225327680:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1772305846.333357:0:55141:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305846.333373:0:55141:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6e7b5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x31e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196eaee expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305846.333469:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6e7bc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x31e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305846.333485:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6e7bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x31e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305846.333496:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6e7bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x31e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1772305846.333506:0:55141:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x31e:0x0]: returning size 1516 00010000:00010000:1.0:1772305846.333603:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6e7b5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x31e:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eaee expref: 46 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305846.333614:0:55141:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6e7bc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x31e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eaee expref: 45 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305846.333677:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31e:0x0].0x0 (000000002ab31ac6) 00010000:00010000:1.0:1772305846.333679:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1772305846.333682:0:55141:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001cde7dd0, rc 0) 00000100:00100000:1.0:1772305846.333712:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b74b7ed1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+45:93021:x1858396225327680:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 368us (476us total) trans 8589934790 rc 0/0 00000100:00100000:1.0:1772305846.333718:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 614 00000100:00100000:1.0:1772305846.334652:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305846.335919:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305846.336104:0:6323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225327872 00010000:00010000:1.0:1772305846.336122:0:6323:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000949f0123/0xa5e9c8c58c6e792 lrc: 4/0,0 mode: PR/PR res: [0x1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ead9 expref: 230 pid: 10520 timeout: 1258 lvb_type: 1 00000100:00100000:1.0:1772305846.336161:0:6323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3045 00000100:00100000:1.0:1772305846.336168:0:6323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e05e1d9c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2215:x1858396225327872:12345-192.168.203.30@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1772305846.336175:0:6323:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1772305846.336184:0:6323:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000949f0123/0xa5e9c8c58c6e792 lrc: 4/0,0 mode: PR/PR res: [0x1ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ead9 expref: 230 pid: 10520 timeout: 1258 lvb_type: 1 00010000:00010000:1.0:1772305846.336196:0:6323:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000949f0123/0xa5e9c8c58c6e792 lrc: 3/0,0 mode: PR/PR res: [0x1ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ead9 expref: 230 pid: 10520 timeout: 1258 lvb_type: 1 00010000:00010000:1.0:1772305846.336212:0:6323:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000949f0123/0xa5e9c8c58c6e792 lrc: 0/0,0 mode: --/PR res: [0x1ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ead9 expref: 230 pid: 10520 timeout: 1258 lvb_type: 1 00010000:00010000:1.0:1772305846.336222:0:6323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305846.336230:0:6323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305846.336233:0:6323:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007745523f/0xa5e9c8c58c6e7ca lrc: 3/0,1 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305846.336238:0:6323:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007745523f/0xa5e9c8c58c6e7ca lrc: 4/0,1 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305846.336258:0:6323:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1772305846.336291:0:6323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e05e1d9c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+229:2215:x1858396225327872:12345-192.168.203.30@tcp:103:ldlm_bl_01.0 Request processed in 118us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305846.336302:0:6323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3045 00010000:00010000:3.0:1772305846.336352:0:5496:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1772305846.336359:0:5496:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007745523f/0xa5e9c8c58c6e7ca lrc: 2/0,0 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305846.336379:0:5496:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000007745523f already unused, calling callback (00000000b5e4f3c0) 00010000:00010000:3.0:1772305846.336385:0:5496:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007745523f/0xa5e9c8c58c6e7ca lrc: 2/0,0 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305846.336396:0:5496:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007745523f/0xa5e9c8c58c6e7ca lrc: 3/0,0 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305846.336414:0:5496:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007745523f/0xa5e9c8c58c6e7ca lrc: 1/0,0 mode: --/PW res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305846.336421:0:5496:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007745523f/0xa5e9c8c58c6e7ca lrc: 0/0,0 mode: --/PW res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305846.336508:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1772305846.336510:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1772305846.336511:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1772305846.337029:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305846.339034:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305846.339073:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305846.339127:0:5493:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225328128 00010000:00010000:3.0:1772305846.339144:0:5493:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d4c26f30/0xa5e9c8c58c6e737 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x31e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eaaf expref: 47 pid: 54698 timeout: 1258 lvb_type: 0 00000100:00100000:1.0:1772305846.339161:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305846.339206:0:5494:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225328192 00010000:00010000:1.0:1772305846.339225:0:5494:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 000000006493e1f8/0xa5e9c8c58c6e6f8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x31e:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ea93 expref: 52 pid: 54698 timeout: 1258 lvb_type: 0 00000100:00100000:3.0:1772305846.339237:0:5493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3047 00000100:00100000:3.0:1772305846.339247:0:5493:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000957f52ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+47:2215:x1858396225328128:12345-192.168.203.30@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1772305846.339261:0:5493:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1772305846.339268:0:5494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3048 00010000:00010000:3.0:1772305846.339269:0:5493:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000d4c26f30/0xa5e9c8c58c6e737 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x31e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eaaf expref: 47 pid: 54698 timeout: 1258 lvb_type: 0 00010000:00010000:3.0:1772305846.339281:0:5493:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000d4c26f30/0xa5e9c8c58c6e737 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x31e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eaaf expref: 47 pid: 54698 timeout: 1258 lvb_type: 0 00010000:00010000:3.0:1772305846.339293:0:5493:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d4c26f30/0xa5e9c8c58c6e737 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x31e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eaaf expref: 47 pid: 54698 timeout: 1258 lvb_type: 0 00000100:00100000:1.0:1772305846.339300:0:5494:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000063d874e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+52:2218:x1858396225328192:12345-192.168.203.30@tcp:103:ldlm_bl_07.0 00010000:00010000:3.0:1772305846.339306:0:5493:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31e:0x0].0x0 (000000002ab31ac6) 00010000:00010000:3.0:1772305846.339313:0:5493:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: 00000000e7775746/0xa5e9c8c58c6e7d1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x31e:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305846.339313:0:5494:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1772305846.339321:0:5494:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 000000006493e1f8/0xa5e9c8c58c6e6f8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x31e:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ea93 expref: 52 pid: 54698 timeout: 1258 lvb_type: 0 00010000:00010000:3.0:1772305846.339331:0:5493:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: 00000000e7775746/0xa5e9c8c58c6e7d1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x31e:0x0].0x0 bits 0x28/0x0 rrc: 8 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305846.339345:0:5493:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1772305846.339350:0:5494:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 000000006493e1f8/0xa5e9c8c58c6e6f8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x31e:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ea93 expref: 52 pid: 54698 timeout: 1258 lvb_type: 0 00000100:00100000:3.0:1772305846.339370:0:5493:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000957f52ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+46:2215:x1858396225328128:12345-192.168.203.30@tcp:103:ldlm_bl_02.0 Request processed in 124us (296us total) trans 0 rc 0/0 00010000:00010000:1.0:1772305846.339370:0:5494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006493e1f8/0xa5e9c8c58c6e6f8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x31e:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ea93 expref: 51 pid: 54698 timeout: 1258 lvb_type: 0 00000100:00100000:3.0:1772305846.339383:0:5493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3047 00010000:00010000:1.0:1772305846.339407:0:5494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31e:0x0].0x0 (000000002ab31ac6) 00010000:00010000:1.0:1772305846.339411:0:5494:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: 00000000e7775746/0xa5e9c8c58c6e7d1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x31e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305846.339432:0:5494:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: 00000000e7775746/0xa5e9c8c58c6e7d1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x31e:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305846.339440:0:5494:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1772305846.339472:0:5494:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000063d874e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+50:2218:x1858396225328192:12345-192.168.203.30@tcp:103:ldlm_bl_07.0 Request processed in 194us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305846.339482:0:5494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3048 00000100:00100000:1.0:1772305846.339534:0:5494:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225328256 00010000:00010000:1.0:1772305846.339549:0:5494:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6e70d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x31e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ea9a expref: 50 pid: 54698 timeout: 1258 lvb_type: 0 00000100:00100000:1.0:1772305846.339579:0:5494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3049 00000100:00100000:1.0:1772305846.339585:0:5494:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009ce141ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+50:2218:x1858396225328256:12345-192.168.203.30@tcp:103:ldlm_bl_06.0 00010000:00010000:1.0:1772305846.339594:0:5494:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1772305846.339599:0:5494:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6e70d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x31e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ea9a expref: 50 pid: 54698 timeout: 1258 lvb_type: 0 00010000:00010000:1.0:1772305846.339609:0:5494:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6e70d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x31e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ea9a expref: 50 pid: 54698 timeout: 1258 lvb_type: 0 00010000:00010000:1.0:1772305846.339623:0:5494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6e70d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x31e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ea9a expref: 50 pid: 54698 timeout: 1258 lvb_type: 0 00010000:00010000:1.0:1772305846.339680:0:5494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31e:0x0].0x0 (000000002ab31ac6) 00010000:00010000:1.0:1772305846.339684:0:5494:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: 00000000e7775746/0xa5e9c8c58c6e7d1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x31e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305846.339692:0:5494:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000e7775746/0xa5e9c8c58c6e7d1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x31e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305846.339699:0:5494:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e7775746/0xa5e9c8c58c6e7d1 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x31e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305846.339724:0:5494:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1772305846.339760:0:5494:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009ce141ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+49:2218:x1858396225328256:12345-192.168.203.30@tcp:103:ldlm_bl_06.0 Request processed in 171us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305846.339776:0:5494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3049 00000100:00100000:3.0:1772305846.415819:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305846.415896:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225328384 00000100:00100000:1.0:1772305846.415969:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 615 00000100:00100000:1.0:1772305846.415977:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006ceb8211 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+44:93041:x1858396225328384:12345-192.168.203.30@tcp:101:md5sum.0 00010000:00010000:1.0:1772305846.416012:0:55141:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305846.416033:0:55141:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000949f0123/0xa5e9c8c58c6e7d8 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x83:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196eaf5 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305846.416110:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6e7df lrc: 3/1,0 mode: --/CR res: [0x200000408:0x83:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305846.416124:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6e7df lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x83:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305846.416133:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6e7df lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x83:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305846.416157:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6e7e6 lrc: 3/1,0 mode: --/PR res: [0x200000408:0x83:0x0].0xab9f0aba bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305846.416162:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6e7e6 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x83:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305846.416166:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6e7e6 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x83:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305846.416273:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6e7ed lrc: 3/1,0 mode: --/CR res: [0x200000402:0x31e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305846.416279:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6e7ed lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x31e:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305846.416283:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6e7ed lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x31e:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1772305846.416289:0:55141:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x31e:0x0]: returning size 1516 00010000:00010000:1.0:1772305846.416365:0:55141:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6e7df lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x83:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305846.416370:0:55141:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6e7df lrc: 2/0,0 mode: CR/CR res: [0x200000408:0x83:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305846.416375:0:55141:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6e7df lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x83:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305846.416378:0:55141:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000748ac5ea already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305846.416386:0:55141:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6e7df lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x83:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305846.416392:0:55141:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6e7df lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x83:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305846.416400:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x83:0x0].0x0 (000000008bba0213) 00010000:00010000:1.0:1772305846.416402:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305846.416406:0:55141:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6e7df lrc: 2/0,0 mode: --/CR res: [0x200000408:0x83:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305846.416410:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6e7df lrc: 0/0,0 mode: --/CR res: [0x200000408:0x83:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305846.416419:0:55141:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6e7e6 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x83:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305846.416423:0:55141:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6e7e6 lrc: 2/0,0 mode: PR/PR res: [0x200000408:0x83:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305846.416426:0:55141:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6e7e6 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x83:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305846.416430:0:55141:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000048d87789 already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305846.416431:0:55141:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6e7e6 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x83:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305846.416434:0:55141:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6e7e6 lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x83:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305846.416438:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x83:0x0].0xab9f0aba (0000000094db6ce7) 00010000:00010000:1.0:1772305846.416442:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305846.416444:0:55141:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6e7e6 lrc: 2/0,0 mode: --/PR res: [0x200000408:0x83:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305846.416448:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6e7e6 lrc: 0/0,0 mode: --/PR res: [0x200000408:0x83:0x0].0xab9f0aba bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305846.416474:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000949f0123/0xa5e9c8c58c6e7d8 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x83:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eaf5 expref: 47 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305846.416482:0:55141:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6e7ed lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x31e:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eaf5 expref: 46 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305846.416486:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31e:0x0].0x0 (0000000088b0560f) 00010000:00010000:1.0:1772305846.416487:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1772305846.416489:0:55141:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000025cc37fd, rc 0) 00000100:00100000:1.0:1772305846.416538:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006ceb8211 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+46:93041:x1858396225328384:12345-192.168.203.30@tcp:101:md5sum.0 Request processed in 562us (726us total) trans 8589934792 rc 0/0 00000100:00100000:1.0:1772305846.416544:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 615 00000100:00100000:1.0:1772305846.418003:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225328448 00000100:00100000:1.0:1772305846.418037:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 616 00000100:00100000:1.0:1772305846.418041:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000015856d86 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+46:93041:x1858396225328448:12345-192.168.203.30@tcp:101:md5sum.0 00010000:00010000:1.0:1772305846.418051:0:55141:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305846.418061:0:55141:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000017162762/0xa5e9c8c58c6e7fb lrc: 2/0,0 mode: --/CR res: [0x200000408:0x83:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196eafc expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305846.418094:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6e802 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x31e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305846.418118:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6e802 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x31e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305846.418124:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6e802 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x31e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1772305846.418140:0:55141:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x31e:0x0]: returning size 1516 00000004:00200000:1.0:1772305846.418142:0:55141:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1772305846.418150:0:55141:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6e802 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x31e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305846.418156:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6e802 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x31e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305846.418168:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000017162762/0xa5e9c8c58c6e7fb lrc: 0/0,0 mode: --/CR res: [0x200000408:0x83:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eafc expref: 48 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305846.418177:0:55141:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6e802 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x31e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eafc expref: 47 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305846.418181:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31e:0x0].0x0 (0000000088b0560f) 00010000:00010000:1.0:1772305846.418183:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1772305846.418184:0:55141:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a178fe80, rc 0) 00000100:00100000:1.0:1772305846.418210:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000015856d86 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+47:93041:x1858396225328448:12345-192.168.203.30@tcp:101:md5sum.0 Request processed in 169us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305846.418215:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 616 00000100:00100000:3.0:1772305846.419035:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305846.419079:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225328576 00000100:00100000:1.0:1772305846.419106:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 617 00000100:00100000:1.0:1772305846.419115:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001a9ec63b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+47:93041:x1858396225328576:12345-192.168.203.30@tcp:58:md5sum.0 00010000:00010000:1.0:1772305846.419149:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6e809 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x31e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305846.419159:0:55141:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6e7ed lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x31e:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eaf5 expref: 47 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305846.419164:0:55141:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6e802 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x31e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eafc expref: 47 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305846.419169:0:55141:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6e809 lrc: 5/0,1 mode: --/EX res: [0x200000402:0x31e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305846.419192:0:55141:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6e802 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x31e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eafc expref: 47 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305846.419201:0:55141:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6e802 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x31e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eafc expref: 47 pid: 55141 timeout: 1258 lvb_type: 0 00000100:00100000:1.0:1772305846.419209:0:55141:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000020b0ad0a pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:55141:1858396216592448:192.168.203.30@tcp:104: 00010000:00010000:1.0:1772305846.419252:0:55141:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6e7ed lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x31e:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eaf5 expref: 47 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305846.419259:0:55141:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6e7ed lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x31e:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eaf5 expref: 47 pid: 55141 timeout: 1258 lvb_type: 0 00000100:00100000:1.0:1772305846.419266:0:55141:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002aca8cc4 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:55141:1858396216592512:192.168.203.30@tcp:104: 00000100:00100000:1.0:1772305846.419281:0:55141:0:(client.c:2500:ptlrpc_set_wait()) set 000000003d8e056c going to sleep for 6 seconds 00000100:00100000:1.0:1772305846.420207:0:55141:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000020b0ad0a pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:55141:1858396216592448:192.168.203.30@tcp:104: 00000100:00100000:1.0:1772305846.420214:0:55141:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002aca8cc4 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:55141:1858396216592512:192.168.203.30@tcp:104: 00010000:00010000:1.0:1772305846.420230:0:55141:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6e809 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x31e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305846.420482:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305846.420540:0:5494:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225328704 00010000:00010000:1.0:1772305846.420560:0:5494:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6e7ed lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x31e:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eaf5 expref: 48 pid: 55141 timeout: 1258 lvb_type: 0 00000100:00100000:3.0:1772305846.420577:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305846.420609:0:5494:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225328640 00010000:00010000:1.0:1772305846.420623:0:5494:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6e802 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x31e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eafc expref: 49 pid: 55141 timeout: 1258 lvb_type: 0 00000100:00100000:1.0:1772305846.420709:0:5494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3051 00000100:00100000:1.0:1772305846.420720:0:5494:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c4cd8ffb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+49:2216:x1858396225328640:12345-192.168.203.30@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1772305846.420734:0:5494:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1772305846.420742:0:5494:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6e802 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x31e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eafc expref: 49 pid: 55141 timeout: 1258 lvb_type: 0 00010000:00010000:1.0:1772305846.420782:0:5494:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6e802 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x31e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eafc expref: 48 pid: 55141 timeout: 1258 lvb_type: 0 00010000:00010000:1.0:1772305846.420808:0:5494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6e802 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x31e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eafc expref: 48 pid: 55141 timeout: 1258 lvb_type: 0 00010000:00010000:1.0:1772305846.420824:0:5494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31e:0x0].0x0 (0000000088b0560f) 00010000:00010000:1.0:1772305846.420828:0:5494:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6e809 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x31e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305846.420861:0:5494:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6e809 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x31e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305846.420868:0:5494:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6e809 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x31e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305846.420894:0:5494:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1772305846.420940:0:5494:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c4cd8ffb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+46:2216:x1858396225328640:12345-192.168.203.30@tcp:103:ldlm_bl_03.0 Request processed in 221us (362us total) trans 0 rc 0/0 00010000:00010000:3.0:1772305846.420942:0:55141:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6e809 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x31e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305846.420954:0:5494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3051 00010000:00010000:3.0:1772305846.420955:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6e809 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x31e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1772305846.421183:0:55141:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xf:0x0].27, 136 off11864 00000100:00100000:3.0:1772305846.421224:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001a9ec63b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+45:93041:x1858396225328576:12345-192.168.203.30@tcp:58:md5sum.0 Request processed in 2108us (2190us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305846.421230:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 617 00000100:00100000:3.0:1772305846.421911:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225328768 00000100:00100000:3.0:1772305846.421950:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 618 00000100:00100000:3.0:1772305846.421954:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006b94893a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+45:93041:x1858396225328768:12345-192.168.203.30@tcp:101:md5sum.0 00010000:00010000:3.0:1772305846.421961:0:55141:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305846.421970:0:55141:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000008a734987/0xa5e9c8c58c6e810 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x31e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196eb03 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305846.421990:0:55141:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6e809 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x31e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305846.421996:0:55141:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 000000008a734987/0xa5e9c8c58c6e810 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x31e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb03 expref: 46 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305846.422004:0:55141:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6e809 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x31e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305846.422011:0:55141:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000008a734987/0xa5e9c8c58c6e810 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x31e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb03 expref: 46 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305846.422028:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31e:0x0].0x0 (0000000088b0560f) 00010000:00010000:3.0:1772305846.422030:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1772305846.422032:0:55141:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: 000000008a734987/0xa5e9c8c58c6e810 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x31e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb03 expref: 46 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305846.422037:0:55141:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008a734987, rc 0) 00000100:00100000:3.0:1772305846.422061:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006b94893a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+46:93041:x1858396225328768:12345-192.168.203.30@tcp:101:md5sum.0 Request processed in 106us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305846.422068:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 618 00000100:00100000:1.0:1772305847.363883:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305847.363931:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305847.363957:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305847.363976:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225328896 00000100:00100000:1.0:1772305847.363976:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305847.364008:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305847.364035:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305847.364054:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225329088 00000100:00100000:1.0:1772305847.364075:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305847.364102:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 88 00000100:00100000:1.0:1772305847.364107:0:18149:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225329152 00000100:00100000:3.0:1772305847.364111:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002aca8cc4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+49:2217:x1858396225328896:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:1.0:1772305847.364140:0:18149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1116 00000100:00100000:1.0:1772305847.364162:0:18149:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000020b0ad0a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+229:2217:x1858396225329024:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1772305847.364178:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002aca8cc4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+49:2217:x1858396225328896:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 65us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305847.364195:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 88 00000100:00100000:1.0:1772305847.364196:0:18149:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000020b0ad0a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+229:2217:x1858396225329024:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 39us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305847.364203:0:18149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1116 00000100:00100000:3.0:1772305847.364220:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 89 00000100:00100000:3.0:1772305847.364228:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e53cfa76 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+46:2218:x1858396225329088:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:1.0:1772305847.364230:0:18149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1118 00000100:00100000:1.0:1772305847.364246:0:18149:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000049a6801b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f935b4d0-e17f-49c8-8011-4be99ba75430+160:2217:x1858396225329152:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1772305847.364260:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e53cfa76 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+46:2218:x1858396225329088:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 30us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305847.364277:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 89 00000100:00100000:1.0:1772305847.364297:0:18149:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000049a6801b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f935b4d0-e17f-49c8-8011-4be99ba75430+160:2217:x1858396225329152:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 58us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305847.364304:0:18149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1118 00000100:00100000:3.0:1772305847.370457:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305847.371691:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305847.374148:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305847.375962:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305847.377218:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305847.378324:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00010000:2.0:1772305847.378480:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d4c26f30/0xa5e9c8c58c6e84f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x31f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb11 expref: 52 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305847.378505:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000006493e1f8/0xa5e9c8c58c6e856 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x31f:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb11 expref: 51 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305847.378512:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31f:0x0].0x0 (00000000097a611d) 00010000:00010000:2.0:1772305847.378514:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1772305847.378516:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006493e1f8, rc 0) 00000100:00100000:2.0:1772305847.378547:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000054388a3a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+51:93042:x1858396225329792:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 155us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305847.378555:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 624 00000100:00100000:2.0:1772305847.379420:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225329920 00000100:00100000:2.0:1772305847.379453:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 625 00000100:00100000:2.0:1772305847.379458:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000862e2d15 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+51:93042:x1858396225329920:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1772305847.379495:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000046ff413b/0xa5e9c8c58c6e85d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x31f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305847.379506:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000046ff413b/0xa5e9c8c58c6e85d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x31f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305847.379514:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000046ff413b/0xa5e9c8c58c6e85d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x31f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1772305847.379770:0:54698:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000862e2d15 reply state 00000000ab914336 transno 8589934794 ns: mdt-lustre-MDT0000_UUID lock: 0000000046ff413b/0xa5e9c8c58c6e85d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x31f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305847.379848:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000862e2d15 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+53:93042:x1858396225329920:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 389us (473us total) trans 8589934794 rc 0/0 00000100:00100000:2.0:1772305847.379866:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 625 00010000:00010000:1.0:1772305847.380371:0:2977:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000046ff413b/0xa5e9c8c58c6e85d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x31f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305847.380381:0:2977:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000046ff413b/0xa5e9c8c58c6e85d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x31f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305847.380389:0:2977:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000046ff413b/0xa5e9c8c58c6e85d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x31f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305847.380395:0:2977:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000046ff413b already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305847.380399:0:2977:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000046ff413b/0xa5e9c8c58c6e85d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x31f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305847.380406:0:2977:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000046ff413b/0xa5e9c8c58c6e85d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x31f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305847.380418:0:2977:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31f:0x0].0x0 (00000000097a611d) 00010000:00010000:1.0:1772305847.380422:0:2977:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1772305847.380424:0:2977:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000046ff413b/0xa5e9c8c58c6e85d lrc: 2/0,0 mode: --/PW res: [0x200000402:0x31f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305847.380431:0:2977:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000046ff413b/0xa5e9c8c58c6e85d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x31f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305847.380543:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225329984 00000100:00100000:2.0:1772305847.380572:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 626 00000100:00100000:2.0:1772305847.380577:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004b75309d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+52:93042:x1858396225329984:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1772305847.380589:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305847.380599:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000dd98d4fa/0xa5e9c8c58c6e864 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x31f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196eb18 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305847.380651:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000dd98d4fa/0xa5e9c8c58c6e864 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x31f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb18 expref: 53 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305847.380663:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000dd98d4fa/0xa5e9c8c58c6e864 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x31f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb18 expref: 53 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305847.380672:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31f:0x0].0x0 (00000000097a611d) 00010000:00010000:2.0:1772305847.380675:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1772305847.380677:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000dd98d4fa, rc 0) 00000100:00100000:2.0:1772305847.380705:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004b75309d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+53:93042:x1858396225329984:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 128us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305847.380720:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 626 00000100:00100000:3.0:1772305847.381366:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305847.381409:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225330048 00000100:00100000:2.0:1772305847.381437:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 79 00000100:00100000:2.0:1772305847.381442:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bb867392 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+53:93042:x1858396225330048:12345-192.168.203.30@tcp:49:lhsmtool_posix.0 00000100:00100000:2.0:1772305847.381498:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bb867392 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+53:93042:x1858396225330048:12345-192.168.203.30@tcp:49:lhsmtool_posix.0 Request processed in 55us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305847.381516:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 79 00000100:00100000:1.0:1772305847.382289:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305847.382328:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225330176 00000100:00100000:2.0:1772305847.382355:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 627 00000100:00100000:2.0:1772305847.382360:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006049a92e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+53:93042:x1858396225330176:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1772305847.382413:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006049a92e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+53:93042:x1858396225330176:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 52us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305847.382421:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 627 00000100:00100000:2.0:1772305847.383343:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225330304 00000100:00100000:2.0:1772305847.383366:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 628 00000100:00100000:2.0:1772305847.383369:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000044e87dbc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+53:93042:x1858396225330304:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000040:00080000:2.0:1772305847.383472:0:54698:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x13:0x0].31, 168 off13272 00010000:00010000:2.0:1772305847.383497:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6e809 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x31e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305847.383504:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6e809 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x31e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305847.383509:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6e809 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x31e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305847.383513:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000295bd7c already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305847.383514:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6e809 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x31e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305847.383518:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6e809 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x31e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000020 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305847.383533:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31e:0x0].0x0 (0000000088b0560f) 00010000:00010000:2.0:1772305847.383535:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1772305847.383538:0:54698:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: 000000008a734987/0xa5e9c8c58c6e810 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x31e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb03 expref: 44 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305847.383544:0:54698:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 000000008a734987/0xa5e9c8c58c6e810 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x31e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb03 expref: 44 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305847.383548:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000008a734987/0xa5e9c8c58c6e810 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x31e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb03 expref: 44 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305847.383567:0:54698:0:(ldlm_lockd.c:1069:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: 000000008a734987/0xa5e9c8c58c6e810 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x31e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb03 expref: 44 pid: 55141 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305847.383575:0:54698:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e6635d8a pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:54698:1858396216592704:192.168.203.30@tcp:105: 00000100:00100000:2.0:1772305847.383614:0:54698:0:(client.c:2500:ptlrpc_set_wait()) set 000000007aaf16a4 going to sleep for 6 seconds 00000100:00100000:2.0:1772305847.384485:0:54698:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e6635d8a pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:54698:1858396216592704:192.168.203.30@tcp:105: 00010000:00010000:2.0:1772305847.384499:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6e809 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x31e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305847.384504:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6e809 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x31e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305847.384519:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000bc6e3b0a/0xa5e9c8c58c6e86b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x31e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305847.384526:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000bc6e3b0a/0xa5e9c8c58c6e86b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x31e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305847.384537:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000bc6e3b0a/0xa5e9c8c58c6e86b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x31e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305847.384542:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000bc6e3b0a/0xa5e9c8c58c6e86b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x31e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305847.384545:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000bc6e3b0a/0xa5e9c8c58c6e86b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x31e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305847.384549:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000bc6e3b0a/0xa5e9c8c58c6e86b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x31e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305847.384552:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000bc6e3b0a already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305847.384553:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000bc6e3b0a/0xa5e9c8c58c6e86b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x31e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305847.384557:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000bc6e3b0a/0xa5e9c8c58c6e86b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x31e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305847.384561:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31e:0x0].0x0 (0000000088b0560f) 00010000:00010000:2.0:1772305847.384562:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305847.384564:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000bc6e3b0a/0xa5e9c8c58c6e86b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x31e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305847.384567:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000bc6e3b0a/0xa5e9c8c58c6e86b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x31e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1772305847.384660:0:54698:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305847.384664:0:54698:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305847.384753:0:54698:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 28 count 20 00000040:00080000:2.0:1772305847.384761:0:54698:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:1.0:1772305847.384772:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225330368 00000100:00100000:1.0:1772305847.384802:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 80 00000100:00100000:1.0:1772305847.384807:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dad20ed7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+45:93041:x1858396225330368:12345-192.168.203.30@tcp:49:md5sum.0 00000100:00100000:2.0:1772305847.384819:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000044e87dbc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+54:93042:x1858396225330304:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 1446us (1509us total) trans 8589934795 rc 0/0 00000100:00100000:2.0:1772305847.384829:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 628 00000100:00100000:1.0:1772305847.384864:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dad20ed7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+45:93041:x1858396225330368:12345-192.168.203.30@tcp:49:md5sum.0 Request processed in 56us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305847.384874:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 80 00000100:00100000:3.0:1772305847.385736:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305847.385781:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225330496 00000100:00100000:1.0:1772305847.385816:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 81 00000100:00100000:1.0:1772305847.385822:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a7458d21 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+54:93042:x1858396225330496:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1772305847.386054:0:54699:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225330624 00000004:00080000:1.0:1772305847.386066:0:57054:0:(mdd_object.c:3529:mdd_close()) Object [0x200000402:0x31f:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00100000:3.0:1772305847.386082:0:54699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 82 00000100:00100000:3.0:1772305847.386087:0:54699:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e05e1d9c pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+45:93041:x1858396225330624:12345-192.168.203.30@tcp:35:md5sum.0 00010000:00010000:1.0:1772305847.386202:0:57054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6e872 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x31f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305847.386215:0:57054:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6e872 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x31f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 18446631280743258432 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305847.386218:0:54699:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e05e1d9c pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+46:93041:x1858396225330624:12345-192.168.203.30@tcp:35:md5sum.0 Request processed in 129us (191us total) trans 8589934796 rc 0/0 00000100:00100000:3.0:1772305847.386232:0:54699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 82 00010000:00010000:1.0:1772305847.386235:0:57054:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6e872 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x31f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 18446631280743258432 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305847.386245:0:57054:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6e872 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x31f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 18446631280743258432 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305847.386252:0:57054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6e872 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x31f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 18446631280743258432 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305847.386273:0:57054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6e872 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x31f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 18446631280743258432 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305847.386302:0:57054:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1772305847.386341:0:5497:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1772305847.386346:0:5497:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6e872 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x31f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 18446631280743258432 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305847.386355:0:5497:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a178fe80 already unused, calling callback (00000000b5e4f3c0) 00010000:00010000:2.0:1772305847.386358:0:5497:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6e872 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x31f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 18446631280743258432 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305847.386366:0:5497:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6e872 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x31f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 18446631280743258432 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305847.386378:0:5497:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31f:0x0].0x0 (00000000097a611d) 00010000:00010000:2.0:1772305847.386380:0:5497:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1772305847.386383:0:5497:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6e872 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x31f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 18446631280743258432 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305847.386390:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a7458d21 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+55:93042:x1858396225330496:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 564us (653us total) trans 8589934797 rc 0/0 00010000:00010000:2.0:1772305847.386396:0:5497:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6e872 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x31f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 18446631280743258432 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305847.386411:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 81 00010000:00010000:2.0:1772305847.386415:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1772305847.386419:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1772305847.386421:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1772305847.683926:0:64738:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305847.683931:0:64738:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305847.684005:0:64738:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 28 count 20 00000040:00080000:1.0:1772305847.684009:0:64738:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:1.0:1772305847.684032:0:64738:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305847.684034:0:64738:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305847.684092:0:64738:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 28 count 20 00000040:00080000:1.0:1772305847.684095:0:64738:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:2.0:1772305847.711312:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225330688 00000100:00100000:2.0:1772305847.711373:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 629 00000100:00100000:2.0:1772305847.711380:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a28db514 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+55:93057:x1858396225330688:12345-192.168.203.30@tcp:501:chlg_load_threa.0 00000100:00100000:2.0:1772305847.711571:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a28db514 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+55:93057:x1858396225330688:12345-192.168.203.30@tcp:501:chlg_load_threa.0 Request processed in 190us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305847.711581:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 629 00000100:00100000:2.0:1772305847.712451:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225330752 00000100:00100000:2.0:1772305847.712487:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 630 00000100:00100000:2.0:1772305847.712494:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c230ed64 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+55:93057:x1858396225330752:12345-192.168.203.30@tcp:503:chlg_load_threa.0 00000100:00100000:2.0:1772305847.712729:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c230ed64 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+55:93057:x1858396225330752:12345-192.168.203.30@tcp:503:chlg_load_threa.0 Request processed in 235us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305847.712740:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 630 00000100:00100000:2.0:1772305847.713579:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225330816 00000100:00100000:2.0:1772305847.713614:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 631 00000100:00100000:2.0:1772305847.713621:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000367e8d8d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+55:93057:x1858396225330816:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1772305847.713835:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000367e8d8d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+55:93057:x1858396225330816:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 214us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305847.713842:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 631 00000100:00100000:3.0:1772305847.714615:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305847.714685:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225330880 00000100:00100000:2.0:1772305847.714715:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 632 00000100:00100000:2.0:1772305847.714722:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000032e68268 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+55:93057:x1858396225330880:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1772305847.714876:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000032e68268 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+55:93057:x1858396225330880:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 155us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305847.714882:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 632 00000100:00100000:2.0:1772305847.715777:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225330944 00000100:00100000:2.0:1772305847.715821:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 633 00000100:00100000:2.0:1772305847.715828:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e782a30d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+55:93057:x1858396225330944:12345-192.168.203.30@tcp:501:chlg_load_threa.0 00000100:00100000:2.0:1772305847.715903:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e782a30d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+55:93057:x1858396225330944:12345-192.168.203.30@tcp:501:chlg_load_threa.0 Request processed in 70us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305847.715922:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 633 00000100:00100000:2.0:1772305847.716612:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225331008 00000100:00100000:2.0:1772305847.716661:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 634 00000100:00100000:2.0:1772305847.716667:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bb059566 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+55:93057:x1858396225331008:12345-192.168.203.30@tcp:503:chlg_load_threa.0 00000100:00100000:2.0:1772305847.716759:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bb059566 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+55:93057:x1858396225331008:12345-192.168.203.30@tcp:503:chlg_load_threa.0 Request processed in 91us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305847.716769:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 634 00000100:00100000:3.0:1772305847.717465:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305847.717507:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225331072 00000100:00100000:2.0:1772305847.717539:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 635 00000100:00100000:2.0:1772305847.717545:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e43a966f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+55:93057:x1858396225331072:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1772305847.717691:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e43a966f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+55:93057:x1858396225331072:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 144us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305847.717702:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 635 00000100:00100000:2.0:1772305847.718657:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225331136 00000100:00100000:2.0:1772305847.718696:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 636 00000100:00100000:2.0:1772305847.718702:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000495c9266 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+55:93057:x1858396225331136:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1772305847.718810:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000495c9266 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+55:93057:x1858396225331136:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 106us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305847.718821:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 636 00010000:00010000:3.0:1772305848.008705:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1772305849.032777:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1772305849.304550:0:7114:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-OST0001: transno 4294968340 is committed 00000001:00080000:1.0:1772305849.304575:0:7114:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-OST0001: transno 4294968339 is committed 00000001:00080000:2.0:1772305849.306732:0:54724:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934797 is committed 00000001:00080000:2.0:1772305849.306743:0:54724:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934792 is committed 00000004:00080000:2.0:1772305849.306771:0:54724:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:2.0:1772305849.306804:0:54724:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt 00000000ca1f40f0 refcount 2 committed 0 result 0 batchid 4295052953 00000020:00080000:2.0:1772305849.306812:0:54724:0:(update_trans.c:89:top_multiple_thandle_dump()) st 00000000d77ca7a0 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th 00000000e7485037 00000020:00080000:2.0:1772305849.306816:0:54724:0:(update_trans.c:89:top_multiple_thandle_dump()) st 0000000077d23ccd obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th 00000000d25a5d76 00000001:00080000:2.0:1772305849.306861:0:54724:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934796 is committed 00000100:00100000:2.0:1772305849.306966:0:2994:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1772305849.306993:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009b3b63a3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216592768:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1772305849.307087:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305849.307136:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216592768 00000100:00100000:3.0:1772305849.307199:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5677 00000100:00100000:3.0:1772305849.307208:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e6635d8a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216592768:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1772305849.307240:0:6306:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:427 count 1 00002000:00010000:3.0:1772305849.307283:0:6306:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x1ab:0x0] initial LVB size: 1516, mtime: 0x69a33db3, atime: 0x0, ctime: 0x69a33db3, blocks: 0xb 00010000:00010000:3.0:1772305849.307293:0:6306:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e879 lrc: 3/0,1 mode: --/PW res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305849.307312:0:6306:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1772305849.307315:0:6306:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1772305849.307321:0:6306:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e879 lrc: 3/0,1 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305849.307341:0:6306:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e879 lrc: 3/0,1 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305849.307353:0:6306:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e879 lrc: 3/0,1 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305849.307368:0:6306:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e879 lrc: 2/0,0 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305849.307394:0:6306:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1772305849.307413:0:38581:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1772305849.307420:0:38581:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e879 lrc: 2/0,0 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305849.307429:0:38581:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000051c27e8b already unused, calling callback (00000000b5e4f3c0) 00010000:00010000:1.0:1772305849.307432:0:38581:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e879 lrc: 2/0,0 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305849.307442:0:38581:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e879 lrc: 3/0,0 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305849.307471:0:38581:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e879 lrc: 1/0,0 mode: --/PW res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305849.307475:0:38581:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e879 lrc: 0/0,0 mode: --/PW res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305849.307488:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1772305849.307489:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1772305849.307490:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1772305849.307829:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e6635d8a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:2994:x1858396216592768:12345-0@lo:6:osp-syn-1-0.0 Request processed in 620us (745us total) trans 4294968341 rc 0/0 00000100:00100000:3.0:1772305849.307839:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5677 00000100:00100000:2.0:1772305849.307854:0:2994:0:(client.c:2868:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968340 gen 2 00000004:00080000:2.0:1772305849.307863:0:2994:0:(osp_trans.c:1044:osp_request_commit_cb()) trans no 4294968340 committed transno 4294968340 00000100:00100000:2.0:1772305849.307894:0:2994:0:(client.c:2894:ptlrpc_free_committed()) @@@ stopping search req@000000009b3b63a3 x1858396216592768/t4294968341(4294968341) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1772305856 ref 2 fl Rpc:RQU/4/0 rc 0/0 job:'osp-syn-1-0.0' 00000004:00080000:2.0:1772305849.307920:0:2994:0:(osp_sync.c:563:osp_sync_interpret()) reply req 000000009b3b63a3/2, rc 0, transno 1045 00000100:00100000:2.0:1772305849.307926:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009b3b63a3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216592768:0@lo:6:osp-syn-1-0.0 00000040:00080000:2.0:1772305849.608164:0:64939:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1772305849.608169:0:64939:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x11:0x1:0x0]:0 at index 1 of catalog [0x6:0xa:0x0] 00000040:00080000:2.0:1772305849.608197:0:64939:0:(llog.c:789:llog_process_thread()) stop processing plain 0x11:1:0 index 8 count 2 00000040:00080000:2.0:1772305849.608202:0:64939:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x6:10:0 index 2 count 2 00000100:00100000:3.0:1772305849.625755:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305849.625824:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225331200 00000100:00100000:1.0:1772305849.625917:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 637 00000100:00100000:1.0:1772305849.625925:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003bb53c21 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+48:93494:x1858396225331200:12345-192.168.203.30@tcp:46:lfs.0 00000004:00000080:1.0:1772305849.625973:0:54698:0:(mdt_handler.c:7411:mdt_iocontrol()) handling ioctl cmd 0x424066b3 00000004:00000080:1.0:1772305849.626016:0:54698:0:(mdd_device.c:2125:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=7, endrec=0 00000040:00080000:1.0:1772305849.626104:0:54698:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1772305849.626108:0:54698:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x11:0x1:0x0]:0 at index 1 of catalog [0x6:0xa:0x0] 00000004:00000080:1.0:1772305849.626138:0:54698:0:(mdd_device.c:2095:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl7 endrec = 31 00000040:00080000:1.0:1772305849.626227:0:54698:0:(llog.c:789:llog_process_thread()) stop processing plain 0x11:1:0 index 8 count 2 00000040:00080000:1.0:1772305849.626232:0:54698:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x6:10:0 index 2 count 2 00000004:00000080:1.0:1772305849.626236:0:54698:0:(mdd_device.c:2173:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl7 entries up to 18446744073709551615 00000040:00080000:1.0:1772305849.626262:0:54698:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1772305849.626263:0:54698:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x13:0x1:0x0]:0 at index 1 of catalog [0x5:0xa:0x0] 00000040:00100000:1.0:1772305849.626286:0:54698:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 24 in log [0x13:0x1:0x0] 00000040:00100000:1.0:1772305849.626358:0:54698:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 25 in log [0x13:0x1:0x0] 00000040:00100000:1.0:1772305849.626386:0:54698:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 26 in log [0x13:0x1:0x0] 00000040:00100000:1.0:1772305849.626410:0:54698:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 27 in log [0x13:0x1:0x0] 00000040:00100000:1.0:1772305849.626434:0:54698:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 28 in log [0x13:0x1:0x0] 00000040:00100000:1.0:1772305849.626473:0:54698:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 29 in log [0x13:0x1:0x0] 00000040:00100000:1.0:1772305849.626494:0:54698:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 30 in log [0x13:0x1:0x0] 00000040:00100000:1.0:1772305849.626522:0:54698:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 31 in log [0x13:0x1:0x0] 00000040:00080000:1.0:1772305849.626541:0:54698:0:(llog.c:789:llog_process_thread()) stop processing plain 0x13:1:0 index 31 count 1 00000040:00080000:1.0:1772305849.626544:0:54698:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x5:10:0 index 2 count 2 00000100:00100000:1.0:1772305849.626681:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003bb53c21 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+48:93494:x1858396225331200:12345-192.168.203.30@tcp:46:lfs.0 Request processed in 755us (934us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305849.626693:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 637 00000100:00100000:2.0:1772305849.800769:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d0e10cf7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216592832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1772305849.800849:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772305849.801149:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d0e10cf7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216592832:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1772305849.801884:0:2992:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1772305849.801911:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000025278777 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216592896:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1772305849.801958:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1772305849.922778:0:64987:0:(class_obd.c:302:class_handle_ioctl()) cmd = c008667f 00000020:00000080:1.0:1772305849.922787:0:64987:0:(class_obd.c:126:class_resolve_dev_name()) device name lustre-MDT0000 00000020:00000080:1.0:1772305849.922793:0:64987:0:(class_obd.c:133:class_resolve_dev_name()) device name lustre-MDT0000, dev 5 00000020:00000080:1.0:1772305849.922825:0:64987:0:(class_obd.c:302:class_handle_ioctl()) cmd = 424066b2 00000004:00000080:1.0:1772305849.922831:0:64987:0:(mdt_handler.c:7411:mdt_iocontrol()) handling ioctl cmd 0x424066b2 00000004:00000080:1.0:1772305849.922880:0:64987:0:(mdd_device.c:2125:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=7, endrec=0 00000040:00080000:1.0:1772305849.922980:0:64987:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1772305849.922984:0:64987:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x11:0x1:0x0]:0 at index 1 of catalog [0x6:0xa:0x0] 00000004:00000080:1.0:1772305849.923012:0:64987:0:(mdd_device.c:2095:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl7 endrec = 31 00000040:00080000:1.0:1772305849.923085:0:64987:0:(llog.c:789:llog_process_thread()) stop processing plain 0x11:1:0 index 8 count 2 00000040:00080000:1.0:1772305849.923090:0:64987:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x6:10:0 index 2 count 2 00000004:00000080:1.0:1772305849.923094:0:64987:0:(mdd_device.c:2173:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl7 entries up to 18446744073709551615 00000040:00080000:1.0:1772305849.923122:0:64987:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1772305849.923123:0:64987:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x13:0x1:0x0]:0 at index 1 of catalog [0x5:0xa:0x0] 00000040:00080000:1.0:1772305849.923480:0:64987:0:(llog.c:789:llog_process_thread()) stop processing plain 0x13:1:0 index 64768 count 1 00000040:00080000:1.0:1772305849.923482:0:64987:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x5:10:0 index 2 count 2 00000004:00000080:1.0:1772305849.923487:0:64987:0:(mdd_device.c:1983:mdd_changelog_user_purge()) lustre-MDD0000: Purge request: id=7 00000040:00080000:1.0:1772305849.923500:0:64987:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1772305849.923501:0:64987:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x11:0x1:0x0]:0 at index 1 of catalog [0x6:0xa:0x0] 00000040:00100000:1.0:1772305849.923515:0:64987:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 7 in log [0x11:0x1:0x0] 00000040:00080000:1.0:1772305849.923596:0:64987:0:(llog.c:789:llog_process_thread()) stop processing plain 0x11:1:0 index 7 count 1 00000040:00080000:1.0:1772305849.923599:0:64987:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x6:10:0 index 2 count 2 00000004:00000080:1.0:1772305849.923602:0:64987:0:(mdd_device.c:2005:mdd_changelog_user_purge()) turning off changelogs 00000004:02000000:1.0:1772305849.923604:0:64987:0:(mdd_device.c:483:mdd_changelog_off()) lustre-MDD0000: changelog off 00000004:00000080:1.0:1772305849.926272:0:64987:0:(mdd_device.c:2015:mdd_changelog_user_purge()) lustre-MDD0000: Purge changelog entries for user cl7 record=18446744073709551615 00000040:00080000:1.0:1772305849.926370:0:64987:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1772305849.926374:0:64987:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x13:0x1:0x0]:0 at index 1 of catalog [0x5:0xa:0x0] 00000040:00080000:1.0:1772305849.926763:0:64987:0:(llog.c:789:llog_process_thread()) stop processing plain 0x13:1:0 index 64768 count 1 00000040:00080000:1.0:1772305849.926769:0:64987:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x5:10:0 index 2 count 2 00000040:00080000:1.0:1772305849.926798:0:64987:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1772305849.926799:0:64987:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x11:0x1:0x0]:0 at index 1 of catalog [0x6:0xa:0x0] 00000040:00080000:1.0:1772305849.927169:0:64987:0:(llog.c:789:llog_process_thread()) stop processing plain 0x11:1:0 index 64768 count 1 00000040:00080000:1.0:1772305849.927173:0:64987:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x6:10:0 index 2 count 2 00010000:00010000:2.0:1772305850.056769:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1772305850.238766:0:65035:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1772305850.238771:0:65035:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x11:0x1:0x0]:0 at index 1 of catalog [0x6:0xa:0x0] 00000040:00080000:2.0:1772305850.239143:0:65035:0:(llog.c:789:llog_process_thread()) stop processing plain 0x11:1:0 index 64768 count 1 00000040:00080000:2.0:1772305850.239149:0:65035:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x6:10:0 index 2 count 2 00000100:00100000:1.0:1772305850.271404:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225331264 00000100:00100000:1.0:1772305850.271468:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 638 00000100:00100000:1.0:1772305850.271477:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000051fd3951 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+48:92960:x1858396225331264:12345-192.168.203.30@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1772305850.271575:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000051fd3951 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+48:92960:x1858396225331264:12345-192.168.203.30@tcp:60:lhsmtool_posix.0 Request processed in 99us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305850.271585:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 638 00000100:00100000:2.0:1772305850.313799:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000301518ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:2993:1858396216593024:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305850.313816:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005b2347ad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216593152:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1772305850.313833:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b2b1cc4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:2994:1858396216593088:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1772305850.313866:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305850.313869:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305850.313918:0:54689:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216592960 00000100:00100000:2.0:1772305850.313927:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000016a92645 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:2993:1858396216593280:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305850.313929:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216593152 00000100:00100000:1.0:1772305850.313960:0:54689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1772305850.313961:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305850.313967:0:54689:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c236a9c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70aae467-c860-409f-ba1b-742f4d042da6+18:2992:x1858396216592960:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305850.313971:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216593216 00000100:00100000:3.0:1772305850.314002:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1120 00000100:00100000:3.0:1772305850.314006:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b29332f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216593152:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1772305850.314012:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1121 00000100:00100000:1.0:1772305850.314019:0:54689:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c236a9c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70aae467-c860-409f-ba1b-742f4d042da6+18:2992:x1858396216592960:12345-0@lo:400:kworker/u8:0.0 Request processed in 51us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305850.314022:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000045e54637 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:2992:x1858396216593216:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1772305850.314029:0:54689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1772305850.314059:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b29332f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216593152:12345-0@lo:400:kworker/u8:0.0 Request processed in 51us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305850.314068:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1120 00000100:00100000:2.0:1772305850.314079:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000045e54637 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:2992:x1858396216593216:12345-0@lo:400:kworker/u8:0.0 Request processed in 57us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305850.314088:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1121 00000100:00100000:1.0:1772305850.314096:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216593024 00000100:00100000:3.0:1772305850.314123:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216593280 00000100:00100000:1.0:1772305850.314136:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216593088 00000100:00100000:2.0:1772305850.314143:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005b2347ad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216593152:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305850.314163:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1772305850.314174:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ffad9327 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:2993:x1858396216593024:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1772305850.314182:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1772305850.314191:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000120e5172 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:2994:x1858396216593088:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1772305850.314256:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000120e5172 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:2994:x1858396216593088:12345-0@lo:400:kworker/u8:0.0 Request processed in 66us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305850.314262:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ffad9327 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:2993:x1858396216593024:12345-0@lo:400:kworker/u8:0.0 Request processed in 87us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305850.314270:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000016a92645 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:2993:1858396216593280:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1772305850.314272:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1772305850.314287:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1772305850.314288:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000301518ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:2993:1858396216593024:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1772305850.314323:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b2b1cc4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:2994:1858396216593088:0@lo:400:kworker/u8:0.0 00000400:00000080:2.0:1772305850.821272:0:65083:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:2.0:1772305850.821278:0:65083:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 223a: Changelog for restore canceled (import case) ========================================================== 14:10:50 (1772305850) 00000100:00100000:3.0:1772305850.931559:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225331328 00000100:00100000:3.0:1772305850.931617:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 639 00000100:00100000:3.0:1772305850.931682:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f1168a53 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+48:93696:x1858396225331328:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1772305850.931704:0:55141:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305850.931740:0:55141:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c6e880 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196eb1f expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.931800:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c6e887 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.931816:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c6e887 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.931830:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c6e887 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1772305850.931909:0:55141:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:3.0:1772305850.931913:0:55141:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 102 stripe count 1 MDT count 1 00000004:00010000:3.0:1772305850.931939:0:55141:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c6e887 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.931963:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c6e880 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb1f expref: 50 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.931981:0:55141:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c6e887 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb1f expref: 49 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.931989:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:3.0:1772305850.931993:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1772305850.931996:0:55141:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000617aea8a, rc 0) 00000100:00100000:3.0:1772305850.932051:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f1168a53 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+49:93696:x1858396225331328:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 372us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305850.932065:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 639 00000100:00100000:2.0:1772305850.934781:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305850.934829:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225331456 00000100:00100000:3.0:1772305850.934873:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 640 00000100:00100000:3.0:1772305850.934879:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e0d19a66 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+49:93697:x1858396225331456:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1772305850.934902:0:55141:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305850.934914:0:55141:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a5c1895c/0xa5e9c8c58c6e88e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196eb26 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.934956:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000094970864/0xa5e9c8c58c6e895 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.934966:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000094970864/0xa5e9c8c58c6e895 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.934983:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000094970864/0xa5e9c8c58c6e895 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.935000:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e89c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.935007:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e89c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.935012:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e89c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1772305850.935098:0:55141:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 10752 00010000:00010000:3.0:1772305850.935217:0:55141:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000094970864/0xa5e9c8c58c6e895 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.935229:0:55141:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000094970864/0xa5e9c8c58c6e895 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.935233:0:55141:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000094970864/0xa5e9c8c58c6e895 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.935237:0:55141:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000094970864 already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305850.935240:0:55141:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000094970864/0xa5e9c8c58c6e895 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.935244:0:55141:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000094970864/0xa5e9c8c58c6e895 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.935251:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (000000006b52a2ed) 00010000:00010000:3.0:1772305850.935253:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305850.935256:0:55141:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000094970864/0xa5e9c8c58c6e895 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.935259:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000094970864/0xa5e9c8c58c6e895 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.935266:0:55141:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e89c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.935270:0:55141:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e89c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.935274:0:55141:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e89c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.935284:0:55141:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000051c27e8b already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305850.935285:0:55141:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e89c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.935289:0:55141:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e89c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.935293:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (00000000c7517594) 00010000:00010000:3.0:1772305850.935294:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305850.935295:0:55141:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e89c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.935299:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e89c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.935317:0:55141:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000a5c1895c/0xa5e9c8c58c6e88e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb26 expref: 51 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.935322:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a5c1895c/0xa5e9c8c58c6e88e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb26 expref: 51 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.935327:0:55141:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5c1895c, rc 0) 00000100:00100000:3.0:1772305850.935358:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e0d19a66 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+50:93697:x1858396225331456:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 479us (579us total) trans 8589934798 rc 301/301 00000100:00100000:3.0:1772305850.935363:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 640 00000100:00100000:1.0:1772305850.936565:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225331584 00000100:00100000:1.0:1772305850.936602:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 83 00000100:00100000:1.0:1772305850.936608:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003c3b26a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+50:93697:x1858396225331584:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1772305850.936791:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003c3b26a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+51:93697:x1858396225331584:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 182us (285us total) trans 8589934799 rc 0/0 00000100:00100000:1.0:1772305850.936802:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 83 00000100:00100000:3.0:1772305850.937667:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225331648 00000100:00100000:3.0:1772305850.937699:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 641 00000100:00100000:3.0:1772305850.937704:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cae996b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+51:93697:x1858396225331648:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1772305850.937763:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cae996b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+51:93697:x1858396225331648:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 Request processed in 58us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305850.937773:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 641 00000100:00100000:2.0:1772305850.944842:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305850.944901:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225331712 00000100:00100000:3.0:1772305850.944947:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 642 00000100:00100000:3.0:1772305850.944954:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000301518ab pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+42:93698:x1858396225331712:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1772305850.944973:0:55141:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305850.944991:0:55141:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c6e8aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196eb2d expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.945038:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e8b1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.945050:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e8b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.945061:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e8b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.945074:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6e8b8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.945081:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6e8b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.945087:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6e8b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.945149:0:55141:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e8b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.945166:0:55141:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e8b1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.945173:0:55141:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e8b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.945179:0:55141:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f0848df9 already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305850.945183:0:55141:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e8b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.945191:0:55141:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e8b1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.945202:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:3.0:1772305850.945205:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305850.945209:0:55141:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e8b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.945215:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e8b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.945226:0:55141:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6e8b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.945233:0:55141:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6e8b8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.945240:0:55141:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6e8b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.945258:0:55141:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000403929b5 already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305850.945260:0:55141:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6e8b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.945267:0:55141:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6e8b8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.945275:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3148153d (000000006ffb5619) 00010000:00010000:3.0:1772305850.945277:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305850.945279:0:55141:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6e8b8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.945285:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6e8b8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.945314:0:55141:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c6e8aa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb2d expref: 43 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.945322:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c6e8aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb2d expref: 43 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.945330:0:55141:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0648135, rc 0) 00000100:00100000:3.0:1772305850.945375:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000301518ab pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+42:93698:x1858396225331712:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 421us (537us total) trans 0 rc 301/301 00000100:00100000:3.0:1772305850.945391:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 642 00000100:00100000:3.0:1772305850.947316:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305850.948526:0:55141:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d0e10cf7 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:55141:1858396216593344:192.168.203.30@tcp:104: 00010000:00010000:3.0:1772305850.948550:0:55141:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 000000007c4795ba/0xa5e9c8c58c6e8bf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305850.948603:0:5494:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225331904 00010000:00010000:2.0:1772305850.948620:0:5494:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c6e887 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb1f expref: 51 pid: 55141 timeout: 1262 lvb_type: 0 00000100:00100000:2.0:1772305850.948673:0:5494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3053 00000100:00100000:2.0:1772305850.948677:0:5494:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d0e10cf7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+51:2215:x1858396225331904:12345-192.168.203.30@tcp:103:ldlm_bl_07.0 00010000:00010000:2.0:1772305850.948686:0:5494:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1772305850.948689:0:5494:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c6e887 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb1f expref: 51 pid: 55141 timeout: 1262 lvb_type: 0 00010000:00010000:2.0:1772305850.948707:0:5494:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c6e887 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb1f expref: 51 pid: 55141 timeout: 1262 lvb_type: 0 00010000:00010000:2.0:1772305850.948717:0:5494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c6e887 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb1f expref: 51 pid: 55141 timeout: 1262 lvb_type: 0 00010000:00010000:2.0:1772305850.948725:0:5494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:2.0:1772305850.948727:0:5494:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: 000000007c4795ba/0xa5e9c8c58c6e8bf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305850.948732:0:5494:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 000000007c4795ba/0xa5e9c8c58c6e8bf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305850.948736:0:5494:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007c4795ba/0xa5e9c8c58c6e8bf lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305850.948751:0:5494:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1772305850.948766:0:55141:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 000000007c4795ba/0xa5e9c8c58c6e8bf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.948774:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007c4795ba/0xa5e9c8c58c6e8bf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305850.948780:0:5494:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d0e10cf7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+50:2215:x1858396225331904:12345-192.168.203.30@tcp:103:ldlm_bl_07.0 Request processed in 99us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305850.948790:0:5494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3053 00010000:00010000:3.0:1772305850.948795:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000a5c1895c/0xa5e9c8c58c6e8c6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x3148153d bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.948803:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a5c1895c/0xa5e9c8c58c6e8c6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.948810:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a5c1895c/0xa5e9c8c58c6e8c6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1772305850.949359:0:55141:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000408:0x85:0x0]: returning size 512 00010000:00010000:3.0:1772305850.949364:0:55141:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000007c4795ba/0xa5e9c8c58c6e8bf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.949370:0:55141:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000007c4795ba/0xa5e9c8c58c6e8bf lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.949374:0:55141:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000007c4795ba/0xa5e9c8c58c6e8bf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.949378:0:55141:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000007c4795ba already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305850.949380:0:55141:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007c4795ba/0xa5e9c8c58c6e8bf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.949389:0:55141:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007c4795ba/0xa5e9c8c58c6e8bf lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.949395:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:3.0:1772305850.949396:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305850.949398:0:55141:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000007c4795ba/0xa5e9c8c58c6e8bf lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305850.949401:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007c4795ba/0xa5e9c8c58c6e8bf lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1772305850.949408:0:55141:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000003e88e354 reply state 00000000c67d24cd transno 8589934800 ns: mdt-lustre-MDT0000_UUID lock: 00000000a5c1895c/0xa5e9c8c58c6e8c6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305850.949449:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003e88e354 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+43:93698:x1858396225331840:12345-192.168.203.30@tcp:36:lfs.0 Request processed in 2060us (2134us total) trans 8589934800 rc 0/0 00000100:00100000:3.0:1772305850.949454:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 643 00010000:00010000:2.0:1772305850.949988:0:2978:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000a5c1895c/0xa5e9c8c58c6e8c6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305850.949998:0:2978:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a5c1895c/0xa5e9c8c58c6e8c6 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305850.950005:0:2978:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000a5c1895c/0xa5e9c8c58c6e8c6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305850.950025:0:2978:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a5c1895c already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305850.950027:0:2978:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a5c1895c/0xa5e9c8c58c6e8c6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305850.950032:0:2978:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a5c1895c/0xa5e9c8c58c6e8c6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305850.950039:0:2978:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3148153d (00000000c7517594) 00010000:00010000:2.0:1772305850.950040:0:2978:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305850.950042:0:2978:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000a5c1895c/0xa5e9c8c58c6e8c6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305850.950046:0:2978:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a5c1895c/0xa5e9c8c58c6e8c6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305851.080824:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1772305852.105711:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1772305852.352341:0:65227:0:(class_obd.c:302:class_handle_ioctl()) cmd = c008667f 00000020:00000080:3.0:1772305852.352351:0:65227:0:(class_obd.c:126:class_resolve_dev_name()) device name lustre-MDT0000 00000020:00000080:3.0:1772305852.352356:0:65227:0:(class_obd.c:133:class_resolve_dev_name()) device name lustre-MDT0000, dev 5 00000020:00000080:3.0:1772305852.352376:0:65227:0:(class_obd.c:302:class_handle_ioctl()) cmd = 424066b1 00000004:00000080:3.0:1772305852.352382:0:65227:0:(mdt_handler.c:7411:mdt_iocontrol()) handling ioctl cmd 0x424066b1 00000040:00080000:3.0:1772305852.352586:0:65227:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x11:0x0].8, 80 off8832 00000004:00000080:3.0:1772305852.352604:0:65227:0:(mdd_device.c:1821:mdd_changelog_user_register()) lustre-MDD0000: registered changelog user 'cl8', mask 0x0 00000004:02000000:3.0:1772305852.352606:0:65227:0:(mdd_device.c:460:mdd_changelog_on()) lustre-MDD0000: changelog on 00000100:00100000:3.0:1772305852.420406:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225332032 00000100:00100000:3.0:1772305852.420475:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 644 00000100:00100000:3.0:1772305852.420484:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000873b4f3c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+42:93767:x1858396225332032:12345-192.168.203.30@tcp:36:mkdir.0 00000100:00100000:3.0:1772305852.420768:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000873b4f3c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+42:93767:x1858396225332032:12345-192.168.203.30@tcp:36:mkdir.0 Request processed in 284us (462us total) trans 0 rc -17/-17 00000100:00100000:3.0:1772305852.420776:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 644 00000100:00100000:3.0:1772305852.421817:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225332096 00000100:00100000:3.0:1772305852.421843:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 645 00000100:00100000:3.0:1772305852.421847:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003fdd35f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+42:93767:x1858396225332096:12345-192.168.203.30@tcp:101:mkdir.0 00010000:00010000:3.0:1772305852.421857:0:55141:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305852.421877:0:55141:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c6e8cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196eb34 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.421936:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6e8d4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.421950:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6e8d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.421962:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6e8d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.421974:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e8db lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.421978:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e8db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.421982:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e8db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.422034:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e8e2 lrc: 3/1,0 mode: --/PR res: [0x200000408:0x85:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.422051:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e8e2 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x85:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.422059:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e8e2 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x85:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1772305852.422104:0:55141:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000408:0x85:0x0]: returning size 512 00000004:00200000:3.0:1772305852.422107:0:55141:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1772305852.422127:0:55141:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e8e2 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x85:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.422136:0:55141:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6e8d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.422141:0:55141:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6e8d4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.422147:0:55141:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6e8d4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.422151:0:55141:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000403929b5 already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305852.422154:0:55141:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6e8d4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.422159:0:55141:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6e8d4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.422169:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:3.0:1772305852.422171:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305852.422180:0:55141:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6e8d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.422185:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6e8d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.422194:0:55141:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e8db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.422198:0:55141:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e8db lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.422202:0:55141:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e8db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.422205:0:55141:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f0848df9 already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305852.422206:0:55141:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e8db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.422210:0:55141:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e8db lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.422214:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3148153d (000000006ffb5619) 00010000:00010000:3.0:1772305852.422215:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305852.422216:0:55141:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e8db lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.422219:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e8db lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.422241:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c6e8cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb34 expref: 44 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.422254:0:55141:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e8e2 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x85:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb34 expref: 43 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.422260:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x85:0x0].0x0 (000000005333691a) 00010000:00010000:3.0:1772305852.422261:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1772305852.422263:0:55141:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000051c27e8b, rc 0) 00000100:00100000:3.0:1772305852.422289:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003fdd35f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+43:93767:x1858396225332096:12345-192.168.203.30@tcp:101:mkdir.0 Request processed in 442us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305852.422294:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 645 00000100:00100000:3.0:1772305852.441678:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225332160 00000100:00100000:3.0:1772305852.441746:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 646 00000100:00100000:3.0:1772305852.441755:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000025278777 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+50:93773:x1858396225332160:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1772305852.441779:0:55141:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305852.441802:0:55141:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c6e8e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196eb3b expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.441868:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e8f0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.441895:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e8f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.441908:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e8f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1772305852.441974:0:55141:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:3.0:1772305852.441978:0:55141:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 103 stripe count 1 MDT count 1 00000004:00010000:3.0:1772305852.442021:0:55141:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e8f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.442047:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c6e8e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb3b expref: 52 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.442065:0:55141:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e8f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb3b expref: 51 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.442075:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:3.0:1772305852.442078:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1772305852.442083:0:55141:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f0848df9, rc 0) 00000100:00100000:3.0:1772305852.442155:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000025278777 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+51:93773:x1858396225332160:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 400us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305852.442162:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 646 00000100:00100000:3.0:1772305852.444272:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225332288 00000100:00100000:3.0:1772305852.444307:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 647 00000100:00100000:3.0:1772305852.444313:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000924bcdea pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+43:93773:x1858396225332288:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1772305852.444323:0:55141:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305852.444326:0:55141:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1772305852.444345:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6e8e2 lrc: 0/0,0 mode: --/PR res: [0x200000408:0x85:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb34 expref: 43 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.444358:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x85:0x0].0x0 (000000005333691a) 00010000:00010000:3.0:1772305852.444367:0:55141:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1772305852.444379:0:55141:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6e8f7 lrc: 2/0,0 mode: --/CW res: [0x200000408:0x85:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196eb42 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.444478:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000094970864/0xa5e9c8c58c6e8fe lrc: 3/0,1 mode: --/CW res: [0x200000408:0x85:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.444497:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000094970864/0xa5e9c8c58c6e8fe lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x85:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.444506:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000094970864/0xa5e9c8c58c6e8fe lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x85:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.444665:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6e905 lrc: 3/0,1 mode: --/PW res: [0x200000408:0x85:0x0].0xfd36da02 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.444692:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6e905 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x85:0x0].0xfd36da02 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.444702:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6e905 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x85:0x0].0xfd36da02 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1772305852.445102:0:55141:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x13:0x0].32, 184 off13456 00010000:00010000:3.0:1772305852.445226:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000a5c1895c/0xa5e9c8c58c6e90c lrc: 3/1,0 mode: --/CR res: [0x200000408:0x87:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.445233:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a5c1895c/0xa5e9c8c58c6e90c lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x87:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.445238:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a5c1895c/0xa5e9c8c58c6e90c lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x87:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1772305852.445245:0:55141:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000408:0x87:0x0]: returning size 0 00010000:00010000:3.0:1772305852.445263:0:55141:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000094970864/0xa5e9c8c58c6e8fe lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x85:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.445268:0:55141:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000094970864/0xa5e9c8c58c6e8fe lrc: 2/0,0 mode: CW/CW res: [0x200000408:0x85:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.445283:0:55141:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000094970864/0xa5e9c8c58c6e8fe lrc: 3/0,0 mode: CW/CW res: [0x200000408:0x85:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.445288:0:55141:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000094970864 already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305852.445291:0:55141:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000094970864/0xa5e9c8c58c6e8fe lrc: 3/0,0 mode: CW/CW res: [0x200000408:0x85:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.445295:0:55141:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000094970864/0xa5e9c8c58c6e8fe lrc: 4/0,0 mode: CW/CW res: [0x200000408:0x85:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.445304:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x85:0x0].0x0 (000000006ffb5619) 00010000:00010000:3.0:1772305852.445306:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305852.445309:0:55141:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000094970864/0xa5e9c8c58c6e8fe lrc: 2/0,0 mode: --/CW res: [0x200000408:0x85:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.445313:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000094970864/0xa5e9c8c58c6e8fe lrc: 0/0,0 mode: --/CW res: [0x200000408:0x85:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1772305852.445320:0:55141:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000924bcdea reply state 000000004e73ab1b transno 8589934801 ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6e905 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x85:0x0].0xfd36da02 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.445346:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6e8f7 lrc: 0/0,0 mode: --/CW res: [0x200000408:0x85:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb42 expref: 45 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.445358:0:55141:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000a5c1895c/0xa5e9c8c58c6e90c lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x87:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb42 expref: 44 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.445362:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x87:0x0].0x0 (00000000a6deaf5e) 00010000:00010000:3.0:1772305852.445367:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1772305852.445369:0:55141:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5c1895c, rc 0) 00000100:00100000:3.0:1772305852.445435:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000924bcdea pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+45:93773:x1858396225332288:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 1122us (1196us total) trans 8589934801 rc 0/0 00000100:00100000:3.0:1772305852.445442:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 647 00010000:00010000:1.0:1772305852.446174:0:2977:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6e905 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x85:0x0].0xfd36da02 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305852.446188:0:2977:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6e905 lrc: 2/0,0 mode: PW/PW res: [0x200000408:0x85:0x0].0xfd36da02 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305852.446196:0:2977:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6e905 lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x85:0x0].0xfd36da02 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305852.446203:0:2977:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c6c2d285 already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305852.446207:0:2977:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6e905 lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x85:0x0].0xfd36da02 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305852.446214:0:2977:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6e905 lrc: 4/0,0 mode: PW/PW res: [0x200000408:0x85:0x0].0xfd36da02 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305852.446234:0:2977:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x85:0x0].0xfd36da02 (00000000fbf2c1ae) 00010000:00010000:1.0:1772305852.446236:0:2977:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305852.446239:0:2977:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6e905 lrc: 2/0,0 mode: --/PW res: [0x200000408:0x85:0x0].0xfd36da02 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305852.446243:0:2977:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6e905 lrc: 0/0,0 mode: --/PW res: [0x200000408:0x85:0x0].0xfd36da02 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305852.446743:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225332416 00000100:00100000:3.0:1772305852.446778:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 648 00000100:00100000:3.0:1772305852.446782:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fd7b4ff5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+44:93773:x1858396225332416:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1772305852.446799:0:55141:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305852.446810:0:55141:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c6e91a lrc: 2/0,0 mode: --/CR res: [0x200000408:0x85:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196eb49 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.446857:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000bce5ea16/0xa5e9c8c58c6e921 lrc: 3/0,1 mode: --/EX res: [0x200000408:0x87:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.446865:0:55141:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000a5c1895c/0xa5e9c8c58c6e90c lrc: 2/0,0 mode: CR/CR res: [0x200000408:0x87:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb42 expref: 45 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.446870:0:55141:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 00000000bce5ea16/0xa5e9c8c58c6e921 lrc: 4/0,1 mode: --/EX res: [0x200000408:0x87:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.446915:0:55141:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000a5c1895c/0xa5e9c8c58c6e90c lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x87:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb42 expref: 45 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.446928:0:55141:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000a5c1895c/0xa5e9c8c58c6e90c lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x87:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb42 expref: 45 pid: 55141 timeout: 1264 lvb_type: 0 00000100:00100000:3.0:1772305852.446940:0:55141:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bb867392 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:55141:1858396216593408:192.168.203.30@tcp:104: 00000100:00100000:3.0:1772305852.447001:0:55141:0:(client.c:2500:ptlrpc_set_wait()) set 00000000759303ac going to sleep for 6 seconds 00000100:00100000:3.0:1772305852.447964:0:55141:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bb867392 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:55141:1858396216593408:192.168.203.30@tcp:104: 00010000:00010000:3.0:1772305852.447979:0:55141:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 00000000bce5ea16/0xa5e9c8c58c6e921 lrc: 3/0,1 mode: --/EX res: [0x200000408:0x87:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305852.448208:0:5494:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225332480 00010000:00010000:2.0:1772305852.448228:0:5494:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a5c1895c/0xa5e9c8c58c6e90c lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x87:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb42 expref: 46 pid: 55141 timeout: 1264 lvb_type: 0 00000100:00100000:2.0:1772305852.448253:0:5494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3054 00000100:00100000:2.0:1772305852.448257:0:5494:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008e341f60 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+46:2216:x1858396225332480:12345-192.168.203.30@tcp:103:ldlm_bl_08.0 00010000:00010000:2.0:1772305852.448265:0:5494:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1772305852.448270:0:5494:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000a5c1895c/0xa5e9c8c58c6e90c lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x87:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb42 expref: 46 pid: 55141 timeout: 1264 lvb_type: 0 00010000:00010000:2.0:1772305852.448278:0:5494:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000a5c1895c/0xa5e9c8c58c6e90c lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x87:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb42 expref: 46 pid: 55141 timeout: 1264 lvb_type: 0 00010000:00010000:2.0:1772305852.448299:0:5494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a5c1895c/0xa5e9c8c58c6e90c lrc: 0/0,0 mode: --/CR res: [0x200000408:0x87:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb42 expref: 46 pid: 55141 timeout: 1264 lvb_type: 0 00010000:00010000:2.0:1772305852.448307:0:5494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x87:0x0].0x0 (00000000a6deaf5e) 00010000:00010000:2.0:1772305852.448310:0:5494:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: 00000000bce5ea16/0xa5e9c8c58c6e921 lrc: 3/0,1 mode: --/EX res: [0x200000408:0x87:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305852.448315:0:5494:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000bce5ea16/0xa5e9c8c58c6e921 lrc: 3/0,1 mode: EX/EX res: [0x200000408:0x87:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305852.448319:0:5494:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000bce5ea16/0xa5e9c8c58c6e921 lrc: 4/0,1 mode: EX/EX res: [0x200000408:0x87:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305852.448335:0:5494:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1772305852.448351:0:55141:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 00000000bce5ea16/0xa5e9c8c58c6e921 lrc: 3/0,1 mode: EX/EX res: [0x200000408:0x87:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.448358:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000bce5ea16/0xa5e9c8c58c6e921 lrc: 3/0,1 mode: EX/EX res: [0x200000408:0x87:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305852.448362:0:5494:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008e341f60 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+45:2216:x1858396225332480:12345-192.168.203.30@tcp:103:ldlm_bl_08.0 Request processed in 102us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305852.448377:0:5494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3054 00000004:00200000:3.0:1772305852.448380:0:55141:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000408:0x87:0x0]: returning size 0 00000040:00080000:3.0:1772305852.448568:0:55141:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x13:0x0].33, 168 off13624 00010000:00010000:3.0:1772305852.448650:0:55141:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000bce5ea16/0xa5e9c8c58c6e921 lrc: 3/0,1 mode: EX/EX res: [0x200000408:0x87:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.448660:0:55141:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000bce5ea16/0xa5e9c8c58c6e921 lrc: 2/0,0 mode: EX/EX res: [0x200000408:0x87:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.448667:0:55141:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000bce5ea16/0xa5e9c8c58c6e921 lrc: 3/0,0 mode: EX/EX res: [0x200000408:0x87:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.448673:0:55141:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000bce5ea16 already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305852.448675:0:55141:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000bce5ea16/0xa5e9c8c58c6e921 lrc: 3/0,0 mode: EX/EX res: [0x200000408:0x87:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.448682:0:55141:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000bce5ea16/0xa5e9c8c58c6e921 lrc: 4/0,0 mode: EX/EX res: [0x200000408:0x87:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.448692:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x87:0x0].0x0 (00000000a6deaf5e) 00010000:00010000:3.0:1772305852.448701:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1772305852.448704:0:55141:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000bce5ea16/0xa5e9c8c58c6e921 lrc: 2/0,0 mode: --/EX res: [0x200000408:0x87:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.448710:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000bce5ea16/0xa5e9c8c58c6e921 lrc: 0/0,0 mode: --/EX res: [0x200000408:0x87:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.448735:0:55141:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c6e91a lrc: 1/0,0 mode: --/CR res: [0x200000408:0x85:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb49 expref: 45 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.448740:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c6e91a lrc: 0/0,0 mode: --/CR res: [0x200000408:0x85:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb49 expref: 45 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.448746:0:55141:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000617aea8a, rc 0) 00000100:00100000:3.0:1772305852.448774:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fd7b4ff5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+44:93773:x1858396225332416:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 1990us (2069us total) trans 8589934802 rc 301/301 00000100:00100000:3.0:1772305852.448779:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 648 00000100:00100000:1.0:1772305852.449708:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225332608 00000100:00100000:1.0:1772305852.449788:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 84 00000100:00100000:1.0:1772305852.449799:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006f4c803f pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+44:93773:x1858396225332608:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000040:00080000:1.0:1772305852.450104:0:57054:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x13:0x0].34, 168 off13792 00000001:00080000:1.0:1772305852.450111:0:57054:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934803 00000100:00100000:1.0:1772305852.450189:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006f4c803f pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+45:93773:x1858396225332608:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 393us (523us total) trans 8589934803 rc 0/0 00000100:00100000:1.0:1772305852.450198:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 84 00000100:00100000:3.0:1772305852.450955:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225332672 00000100:00100000:3.0:1772305852.450986:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 649 00000100:00100000:3.0:1772305852.450990:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004ebc4db7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+45:93773:x1858396225332672:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1772305852.451003:0:55141:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305852.451013:0:55141:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d02430e8/0xa5e9c8c58c6e92f lrc: 2/0,0 mode: --/CR res: [0x200000408:0x87:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196eb50 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.451037:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d02430e8/0xa5e9c8c58c6e92f lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x87:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb50 expref: 46 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.451044:0:55141:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000d02430e8/0xa5e9c8c58c6e92f lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x87:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb50 expref: 46 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.451066:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x87:0x0].0x0 (0000000077cfe56e) 00010000:00010000:3.0:1772305852.451068:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1772305852.451069:0:55141:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d02430e8, rc 0) 00000100:00100000:3.0:1772305852.451099:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004ebc4db7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+46:93773:x1858396225332672:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 108us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305852.451105:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 649 00000100:00100000:3.0:1772305852.451937:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225332800 00000100:00100000:3.0:1772305852.451964:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 650 00000100:00100000:3.0:1772305852.451968:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001770c2e6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+46:93773:x1858396225332800:12345-192.168.203.30@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1772305852.451991:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6e936 lrc: 3/0,1 mode: --/PW res: [0x200000408:0x87:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.451998:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6e936 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x87:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.452004:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6e936 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x87:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1772305852.452113:0:55141:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x13:0x0].35, 168 off13960 00010000:00010000:3.0:1772305852.452161:0:55141:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6e936 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x87:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.452166:0:55141:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6e936 lrc: 2/0,0 mode: PW/PW res: [0x200000408:0x87:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.452170:0:55141:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6e936 lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x87:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.452183:0:55141:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cace9935 already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305852.452185:0:55141:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6e936 lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x87:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.452189:0:55141:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6e936 lrc: 4/0,0 mode: PW/PW res: [0x200000408:0x87:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.452195:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x87:0x0].0x0 (0000000077cfe56e) 00010000:00010000:3.0:1772305852.452197:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1772305852.452198:0:55141:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6e936 lrc: 2/0,0 mode: --/PW res: [0x200000408:0x87:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.452202:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6e936 lrc: 0/0,0 mode: --/PW res: [0x200000408:0x87:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305852.452237:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001770c2e6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+47:93773:x1858396225332800:12345-192.168.203.30@tcp:55:lhsmtool_posix.0 Request processed in 268us (359us total) trans 8589934804 rc 0/0 00000100:00100000:3.0:1772305852.452242:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 650 00000100:00100000:3.0:1772305852.452910:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225332928 00000100:00100000:3.0:1772305852.452943:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 651 00000100:00100000:3.0:1772305852.452949:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cd147362 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+47:93773:x1858396225332928:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1772305852.453039:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d6b71f01/0xa5e9c8c58c6e93d lrc: 3/0,1 mode: --/PW res: [0x200000408:0x87:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.453047:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d6b71f01/0xa5e9c8c58c6e93d lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x87:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.453052:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d6b71f01/0xa5e9c8c58c6e93d lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x87:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1772305852.453145:0:55141:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x13:0x0].36, 168 off14128 00000001:00080000:3.0:1772305852.453152:0:55141:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934805 00000004:00010000:3.0:1772305852.453170:0:55141:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000cd147362 reply state 00000000c1b1776a transno 8589934805 ns: mdt-lustre-MDT0000_UUID lock: 00000000d6b71f01/0xa5e9c8c58c6e93d lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x87:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305852.453221:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cd147362 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+49:93773:x1858396225332928:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 272us (359us total) trans 8589934805 rc 0/0 00000100:00100000:3.0:1772305852.453226:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 651 00010000:00010000:2.0:1772305852.453843:0:2978:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d6b71f01/0xa5e9c8c58c6e93d lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x87:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305852.453853:0:2978:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d6b71f01/0xa5e9c8c58c6e93d lrc: 2/0,0 mode: PW/PW res: [0x200000408:0x87:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305852.453857:0:2978:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d6b71f01/0xa5e9c8c58c6e93d lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x87:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305852.453862:0:2978:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d6b71f01 already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305852.453864:0:2978:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d6b71f01/0xa5e9c8c58c6e93d lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x87:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305852.453878:0:2978:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d6b71f01/0xa5e9c8c58c6e93d lrc: 4/0,0 mode: PW/PW res: [0x200000408:0x87:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305852.453902:0:2978:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x87:0x0].0x0 (0000000077cfe56e) 00010000:00010000:2.0:1772305852.453904:0:2978:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1772305852.453907:0:2978:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d6b71f01/0xa5e9c8c58c6e93d lrc: 2/0,0 mode: --/PW res: [0x200000408:0x87:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305852.453911:0:2978:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d6b71f01/0xa5e9c8c58c6e93d lrc: 0/0,0 mode: --/PW res: [0x200000408:0x87:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305852.454026:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225333056 00000100:00100000:1.0:1772305852.454064:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 85 00000100:00100000:1.0:1772305852.454070:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e9e81c30 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+48:93773:x1858396225333056:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000040:00080000:1.0:1772305852.454170:0:57054:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x13:0x0].37, 168 off14296 00000100:00100000:1.0:1772305852.454235:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e9e81c30 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+49:93773:x1858396225333056:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 163us (258us total) trans 8589934806 rc 0/0 00000100:00100000:1.0:1772305852.454244:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 85 00000100:00100000:3.0:1772305852.467400:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225333120 00000100:00100000:3.0:1772305852.467448:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 652 00000100:00100000:3.0:1772305852.467456:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a26b6941 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+49:93775:x1858396225333120:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1772305852.467479:0:55141:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305852.467499:0:55141:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6e944 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196eb57 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.467563:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000bce5ea16/0xa5e9c8c58c6e94b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.467580:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000bce5ea16/0xa5e9c8c58c6e94b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.467592:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000bce5ea16/0xa5e9c8c58c6e94b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.467607:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6e952 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.467616:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6e952 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.467661:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6e952 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.467778:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e68b50db/0xa5e9c8c58c6e959 lrc: 3/1,0 mode: --/PR res: [0x200000408:0x85:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.467788:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e68b50db/0xa5e9c8c58c6e959 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x85:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.467796:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e68b50db/0xa5e9c8c58c6e959 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x85:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1772305852.467827:0:55141:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000408:0x85:0x0]: returning size 512 00000004:00200000:3.0:1772305852.467831:0:55141:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1772305852.467853:0:55141:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000e68b50db/0xa5e9c8c58c6e959 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x85:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.467866:0:55141:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000bce5ea16/0xa5e9c8c58c6e94b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.467873:0:55141:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000bce5ea16/0xa5e9c8c58c6e94b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.467898:0:55141:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000bce5ea16/0xa5e9c8c58c6e94b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.467905:0:55141:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000bce5ea16 already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305852.467909:0:55141:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000bce5ea16/0xa5e9c8c58c6e94b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.467931:0:55141:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000bce5ea16/0xa5e9c8c58c6e94b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.467944:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:3.0:1772305852.467948:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305852.467952:0:55141:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000bce5ea16/0xa5e9c8c58c6e94b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.467960:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000bce5ea16/0xa5e9c8c58c6e94b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.467971:0:55141:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6e952 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.467978:0:55141:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6e952 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.467986:0:55141:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6e952 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.467992:0:55141:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ca5be8d6 already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305852.467995:0:55141:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6e952 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.468002:0:55141:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6e952 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.468011:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3148153d (000000009fad10f9) 00010000:00010000:3.0:1772305852.468013:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305852.468021:0:55141:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6e952 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.468029:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6e952 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3148153d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.468061:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6e944 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb57 expref: 51 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.468075:0:55141:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000e68b50db/0xa5e9c8c58c6e959 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x85:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb57 expref: 50 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.468082:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x85:0x0].0x0 (00000000a6deaf5e) 00010000:00010000:3.0:1772305852.468085:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1772305852.468087:0:55141:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e68b50db, rc 0) 00000100:00100000:3.0:1772305852.468137:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a26b6941 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+50:93775:x1858396225333120:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 681us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305852.468146:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 652 00000100:00100000:3.0:1772305852.469136:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225333184 00000100:00100000:3.0:1772305852.469160:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 653 00000100:00100000:3.0:1772305852.469164:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000049ea3c34 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+50:93775:x1858396225333184:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1772305852.469171:0:55141:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305852.469179:0:55141:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007e4c73f4/0xa5e9c8c58c6e960 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x85:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196eb5e expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.469204:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6e967 lrc: 3/1,0 mode: --/CR res: [0x200000408:0x85:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.469211:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6e967 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x85:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.469224:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6e967 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x85:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.469232:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6e96e lrc: 3/1,0 mode: --/PR res: [0x200000408:0x85:0x0].0xfd36da02 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.469238:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6e96e lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x85:0x0].0xfd36da02 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.469242:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6e96e lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x85:0x0].0xfd36da02 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.469278:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6e975 lrc: 3/1,0 mode: --/PR res: [0x200000408:0x87:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.469284:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6e975 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x87:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.469288:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6e975 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x87:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1772305852.469305:0:55141:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000408:0x87:0x0]: returning size 40894464 00000004:00200000:3.0:1772305852.469307:0:55141:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1772305852.469313:0:55141:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6e975 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x87:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.469320:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6e975 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x87:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.469325:0:55141:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6e967 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x85:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.469335:0:55141:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6e967 lrc: 2/0,0 mode: CR/CR res: [0x200000408:0x85:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.469339:0:55141:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6e967 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x85:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.469342:0:55141:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000009fea887 already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305852.469344:0:55141:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6e967 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x85:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.469348:0:55141:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6e967 lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x85:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.469359:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x85:0x0].0x0 (00000000a6deaf5e) 00010000:00010000:3.0:1772305852.469361:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305852.469362:0:55141:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6e967 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x85:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.469366:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6e967 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x85:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.469373:0:55141:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6e96e lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x85:0x0].0xfd36da02 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.469377:0:55141:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6e96e lrc: 2/0,0 mode: PR/PR res: [0x200000408:0x85:0x0].0xfd36da02 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.469381:0:55141:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6e96e lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x85:0x0].0xfd36da02 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.469392:0:55141:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d90d1abd already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305852.469393:0:55141:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6e96e lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x85:0x0].0xfd36da02 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.469397:0:55141:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6e96e lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x85:0x0].0xfd36da02 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.469401:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x85:0x0].0xfd36da02 (000000006ffb5619) 00010000:00010000:3.0:1772305852.469403:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305852.469404:0:55141:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6e96e lrc: 2/0,0 mode: --/PR res: [0x200000408:0x85:0x0].0xfd36da02 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.469407:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6e96e lrc: 0/0,0 mode: --/PR res: [0x200000408:0x85:0x0].0xfd36da02 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.469422:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007e4c73f4/0xa5e9c8c58c6e960 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x85:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb5e expref: 52 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.469429:0:55141:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6e975 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x87:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb5e expref: 51 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.469434:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x87:0x0].0x0 (0000000077cfe56e) 00010000:00010000:3.0:1772305852.469436:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1772305852.469437:0:55141:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002f753c58, rc 0) 00000100:00100000:3.0:1772305852.469463:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000049ea3c34 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+51:93775:x1858396225333184:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 298us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305852.469468:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 653 00000100:00100000:3.0:1772305852.478340:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225333248 00000100:00100000:3.0:1772305852.478380:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 654 00000100:00100000:3.0:1772305852.478386:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b7808eb8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+51:93777:x1858396225333248:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1772305852.478399:0:55141:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305852.478413:0:55141:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007e4c73f4/0xa5e9c8c58c6e97c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196eb65 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.478451:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6e983 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.478464:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6e983 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.478474:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6e983 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1772305852.478510:0:55141:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:3.0:1772305852.478513:0:55141:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 103 stripe count 1 MDT count 1 00000004:00010000:3.0:1772305852.478532:0:55141:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6e983 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.478552:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007e4c73f4/0xa5e9c8c58c6e97c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb65 expref: 53 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.478565:0:55141:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6e983 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb65 expref: 52 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.478573:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:3.0:1772305852.478576:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1772305852.478578:0:55141:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d90d1abd, rc 0) 00000100:00100000:3.0:1772305852.478615:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b7808eb8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+52:93777:x1858396225333248:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 228us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305852.478664:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 654 00000100:00100000:3.0:1772305852.479569:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225333312 00000100:00100000:3.0:1772305852.479602:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 655 00000100:00100000:3.0:1772305852.479609:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000edb23783 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+52:93777:x1858396225333312:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1772305852.479620:0:55141:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305852.479652:0:55141:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6e98a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196eb6c expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.479677:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6e991 lrc: 3/1,0 mode: --/PR res: [0x200000408:0x85:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.479686:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6e991 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x85:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.479696:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6e991 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x85:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1772305852.479724:0:55141:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000408:0x85:0x0]: returning size 512 00000004:00200000:3.0:1772305852.479727:0:55141:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1772305852.479743:0:55141:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6e991 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x85:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.479763:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6e98a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb6c expref: 54 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.479777:0:55141:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6e991 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x85:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb6c expref: 53 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.479784:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x85:0x0].0x0 (00000000a6deaf5e) 00010000:00010000:3.0:1772305852.479793:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1772305852.479796:0:55141:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000cace9935, rc 0) 00000100:00100000:3.0:1772305852.479831:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000edb23783 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+53:93777:x1858396225333312:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 222us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305852.479839:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 655 00000100:00100000:3.0:1772305852.482091:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225333440 00000100:00100000:3.0:1772305852.482124:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 656 00000100:00100000:3.0:1772305852.482130:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000023b4ec49 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+53:93777:x1858396225333440:12345-192.168.203.30@tcp:58:lfs.0 00010000:00010000:3.0:1772305852.482178:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6e998 lrc: 3/0,1 mode: --/EX res: [0x200000408:0x87:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.482188:0:55141:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000d02430e8/0xa5e9c8c58c6e92f lrc: 2/0,0 mode: CR/CR res: [0x200000408:0x87:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb50 expref: 53 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.482193:0:55141:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6e975 lrc: 2/0,0 mode: PR/PR res: [0x200000408:0x87:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb5e expref: 53 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.482198:0:55141:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6e998 lrc: 5/0,1 mode: --/EX res: [0x200000408:0x87:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.482232:0:55141:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6e975 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x87:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb5e expref: 53 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.482246:0:55141:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6e975 lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x87:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb5e expref: 53 pid: 55141 timeout: 1264 lvb_type: 0 00000100:00100000:3.0:1772305852.482262:0:55141:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bb867392 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:55141:1858396216593472:192.168.203.30@tcp:104: 00010000:00010000:3.0:1772305852.482324:0:55141:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000d02430e8/0xa5e9c8c58c6e92f lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x87:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb50 expref: 53 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.482338:0:55141:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000d02430e8/0xa5e9c8c58c6e92f lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x87:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb50 expref: 53 pid: 55141 timeout: 1264 lvb_type: 0 00000100:00100000:3.0:1772305852.482345:0:55141:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a7458d21 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:55141:1858396216593536:192.168.203.30@tcp:104: 00000100:00100000:3.0:1772305852.482367:0:55141:0:(client.c:2500:ptlrpc_set_wait()) set 00000000c1bc7b25 going to sleep for 6 seconds 00000100:00100000:3.0:1772305852.483386:0:55141:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bb867392 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:55141:1858396216593472:192.168.203.30@tcp:104: 00000100:00100000:1.0:1772305852.483472:0:54689:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225333504 00000100:00100000:3.0:1772305852.483475:0:55141:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a7458d21 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:55141:1858396216593536:192.168.203.30@tcp:104: 00010000:00010000:3.0:1772305852.483510:0:55141:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6e998 lrc: 3/0,1 mode: --/EX res: [0x200000408:0x87:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305852.483520:0:54689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 118 00000100:00100000:2.0:1772305852.483525:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225333632 00000100:00100000:1.0:1772305852.483528:0:54689:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003571e040 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2215:x1858396225333504:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1772305852.483574:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225333760 00000100:00100000:3.0:1772305852.483585:0:18149:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225333568 00000100:00100000:1.0:1772305852.483596:0:54689:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003571e040 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2215:x1858396225333504:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 68us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305852.483607:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1122 00000100:00100000:1.0:1772305852.483621:0:54689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 118 00000100:00100000:2.0:1772305852.483622:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009adfd4b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2215:x1858396225333632:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1772305852.483664:0:18149:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225333696 00000100:00100000:2.0:1772305852.483682:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009adfd4b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2215:x1858396225333632:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 67us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305852.483690:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1122 00000100:00100000:3.0:1772305852.483697:0:18149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1123 00000100:00100000:3.0:1772305852.483705:0:18149:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000065549302 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f935b4d0-e17f-49c8-8011-4be99ba75430+140:2215:x1858396225333760:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1772305852.483709:0:48463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1124 00000100:00100000:2.0:1772305852.483725:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1125 00000100:00100000:1.0:1772305852.483725:0:48463:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000096c63f8a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:370cd859-ca07-4cc9-a865-ed970d9eaddd+222:2216:x1858396225333568:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1772305852.483733:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009e643511 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f935b4d0-e17f-49c8-8011-4be99ba75430+160:2216:x1858396225333696:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1772305852.483768:0:48463:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000096c63f8a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:370cd859-ca07-4cc9-a865-ed970d9eaddd+222:2216:x1858396225333568:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 50us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305852.483773:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009e643511 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f935b4d0-e17f-49c8-8011-4be99ba75430+160:2216:x1858396225333696:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 38us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305852.483781:0:48463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1124 00000100:00100000:2.0:1772305852.483787:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1125 00000100:00100000:3.0:1772305852.483835:0:18149:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000065549302 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f935b4d0-e17f-49c8-8011-4be99ba75430+140:2215:x1858396225333760:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 130us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305852.483841:0:5494:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225333824 00000100:00100000:3.0:1772305852.483844:0:18149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1123 00010000:00010000:2.0:1772305852.483861:0:5494:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d02430e8/0xa5e9c8c58c6e92f lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x87:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb50 expref: 54 pid: 55141 timeout: 1264 lvb_type: 0 00000100:00100000:2.0:1772305852.483919:0:5494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3055 00000100:00100000:1.0:1772305852.483921:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305852.483927:0:5494:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006f351ca5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+54:2216:x1858396225333824:12345-192.168.203.30@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1772305852.483938:0:5494:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1772305852.483944:0:5494:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000d02430e8/0xa5e9c8c58c6e92f lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x87:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb50 expref: 54 pid: 55141 timeout: 1264 lvb_type: 0 00010000:00010000:2.0:1772305852.483953:0:5494:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000d02430e8/0xa5e9c8c58c6e92f lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x87:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb50 expref: 54 pid: 55141 timeout: 1264 lvb_type: 0 00000100:00100000:3.0:1772305852.483959:0:7104:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225333888 00010000:00010000:2.0:1772305852.483967:0:5494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d02430e8/0xa5e9c8c58c6e92f lrc: 0/0,0 mode: --/CR res: [0x200000408:0x87:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb50 expref: 55 pid: 55141 timeout: 1264 lvb_type: 0 00010000:00010000:3.0:1772305852.483975:0:7104:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6e975 lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x87:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb5e expref: 54 pid: 55141 timeout: 1264 lvb_type: 0 00010000:00010000:2.0:1772305852.483977:0:5494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x87:0x0].0x0 (0000000077cfe56e) 00010000:00010000:2.0:1772305852.483984:0:5494:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6e998 lrc: 3/0,1 mode: --/EX res: [0x200000408:0x87:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305852.483992:0:5494:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1772305852.484018:0:5494:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006f351ca5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+54:2216:x1858396225333824:12345-192.168.203.30@tcp:103:ldlm_bl_01.0 Request processed in 93us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305852.484025:0:7104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3056 00000100:00100000:3.0:1772305852.484036:0:7104:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000016a92645 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+54:2217:x1858396225333888:12345-192.168.203.30@tcp:103:ldlm_bl_02.0 00000100:00100000:2.0:1772305852.484037:0:5494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3055 00010000:00010000:3.0:1772305852.484129:0:7104:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1772305852.484137:0:7104:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6e975 lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x87:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb5e expref: 53 pid: 55141 timeout: 1264 lvb_type: 0 00010000:00010000:3.0:1772305852.484175:0:7104:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6e975 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x87:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb5e expref: 53 pid: 55141 timeout: 1264 lvb_type: 0 00010000:00010000:3.0:1772305852.484184:0:7104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6e975 lrc: 0/0,0 mode: --/PR res: [0x200000408:0x87:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb5e expref: 53 pid: 55141 timeout: 1264 lvb_type: 0 00010000:00010000:3.0:1772305852.484191:0:7104:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x87:0x0].0x0 (0000000077cfe56e) 00010000:00010000:3.0:1772305852.484193:0:7104:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6e998 lrc: 3/0,1 mode: --/EX res: [0x200000408:0x87:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.484198:0:7104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6e998 lrc: 3/0,1 mode: EX/EX res: [0x200000408:0x87:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.484202:0:7104:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6e998 lrc: 4/0,1 mode: EX/EX res: [0x200000408:0x87:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.484218:0:7104:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1772305852.484244:0:7104:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000016a92645 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+52:2217:x1858396225333888:12345-192.168.203.30@tcp:103:ldlm_bl_02.0 Request processed in 211us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305852.484258:0:7104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3056 00000100:00100000:1.0:1772305852.490217:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305852.491274:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305852.492449:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305852.493613:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305852.494978:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305852.496919:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305852.498562:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305852.498698:0:7104:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225334464 00010000:00010000:3.0:1772305852.498715:0:7104:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6e991 lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x85:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb6c expref: 51 pid: 55141 timeout: 1264 lvb_type: 0 00000100:00100000:3.0:1772305852.498741:0:7104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3057 00000100:00100000:3.0:1772305852.498745:0:7104:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b830b726 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+51:2215:x1858396225334464:12345-192.168.203.30@tcp:103:ldlm_bl_05.0 00010000:00010000:3.0:1772305852.498765:0:7104:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1772305852.498769:0:7104:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6e991 lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x85:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb6c expref: 51 pid: 55141 timeout: 1264 lvb_type: 0 00010000:00010000:3.0:1772305852.498777:0:7104:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6e991 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x85:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb6c expref: 51 pid: 55141 timeout: 1264 lvb_type: 0 00010000:00010000:3.0:1772305852.498787:0:7104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6e991 lrc: 0/0,0 mode: --/PR res: [0x200000408:0x85:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb6c expref: 51 pid: 55141 timeout: 1264 lvb_type: 0 00010000:00010000:3.0:1772305852.498795:0:7104:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x85:0x0].0x0 (00000000a6deaf5e) 00010000:00010000:3.0:1772305852.498798:0:7104:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: 0000000027bbef42/0xa5e9c8c58c6e9e5 lrc: 3/0,1 mode: --/CW res: [0x200000408:0x85:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.498804:0:7104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 0000000027bbef42/0xa5e9c8c58c6e9e5 lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x85:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.498809:0:7104:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000027bbef42/0xa5e9c8c58c6e9e5 lrc: 4/0,1 mode: CW/CW res: [0x200000408:0x85:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.498825:0:7104:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1772305852.498851:0:7104:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b830b726 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+50:2215:x1858396225334464:12345-192.168.203.30@tcp:103:ldlm_bl_05.0 Request processed in 102us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305852.498866:0:7104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3057 00000100:00100000:1.0:1772305852.499935:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305852.501220:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00010000:2.0:1772305852.502310:0:2977:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f90c3eda/0xa5e9c8c58c6ea01 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x320:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305852.502318:0:2977:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f90c3eda/0xa5e9c8c58c6ea01 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x320:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305852.502323:0:2977:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f90c3eda/0xa5e9c8c58c6ea01 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x320:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305852.502334:0:2977:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f90c3eda already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305852.502336:0:2977:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f90c3eda/0xa5e9c8c58c6ea01 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x320:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305852.502340:0:2977:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f90c3eda/0xa5e9c8c58c6ea01 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x320:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305852.502347:0:2977:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x320:0x0].0x0 (00000000a16b93f9) 00010000:00010000:2.0:1772305852.502348:0:2977:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1772305852.502350:0:2977:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f90c3eda/0xa5e9c8c58c6ea01 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x320:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305852.502354:0:2977:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f90c3eda/0xa5e9c8c58c6ea01 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x320:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305852.502522:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305852.503617:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305852.503674:0:18149:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225334784 00000100:00100000:3.0:1772305852.503701:0:18149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5678 00000100:00100000:3.0:1772305852.503705:0:18149:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000695a247a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+222:2216:x1858396225334784:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1772305852.503955:0:18149:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000695a247a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+223:2216:x1858396225334784:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 Request processed in 249us (339us total) trans 4294968271 rc 0/0 00000100:00100000:3.0:1772305852.503967:0:18149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5678 00000100:00100000:1.0:1772305852.504671:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305852.505708:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305852.506971:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305852.507021:0:18149:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225335040 00000100:00100000:3.0:1772305852.507057:0:18149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5679 00000100:00100000:3.0:1772305852.507063:0:18149:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006e7b3ee8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+223:2217:x1858396225335040:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1772305852.507072:0:18149:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305852.507084:0:18149:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6ea1d lrc: 2/0,0 mode: --/PR res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196eb96 expref: -99 pid: 18149 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1772305852.507100:0:18149:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x1ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x69a33dbc, blocks: 0x1 00010000:00010000:3.0:1772305852.507112:0:18149:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1772305852.507114:0:18149:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1772305852.507120:0:18149:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6ea1d lrc: 3/0,0 mode: PR/PR res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb96 expref: 224 pid: 18149 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1772305852.507131:0:18149:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6ea1d lrc: 3/0,0 mode: PR/PR res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb96 expref: 224 pid: 18149 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1772305852.507140:0:18149:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000cace9935, rc 0) 00000100:00100000:3.0:1772305852.507165:0:18149:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006e7b3ee8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+224:2217:x1858396225335040:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 102us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305852.507169:0:18149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5679 00000100:00100000:1.0:1772305852.508363:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305852.512576:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305852.512623:0:18149:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225335232 00000100:00100000:3.0:1772305852.512701:0:18149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5680 00000100:00100000:3.0:1772305852.512705:0:18149:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a794f851 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+224:93780:x1858396225335232:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1772305852.512714:0:18149:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305852.512735:0:18149:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6ea24 lrc: 2/0,0 mode: --/PW res: [0x1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196eb9d expref: -99 pid: 18149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.512755:0:18149:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6ea1d lrc: 2/0,0 mode: PR/PR res: [0x1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb96 expref: 225 pid: 18149 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1772305852.512762:0:18149:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1772305852.512764:0:18149:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1772305852.512766:0:18149:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6ea24 lrc: 4/0,0 mode: --/PW res: [0x1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb9d expref: 225 pid: 18149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.512791:0:18149:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6ea1d lrc: 3/0,0 mode: PR/PR res: [0x1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb96 expref: 225 pid: 18149 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1772305852.512801:0:18149:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6ea1d lrc: 4/0,0 mode: PR/PR res: [0x1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb96 expref: 225 pid: 18149 timeout: 1264 lvb_type: 1 00000100:00100000:3.0:1772305852.512811:0:18149:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a7458d21 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:18149:1858396216593728:192.168.203.30@tcp:104: 00000100:00100000:3.0:1772305852.512861:0:18149:0:(client.c:2500:ptlrpc_set_wait()) set 00000000c1bc7b25 going to sleep for 6 seconds 00000100:00100000:3.0:1772305852.513895:0:18149:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a7458d21 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:18149:1858396216593728:192.168.203.30@tcp:104: 00010000:00010000:3.0:1772305852.513981:0:18149:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6ea24 lrc: 3/0,0 mode: --/PW res: [0x1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb9d expref: 225 pid: 18149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.513998:0:18149:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002f753c58, rc 0) 00000100:00100000:1.0:1772305852.514027:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305852.514038:0:18149:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a794f851 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+225:93780:x1858396225335232:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 1329us (1463us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305852.514047:0:18149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5680 00000100:00100000:2.0:1772305852.514107:0:7104:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225335296 00010000:00010000:2.0:1772305852.514130:0:7104:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6ea1d lrc: 4/0,0 mode: PR/PR res: [0x1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb96 expref: 225 pid: 18149 timeout: 1264 lvb_type: 1 00000100:00100000:2.0:1772305852.514165:0:7104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3058 00000100:00100000:2.0:1772305852.514172:0:7104:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000082992e06 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+225:2215:x1858396225335296:12345-192.168.203.30@tcp:103:ldlm_bl_06.0 00010000:00010000:2.0:1772305852.514183:0:7104:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1772305852.514201:0:7104:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6ea1d lrc: 4/0,0 mode: PR/PR res: [0x1ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb96 expref: 225 pid: 18149 timeout: 1264 lvb_type: 1 00010000:00010000:2.0:1772305852.514213:0:7104:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6ea1d lrc: 3/0,0 mode: PR/PR res: [0x1ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb96 expref: 225 pid: 18149 timeout: 1264 lvb_type: 1 00010000:00010000:2.0:1772305852.514245:0:7104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6ea1d lrc: 0/0,0 mode: --/PR res: [0x1ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb96 expref: 225 pid: 18149 timeout: 1264 lvb_type: 1 00010000:00010000:2.0:1772305852.514257:0:7104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1772305852.514259:0:7104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1772305852.514265:0:7104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6ea24 lrc: 2/0,0 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb9d expref: 224 pid: 18149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305852.514274:0:7104:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6ea24 lrc: 3/0,0 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb9d expref: 224 pid: 18149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305852.514299:0:7104:0:(ldlm_lockd.c:1069:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6ea24 lrc: 3/0,0 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb9d expref: 224 pid: 18149 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305852.514308:0:7104:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009ce141ff pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:7104:1858396216593792:192.168.203.30@tcp:105: 00000100:00100000:2.0:1772305852.514339:0:7104:0:(client.c:2500:ptlrpc_set_wait()) set 0000000059562925 going to sleep for 6 seconds 00000100:00100000:2.0:1772305852.515239:0:7104:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009ce141ff pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:7104:1858396216593792:192.168.203.30@tcp:105: 00010000:00010000:2.0:1772305852.515250:0:7104:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1772305852.515275:0:7104:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000082992e06 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+224:2215:x1858396225335296:12345-192.168.203.30@tcp:103:ldlm_bl_06.0 Request processed in 1104us (1250us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305852.515281:0:7104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3058 00000100:00100000:1.0:1772305852.527439:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305852.527513:0:21399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225335424 00002000:00100000:3.0:1772305852.527556:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (0->1048575) req@000000009d11ca87 x1858396225335424/t0(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:738/0 lens 488/0 e 0 to 0 dl 1772305858 ref 1 fl New:/0/ffffffff rc 0/-1 job:'lhsmtool_posix.0' 00002000:00100000:3.0:1772305852.527566:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 000000009d11ca87 with x1858396225335424 ext(0->1048575) 00002000:00010000:3.0:1772305852.527572:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000009d11ca87 00000100:00100000:3.0:1772305852.527598:0:21399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2009 00000100:00100000:3.0:1772305852.527604:0:21399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009d11ca87 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+224:2215:x1858396225335424:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1772305852.536306:0:21399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009d11ca87 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+226:2215:x1858396225335424:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 Request processed in 8696us (8870us total) trans 4294968272 rc 0/0 00000100:00100000:3.0:1772305852.536320:0:21399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2009 00002000:00100000:3.0:1772305852.536331:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (0->1048575) req@000000009d11ca87 x1858396225335424/t4294968272(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:738/0 lens 488/448 e 0 to 0 dl 1772305858 ref 1 fl Complete:/0/0 rc 0/0 job:'lhsmtool_posix.0' 00002000:00100000:3.0:1772305852.536339:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 000000009d11ca87 with x1858396225335424 ext(0->1048575) 00002000:00010000:3.0:1772305852.536344:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000009d11ca87 00000100:00100000:1.0:1772305852.807304:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305852.809596:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225335552 00000100:00100000:3.0:1772305852.809644:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 670 00000100:00100000:3.0:1772305852.809650:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d410c5a7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+51:93788:x1858396225335552:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1772305852.809658:0:55141:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305852.809671:0:55141:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6ea47 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ebab expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.809700:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000007e4c73f4/0xa5e9c8c58c6ea4e lrc: 3/1,0 mode: --/PR res: [0x200000408:0x85:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.809709:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007e4c73f4/0xa5e9c8c58c6ea4e lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x85:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.809726:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007e4c73f4/0xa5e9c8c58c6ea4e lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x85:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1772305852.809752:0:55141:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000408:0x85:0x0]: returning size 512 00000004:00200000:3.0:1772305852.809755:0:55141:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1772305852.809768:0:55141:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 000000007e4c73f4/0xa5e9c8c58c6ea4e lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x85:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.809792:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6ea47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ebab expref: 53 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.809806:0:55141:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000007e4c73f4/0xa5e9c8c58c6ea4e lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x85:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ebab expref: 52 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305852.809812:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x85:0x0].0x0 (00000000a6deaf5e) 00010000:00010000:3.0:1772305852.809816:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1772305852.809818:0:55141:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e4c73f4, rc 0) 00000100:00100000:3.0:1772305852.809858:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d410c5a7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+52:93788:x1858396225335552:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 207us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305852.809865:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 670 00000100:00100000:1.0:1772305852.811794:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305852.811828:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225335680 00000100:00100000:3.0:1772305852.811861:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 671 00000100:00100000:3.0:1772305852.811865:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000becfd887 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+52:93788:x1858396225335680:12345-192.168.203.30@tcp:58:lfs.0 00000040:00080000:3.0:1772305852.811968:0:55141:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305852.811972:0:55141:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305852.812007:0:55141:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 29 count 21 00000040:00080000:3.0:1772305852.812016:0:55141:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:3.0:1772305852.812182:0:55141:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xf:0x0].29, 136 off12136 00000100:00100000:3.0:1772305852.812246:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000becfd887 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+52:93788:x1858396225335680:12345-192.168.203.30@tcp:58:lfs.0 Request processed in 378us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305852.812255:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 671 00000040:00080000:1.0:1772305853.109956:0:65327:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305853.109962:0:65327:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305853.110028:0:65327:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 30 count 22 00000040:00080000:1.0:1772305853.110033:0:65327:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:1.0:1772305853.110057:0:65327:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305853.110059:0:65327:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305853.110119:0:65327:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 30 count 22 00000040:00080000:1.0:1772305853.110121:0:65327:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:1.0:1772305853.128795:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772305853.517282:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305853.517395:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225335744 00000100:00100000:3.0:1772305853.517447:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 672 00000100:00100000:3.0:1772305853.517457:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cb7be42b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+57:93799:x1858396225335744:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1772305853.517503:0:55141:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000408:0x87:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1772305853.517607:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cb7be42b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+57:93799:x1858396225335744:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 150us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305853.517614:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 672 00000100:00100000:1.0:1772305853.535213:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305853.535278:0:21399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225335872 00002000:00100000:3.0:1772305853.535328:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (1048576->2097151) req@00000000b2f6d910 x1858396225335872/t0(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:739/0 lens 488/0 e 0 to 0 dl 1772305859 ref 1 fl New:/0/ffffffff rc 0/-1 job:'lhsmtool_posix.0' 00002000:00100000:3.0:1772305853.535339:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 00000000b2f6d910 with x1858396225335872 ext(1048576->2097151) 00002000:00010000:3.0:1772305853.535344:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000b2f6d910 00000100:00100000:3.0:1772305853.535370:0:21399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2010 00000100:00100000:3.0:1772305853.535376:0:21399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b2f6d910 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+226:2216:x1858396225335872:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1772305853.540119:0:21399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b2f6d910 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+228:2216:x1858396225335872:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 Request processed in 4736us (4910us total) trans 4294968273 rc 0/0 00000100:00100000:3.0:1772305853.540132:0:21399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2010 00002000:00100000:3.0:1772305853.540144:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (1048576->2097151) req@00000000b2f6d910 x1858396225335872/t4294968273(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:739/0 lens 488/448 e 0 to 0 dl 1772305859 ref 1 fl Complete:/0/0 rc 0/0 job:'lhsmtool_posix.0' 00002000:00100000:3.0:1772305853.540152:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 00000000b2f6d910 with x1858396225335872 ext(1048576->2097151) 00002000:00010000:3.0:1772305853.540163:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000b2f6d910 00010000:00010000:2.0:1772305854.152761:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1772305854.430821:0:65381:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305854.430831:0:65381:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305854.430979:0:65381:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 30 count 22 00000040:00080000:1.0:1772305854.430987:0:65381:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:1.0:1772305854.431094:0:65381:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305854.431098:0:65381:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305854.431211:0:65381:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 30 count 22 00000040:00080000:1.0:1772305854.431218:0:65381:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000001:00080000:2.0:1772305854.436405:0:7114:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-OST0001: transno 4294968341 is committed 00000001:00080000:3.0:1772305854.450830:0:54724:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934808 is committed 00000004:00080000:3.0:1772305854.450837:0:54724:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:3.0:1772305854.450887:0:54724:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 4295052953 batchid updated 00000001:00080000:3.0:1772305854.450908:0:54724:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934806 is committed 00000100:00100000:3.0:1772305854.451154:0:18149:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216593920 00000100:00100000:3.0:1772305854.451202:0:18149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5681 00000100:00100000:3.0:1772305854.451209:0:18149:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a3ed84e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216593920:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1772305854.451464:0:18149:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x1ab:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:3.0:1772305854.451468:0:18149:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x1ab:0x0] updating lvb mtime from disk: 0 -> 1772305853 00002000:00010000:3.0:1772305854.451469:0:18149:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x1ab:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1772305854.451472:0:18149:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x1ab:0x0] updating lvb ctime from disk: 1772305852 -> 1772305853 00002000:00010000:3.0:1772305854.451473:0:18149:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x1ab:0x0] updating lvb blocks from disk: 1 -> 4103 00000100:00100000:3.0:1772305854.451518:0:18149:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a3ed84e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:2994:x1858396216593920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 309us (412us total) trans 4294968274 rc 0/0 00000100:00100000:3.0:1772305854.451529:0:18149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5681 00000100:00100000:1.0:1772305854.542560:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305854.542659:0:21399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225336000 00002000:00100000:3.0:1772305854.542714:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (2097152->3145727) req@0000000073ba934d x1858396225336000/t0(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:740/0 lens 488/0 e 0 to 0 dl 1772305860 ref 1 fl New:/0/ffffffff rc 0/-1 job:'lhsmtool_posix.0' 00002000:00100000:3.0:1772305854.542734:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 0000000073ba934d with x1858396225336000 ext(2097152->3145727) 00002000:00010000:3.0:1772305854.542739:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000073ba934d 00000100:00100000:3.0:1772305854.542762:0:21399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2011 00000100:00100000:3.0:1772305854.542767:0:21399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000073ba934d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+223:2216:x1858396225336000:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1772305854.547411:0:21399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000073ba934d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+225:2216:x1858396225336000:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 Request processed in 4640us (4858us total) trans 4294968275 rc 0/0 00000100:00100000:3.0:1772305854.547421:0:21399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2011 00002000:00100000:3.0:1772305854.547435:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (2097152->3145727) req@0000000073ba934d x1858396225336000/t4294968275(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:740/0 lens 488/448 e 0 to 0 dl 1772305860 ref 1 fl Complete:/0/0 rc 0/0 job:'lhsmtool_posix.0' 00002000:00100000:3.0:1772305854.547442:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 0000000073ba934d with x1858396225336000 ext(2097152->3145727) 00002000:00010000:3.0:1772305854.547446:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000073ba934d 00000040:00080000:2.0:1772305854.761816:0:65433:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305854.761821:0:65433:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305854.761932:0:65433:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 30 count 22 00000040:00080000:2.0:1772305854.761952:0:65433:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:2.0:1772305854.761992:0:65433:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305854.761994:0:65433:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305854.762081:0:65433:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 30 count 22 00000040:00080000:2.0:1772305854.762084:0:65433:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:2.0:1772305854.920841:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000df58eb45 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216593984:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1772305854.920935:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772305854.920975:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000075ede1e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216594048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1772305854.921004:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305854.921074:0:6309:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 430 00000100:00100000:3.0:1772305854.921082:0:6309:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c51b6958 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:2991:x1858396216594048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1772305854.921096:0:6309:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 743112704 pending 1703936 free 3827302400 avail 3825205248 00000100:00100000:3.0:1772305854.921145:0:6309:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c51b6958 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:2991:x1858396216594048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305854.921155:0:6309:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 430 00000100:00100000:2.0:1772305854.921187:0:2991:0:(client.c:2868:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968341 gen 2 00000004:00080000:2.0:1772305854.921192:0:2991:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 000000009b3b63a3, transno 4294968341 00000100:00100000:2.0:1772305854.921209:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000df58eb45 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216593984:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1772305854.921222:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000075ede1e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216594048:0@lo:13:osp-pre-0-0.0 00000040:00100000:3.0:1772305854.921232:0:54721:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 8 in log [0xd:0x1:0x0] 00010000:00010000:3.0:1772305855.176880:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1772305855.432839:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000731263eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:70aae467-c860-409f-ba1b-742f4d042da6:2992:1858396216594112:0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772305855.432849:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ea1c5fa0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:2993:1858396216594176:0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772305855.432886:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fb0c289e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:2994:1858396216594240:0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772305855.432955:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305855.432960:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772305855.433000:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216594176 00000100:00100000:1.0:1772305855.433011:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f5fe1428 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:2993:1858396216594432:0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772305855.433014:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d22b18dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216594368:0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772305855.433045:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305855.433062:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772305855.433065:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216594432 00000100:00100000:1.0:1772305855.433092:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216594112 00000100:00100000:2.0:1772305855.433101:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1772305855.433113:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006ade2649 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:2993:x1858396216594176:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772305855.433139:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1772305855.433145:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1772305855.433149:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000075ede1e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:2993:x1858396216594432:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772305855.433154:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f0e21dd3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2992:x1858396216594112:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772305855.433200:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006ade2649 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:2993:x1858396216594176:12345-0@lo:400:kworker/u8:4.0 Request processed in 88us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305855.433218:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000075ede1e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:2993:x1858396216594432:12345-0@lo:400:kworker/u8:4.0 Request processed in 62us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305855.433222:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f0e21dd3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2992:x1858396216594112:12345-0@lo:400:kworker/u8:4.0 Request processed in 64us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305855.433223:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1772305855.433236:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1772305855.433237:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1772305855.433312:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f5fe1428 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:2993:1858396216594432:0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772305855.433320:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d22b18dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216594368:0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772305855.433330:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305855.433333:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ea1c5fa0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:2993:1858396216594176:0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772305855.433339:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000731263eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:70aae467-c860-409f-ba1b-742f4d042da6:2992:1858396216594112:0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772305855.433379:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216594240 00000100:00100000:3.0:1772305855.433413:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1772305855.433418:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a7458d21 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:2994:x1858396216594240:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772305855.433473:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a7458d21 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:2994:x1858396216594240:12345-0@lo:400:kworker/u8:4.0 Request processed in 54us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305855.433482:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1772305855.433503:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fb0c289e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:2994:1858396216594240:0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772305855.551081:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305855.551135:0:21399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225336128 00002000:00100000:3.0:1772305855.551175:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (3145728->4194303) req@0000000015b8917a x1858396225336128/t0(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:741/0 lens 488/0 e 0 to 0 dl 1772305861 ref 1 fl New:/0/ffffffff rc 0/-1 job:'lhsmtool_posix.0' 00002000:00100000:3.0:1772305855.551184:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 0000000015b8917a with x1858396225336128 ext(3145728->4194303) 00002000:00010000:3.0:1772305855.551188:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000015b8917a 00000100:00100000:3.0:1772305855.551213:0:21399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2012 00000100:00100000:3.0:1772305855.551217:0:21399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000015b8917a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+225:2216:x1858396225336128:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1772305855.556350:0:21399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000015b8917a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2216:x1858396225336128:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 Request processed in 5123us (5267us total) trans 4294968276 rc 0/0 00000100:00100000:3.0:1772305855.556366:0:21399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2012 00002000:00100000:3.0:1772305855.556377:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (3145728->4194303) req@0000000015b8917a x1858396225336128/t4294968276(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:741/0 lens 488/448 e 0 to 0 dl 1772305861 ref 1 fl Complete:/0/0 rc 0/0 job:'lhsmtool_posix.0' 00002000:00100000:3.0:1772305855.556386:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 0000000015b8917a with x1858396225336128 ext(3145728->4194303) 00002000:00010000:3.0:1772305855.556391:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000015b8917a 00010000:00010000:3.0:1772305856.200765:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772305856.558584:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305856.558674:0:21399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225336256 00002000:00100000:3.0:1772305856.558731:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (4194304->5242879) req@0000000064c96d83 x1858396225336256/t0(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:742/0 lens 488/0 e 0 to 0 dl 1772305862 ref 1 fl New:/0/ffffffff rc 0/-1 job:'lhsmtool_posix.0' 00002000:00100000:3.0:1772305856.558742:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 0000000064c96d83 with x1858396225336256 ext(4194304->5242879) 00002000:00010000:3.0:1772305856.558748:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000064c96d83 00000100:00100000:3.0:1772305856.558785:0:21399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2013 00000100:00100000:3.0:1772305856.558813:0:21399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000064c96d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2216:x1858396225336256:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1772305856.563013:0:21399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000064c96d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+229:2216:x1858396225336256:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 Request processed in 4197us (4430us total) trans 4294968277 rc 0/0 00000100:00100000:3.0:1772305856.563029:0:21399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2013 00002000:00100000:3.0:1772305856.563043:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (4194304->5242879) req@0000000064c96d83 x1858396225336256/t4294968277(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:742/0 lens 488/448 e 0 to 0 dl 1772305862 ref 1 fl Complete:/0/0 rc 0/0 job:'lhsmtool_posix.0' 00002000:00100000:3.0:1772305856.563054:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 0000000064c96d83 with x1858396225336256 ext(4194304->5242879) 00002000:00010000:3.0:1772305856.563060:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000064c96d83 00000040:00080000:2.0:1772305857.344030:0:65535:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305857.344034:0:65535:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305857.344095:0:65535:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 30 count 18 00000040:00080000:2.0:1772305857.344099:0:65535:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:1.0:1772305857.566686:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305857.566739:0:21399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225336384 00002000:00100000:3.0:1772305857.566778:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (5242880->6291455) req@00000000b3f36abe x1858396225336384/t0(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:743/0 lens 488/0 e 0 to 0 dl 1772305863 ref 1 fl New:/0/ffffffff rc 0/-1 job:'lhsmtool_posix.0' 00002000:00100000:3.0:1772305857.566786:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 00000000b3f36abe with x1858396225336384 ext(5242880->6291455) 00002000:00010000:3.0:1772305857.566790:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000b3f36abe 00000100:00100000:3.0:1772305857.566813:0:21399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2014 00000100:00100000:3.0:1772305857.566818:0:21399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b3f36abe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+229:2216:x1858396225336384:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1772305857.570777:0:21399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b3f36abe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+231:2216:x1858396225336384:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 Request processed in 3955us (4095us total) trans 4294968278 rc 0/0 00000100:00100000:3.0:1772305857.570786:0:21399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2014 00002000:00100000:3.0:1772305857.570794:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (5242880->6291455) req@00000000b3f36abe x1858396225336384/t4294968278(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:743/0 lens 488/448 e 0 to 0 dl 1772305863 ref 1 fl Complete:/0/0 rc 0/0 job:'lhsmtool_posix.0' 00002000:00100000:3.0:1772305857.570801:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 00000000b3f36abe with x1858396225336384 ext(5242880->6291455) 00002000:00010000:3.0:1772305857.570805:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000b3f36abe 00000100:00100000:1.0:1772305857.603793:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305857.603826:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305857.603856:0:54689:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225336448 00000100:00100000:1.0:1772305857.603871:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305857.603901:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305857.603933:0:54689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 120 00000100:00100000:1.0:1772305857.603938:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305857.603940:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225336576 00000100:00100000:3.0:1772305857.603944:0:54689:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000c8fddbb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2217:x1858396225336448:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1772305857.603978:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305857.603995:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225336704 00000100:00100000:3.0:1772305857.604006:0:54689:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000c8fddbb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2217:x1858396225336448:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 65us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305857.604014:0:54689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 120 00000100:00100000:2.0:1772305857.604032:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225336768 00000100:00100000:2.0:1772305857.604060:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1128 00000100:00100000:2.0:1772305857.604066:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000242e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2217:x1858396225336576:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1772305857.604079:0:48470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1129 00000100:00100000:3.0:1772305857.604091:0:48470:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fd6a7d40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f935b4d0-e17f-49c8-8011-4be99ba75430+160:2217:x1858396225336704:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1772305857.604102:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000242e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2217:x1858396225336576:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 34us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305857.604112:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1128 00000100:00100000:3.0:1772305857.604122:0:48470:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fd6a7d40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f935b4d0-e17f-49c8-8011-4be99ba75430+160:2217:x1858396225336704:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 34us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305857.604131:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1130 00000100:00100000:2.0:1772305857.604136:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000084abacb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+140:2218:x1858396225336768:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1772305857.604168:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000084abacb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+140:2218:x1858396225336768:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 27us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305857.604178:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1130 00000100:00100000:3.0:1772305857.604200:0:48470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1129 00010000:00010000:2.0:1772305858.248735:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772305858.574803:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305858.574880:0:21399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225336896 00002000:00100000:2.0:1772305858.574925:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (6291456->7340031) req@00000000e5b23836 x1858396225336896/t0(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:744/0 lens 488/0 e 0 to 0 dl 1772305864 ref 1 fl New:/0/ffffffff rc 0/-1 job:'lhsmtool_posix.0' 00002000:00100000:2.0:1772305858.574937:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 00000000e5b23836 with x1858396225336896 ext(6291456->7340031) 00002000:00010000:2.0:1772305858.574942:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000e5b23836 00000100:00100000:2.0:1772305858.574974:0:21399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2015 00000100:00100000:2.0:1772305858.574982:0:21399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e5b23836 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+231:2216:x1858396225336896:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1772305858.579392:0:21399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e5b23836 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+233:2216:x1858396225336896:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 Request processed in 4405us (4590us total) trans 4294968279 rc 0/0 00000100:00100000:2.0:1772305858.579408:0:21399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2015 00002000:00100000:2.0:1772305858.579420:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (6291456->7340031) req@00000000e5b23836 x1858396225336896/t4294968279(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:744/0 lens 488/448 e 0 to 0 dl 1772305864 ref 1 fl Complete:/0/0 rc 0/0 job:'lhsmtool_posix.0' 00002000:00100000:2.0:1772305858.579432:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 00000000e5b23836 with x1858396225336896 ext(6291456->7340031) 00002000:00010000:2.0:1772305858.579437:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000e5b23836 00000040:00080000:2.0:1772305858.625489:0:65586:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305858.625495:0:65586:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305858.625599:0:65586:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 30 count 18 00000040:00080000:2.0:1772305858.625607:0:65586:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772305859.272823:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1772305859.543517:0:6332:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-OST0000: transno 4294968279 is committed 00000001:00080000:1.0:1772305859.543553:0:6332:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-OST0000: transno 4294968274 is committed 00000100:00100000:1.0:1772305859.582471:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305859.582543:0:21399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225337024 00002000:00100000:2.0:1772305859.582583:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (7340032->8388607) req@00000000df3cbb78 x1858396225337024/t0(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:745/0 lens 488/0 e 0 to 0 dl 1772305865 ref 1 fl New:/0/ffffffff rc 0/-1 job:'lhsmtool_posix.0' 00002000:00100000:2.0:1772305859.582592:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 00000000df3cbb78 with x1858396225337024 ext(7340032->8388607) 00002000:00010000:2.0:1772305859.582596:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000df3cbb78 00000100:00100000:2.0:1772305859.582622:0:21399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2016 00000100:00100000:2.0:1772305859.582659:0:21399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000df3cbb78 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+223:2216:x1858396225337024:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1772305859.586547:0:21399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000df3cbb78 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+225:2216:x1858396225337024:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 Request processed in 3886us (4081us total) trans 4294968280 rc 0/0 00000100:00100000:2.0:1772305859.586556:0:21399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2016 00002000:00100000:2.0:1772305859.586564:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (7340032->8388607) req@00000000df3cbb78 x1858396225337024/t4294968280(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:745/0 lens 488/448 e 0 to 0 dl 1772305865 ref 1 fl Complete:/0/0 rc 0/0 job:'lhsmtool_posix.0' 00002000:00100000:2.0:1772305859.586574:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 00000000df3cbb78 with x1858396225337024 ext(7340032->8388607) 00002000:00010000:2.0:1772305859.586586:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000df3cbb78 00000040:00080000:2.0:1772305859.912993:0:65641:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305859.912997:0:65641:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305859.913061:0:65641:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 30 count 18 00000040:00080000:2.0:1772305859.913065:0:65641:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:1.0:1772305860.040785:0:2993:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1772305860.040808:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000f0734f2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216594496:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1772305860.040898:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772305860.040961:0:6310:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216594496 00000100:00100000:2.0:1772305860.041010:0:6310:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216594560 00000100:00100000:3.0:1772305860.041022:0:6309:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00000100:00100000:3.0:1772305860.041031:0:6309:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000042087043 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216594496:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1772305860.041052:0:7591:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 432 00002000:00000024:3.0:1772305860.041057:0:6309:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 742981632 pending 1703936 free 3827302400 avail 3819962368 00000100:00100000:1.0:1772305860.041060:0:7591:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c7eaf1a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216594560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1772305860.041092:0:7591:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 693436416 pending 0 free 3606052864 avail 3603955712 00000100:00100000:3.0:1772305860.041116:0:6309:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000042087043 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216594496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305860.041126:0:6309:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00000100:00100000:1.0:1772305860.041156:0:7591:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c7eaf1a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216594560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305860.041168:0:7591:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 432 00000040:00100000:3.0:1772305860.041193:0:54719:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 7 in log [0xb:0x1:0x0] 00000100:00100000:2.0:1772305860.041210:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008df3460f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216594560:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1772305860.296770:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1772305860.552809:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006fedd554 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:70aae467-c860-409f-ba1b-742f4d042da6:2992:1858396216594624:0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772305860.552854:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004668f3b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:2994:1858396216594752:0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772305860.552902:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305860.552903:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000004473942 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216594816:0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772305860.552928:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305860.552963:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216594624 00000100:00100000:2.0:1772305860.552964:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000019df2d37 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216594880:0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772305860.552977:0:6308:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216594816 00000100:00100000:1.0:1772305860.553013:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1772305860.553018:0:6308:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1131 00000100:00100000:2.0:1772305860.553021:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305860.553024:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008321c004 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2992:x1858396216594624:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772305860.553029:0:6308:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bb867392 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216594816:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772305860.553072:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216594944 00000100:00100000:1.0:1772305860.553085:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008321c004 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2992:x1858396216594624:12345-0@lo:400:kworker/u8:4.0 Request processed in 61us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305860.553093:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1772305860.553099:0:6308:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bb867392 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216594816:12345-0@lo:400:kworker/u8:4.0 Request processed in 71us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305860.553111:0:6308:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1131 00000100:00100000:2.0:1772305860.553122:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1772305860.553131:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000161e896c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:2993:x1858396216594944:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772305860.553139:0:6308:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216594880 00000100:00100000:1.0:1772305860.553145:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006fedd554 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:70aae467-c860-409f-ba1b-742f4d042da6:2992:1858396216594624:0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772305860.553172:0:6308:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1132 00000100:00100000:3.0:1772305860.553177:0:6308:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fb0c289e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216594880:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772305860.553194:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000161e896c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:2993:x1858396216594944:12345-0@lo:400:kworker/u8:4.0 Request processed in 62us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305860.553216:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1772305860.553225:0:6308:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fb0c289e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216594880:12345-0@lo:400:kworker/u8:4.0 Request processed in 45us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305860.553229:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000078a003f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:2993:1858396216594944:0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772305860.553234:0:6308:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1132 00000100:00100000:1.0:1772305860.553256:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f4a43964 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:2993:1858396216594688:0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772305860.553272:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305860.553283:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000004473942 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216594816:0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772305860.553315:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216594752 00000100:00100000:2.0:1772305860.553344:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1772305860.553349:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000731263eb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:2994:x1858396216594752:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772305860.553394:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000731263eb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:2994:x1858396216594752:12345-0@lo:400:kworker/u8:4.0 Request processed in 45us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305860.553399:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1772305860.553440:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004668f3b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:2994:1858396216594752:0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772305860.589887:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305860.589962:0:21399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225337152 00002000:00100000:2.0:1772305860.590015:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (8388608->9437183) req@00000000f4a43964 x1858396225337152/t0(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:746/0 lens 488/0 e 0 to 0 dl 1772305866 ref 1 fl New:/0/ffffffff rc 0/-1 job:'lhsmtool_posix.0' 00002000:00100000:2.0:1772305860.590025:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 00000000f4a43964 with x1858396225337152 ext(8388608->9437183) 00002000:00010000:2.0:1772305860.590029:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000f4a43964 00000100:00100000:2.0:1772305860.590054:0:21399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2017 00000100:00100000:2.0:1772305860.590059:0:21399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f4a43964 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+225:2216:x1858396225337152:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1772305860.593797:0:21399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f4a43964 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2216:x1858396225337152:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 Request processed in 3731us (3910us total) trans 4294968281 rc 0/0 00000100:00100000:2.0:1772305860.593813:0:21399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2017 00002000:00100000:2.0:1772305860.593839:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (8388608->9437183) req@00000000f4a43964 x1858396225337152/t4294968281(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:746/0 lens 488/448 e 0 to 0 dl 1772305866 ref 1 fl Complete:/0/0 rc 0/0 job:'lhsmtool_posix.0' 00002000:00100000:2.0:1772305860.593850:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 00000000f4a43964 with x1858396225337152 ext(8388608->9437183) 00002000:00010000:2.0:1772305860.593856:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000f4a43964 00000040:00080000:1.0:1772305861.197289:0:65692:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305861.197294:0:65692:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305861.197405:0:65692:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 30 count 18 00000040:00080000:1.0:1772305861.197412:0:65692:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:1.0:1772305861.596810:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305861.596905:0:21399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225337280 00002000:00100000:2.0:1772305861.596957:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (9437184->10485759) req@0000000078a003f5 x1858396225337280/t0(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:747/0 lens 488/0 e 0 to 0 dl 1772305867 ref 1 fl New:/0/ffffffff rc 0/-1 job:'lhsmtool_posix.0' 00002000:00100000:2.0:1772305861.596970:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 0000000078a003f5 with x1858396225337280 ext(9437184->10485759) 00002000:00010000:2.0:1772305861.596976:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000078a003f5 00000100:00100000:2.0:1772305861.597008:0:21399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2018 00000100:00100000:2.0:1772305861.597016:0:21399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000078a003f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2216:x1858396225337280:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1772305861.601206:0:21399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000078a003f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+229:2216:x1858396225337280:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 Request processed in 4186us (4400us total) trans 4294968282 rc 0/0 00000100:00100000:2.0:1772305861.601215:0:21399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2018 00002000:00100000:2.0:1772305861.601232:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (9437184->10485759) req@0000000078a003f5 x1858396225337280/t4294968282(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:747/0 lens 488/448 e 0 to 0 dl 1772305867 ref 1 fl Complete:/0/0 rc 0/0 job:'lhsmtool_posix.0' 00002000:00100000:2.0:1772305861.601239:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 0000000078a003f5 with x1858396225337280 ext(9437184->10485759) 00002000:00010000:2.0:1772305861.601243:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000078a003f5 00010000:00010000:2.0:1772305862.344695:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1772305862.475375:0:65744:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305862.475380:0:65744:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305862.475443:0:65744:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 30 count 18 00000040:00080000:1.0:1772305862.475447:0:65744:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:1.0:1772305862.604560:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305862.604611:0:21399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225337408 00002000:00100000:2.0:1772305862.604668:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (10485760->11534335) req@000000006fedd554 x1858396225337408/t0(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:748/0 lens 488/0 e 0 to 0 dl 1772305868 ref 1 fl New:/0/ffffffff rc 0/-1 job:'lhsmtool_posix.0' 00002000:00100000:2.0:1772305862.604677:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 000000006fedd554 with x1858396225337408 ext(10485760->11534335) 00002000:00010000:2.0:1772305862.604681:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000006fedd554 00000100:00100000:2.0:1772305862.604704:0:21399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2019 00000100:00100000:2.0:1772305862.604709:0:21399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006fedd554 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+229:2216:x1858396225337408:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1772305862.608447:0:21399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006fedd554 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+231:2216:x1858396225337408:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 Request processed in 3734us (3890us total) trans 4294968283 rc 0/0 00000100:00100000:2.0:1772305862.608459:0:21399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2019 00002000:00100000:2.0:1772305862.608468:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (10485760->11534335) req@000000006fedd554 x1858396225337408/t4294968283(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:748/0 lens 488/448 e 0 to 0 dl 1772305868 ref 1 fl Complete:/0/0 rc 0/0 job:'lhsmtool_posix.0' 00002000:00100000:2.0:1772305862.608475:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 000000006fedd554 with x1858396225337408 ext(10485760->11534335) 00002000:00010000:2.0:1772305862.608478:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000006fedd554 00000100:00100000:1.0:1772305862.723897:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305862.723932:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305862.723957:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305862.723961:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225337536 00000100:00100000:1.0:1772305862.724006:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305862.724021:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225337664 00000100:00100000:3.0:1772305862.724026:0:48470:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225337600 00000100:00100000:1.0:1772305862.724038:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305862.724058:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 101 00000100:00100000:3.0:1772305862.724067:0:48470:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225337728 00000100:00100000:2.0:1772305862.724072:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007eaa6db7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+53:2218:x1858396225337536:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1772305862.724075:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305862.724093:0:48470:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225337792 00000100:00100000:1.0:1772305862.724115:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 102 00000100:00100000:3.0:1772305862.724123:0:48470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1133 00000100:00100000:1.0:1772305862.724124:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004668f3b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+45:2218:x1858396225337664:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1772305862.724131:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007eaa6db7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+53:2218:x1858396225337536:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 60us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305862.724136:0:48470:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003a8b295f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2217:x1858396225337600:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1772305862.724160:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 101 00000100:00100000:1.0:1772305862.724164:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004668f3b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+45:2218:x1858396225337664:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 39us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305862.724171:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 102 00000100:00100000:3.0:1772305862.724177:0:48470:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003a8b295f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2217:x1858396225337600:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 44us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305862.724184:0:48470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1133 00000100:00100000:3.0:1772305862.724203:0:48470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1134 00000100:00100000:3.0:1772305862.724206:0:48470:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000019df2d37 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f935b4d0-e17f-49c8-8011-4be99ba75430+160:2217:x1858396225337728:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1772305862.724224:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1135 00000100:00100000:3.0:1772305862.724228:0:48470:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000019df2d37 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f935b4d0-e17f-49c8-8011-4be99ba75430+160:2217:x1858396225337728:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 18us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305862.724234:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000004473942 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+140:2218:x1858396225337792:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1772305862.724239:0:48470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1134 00000100:00100000:2.0:1772305862.724271:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000004473942 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+140:2218:x1858396225337792:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 38us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305862.724278:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1135 00010000:00010000:3.0:1772305863.368842:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772305863.613839:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305863.613903:0:21399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225337920 00002000:00100000:2.0:1772305863.613953:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (11534336->12582911) req@000000000f0734f2 x1858396225337920/t0(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:749/0 lens 488/0 e 0 to 0 dl 1772305869 ref 1 fl New:/0/ffffffff rc 0/-1 job:'lhsmtool_posix.0' 00002000:00100000:2.0:1772305863.613966:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 000000000f0734f2 with x1858396225337920 ext(11534336->12582911) 00002000:00010000:2.0:1772305863.613972:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000000f0734f2 00000100:00100000:2.0:1772305863.614007:0:21399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2020 00000100:00100000:2.0:1772305863.614017:0:21399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000f0734f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+231:2216:x1858396225337920:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1772305863.617672:0:21399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000f0734f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+233:2216:x1858396225337920:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 Request processed in 3652us (3834us total) trans 4294968284 rc 0/0 00000100:00100000:2.0:1772305863.617686:0:21399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2020 00002000:00100000:2.0:1772305863.617696:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (11534336->12582911) req@000000000f0734f2 x1858396225337920/t4294968284(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:749/0 lens 488/448 e 0 to 0 dl 1772305869 ref 1 fl Complete:/0/0 rc 0/0 job:'lhsmtool_posix.0' 00002000:00100000:2.0:1772305863.617704:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 000000000f0734f2 with x1858396225337920 ext(11534336->12582911) 00002000:00010000:2.0:1772305863.617708:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000000f0734f2 00000040:00080000:3.0:1772305863.768051:0:65795:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305863.768056:0:65795:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305863.768118:0:65795:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 30 count 18 00000040:00080000:3.0:1772305863.768122:0:65795:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772305864.392765:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772305864.621512:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305864.621582:0:21399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225338048 00002000:00100000:2.0:1772305864.621623:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (12582912->13631487) req@00000000f1c5c466 x1858396225338048/t0(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:750/0 lens 488/0 e 0 to 0 dl 1772305870 ref 1 fl New:/0/ffffffff rc 0/-1 job:'lhsmtool_posix.0' 00002000:00100000:2.0:1772305864.621666:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 00000000f1c5c466 with x1858396225338048 ext(12582912->13631487) 00002000:00010000:2.0:1772305864.621670:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000f1c5c466 00000100:00100000:2.0:1772305864.621702:0:21399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2021 00000100:00100000:2.0:1772305864.621707:0:21399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f1c5c466 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+233:2215:x1858396225338048:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1772305864.625964:0:21399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f1c5c466 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+235:2215:x1858396225338048:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 Request processed in 4252us (4455us total) trans 4294968285 rc 0/0 00000100:00100000:2.0:1772305864.625974:0:21399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2021 00002000:00100000:2.0:1772305864.625983:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (12582912->13631487) req@00000000f1c5c466 x1858396225338048/t4294968285(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:750/0 lens 488/448 e 0 to 0 dl 1772305870 ref 1 fl Complete:/0/0 rc 0/0 job:'lhsmtool_posix.0' 00002000:00100000:2.0:1772305864.625990:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 00000000f1c5c466 with x1858396225338048 ext(12582912->13631487) 00002000:00010000:2.0:1772305864.625994:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000f1c5c466 00000040:00080000:2.0:1772305865.056405:0:65849:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305865.056409:0:65849:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305865.056471:0:65849:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 30 count 18 00000040:00080000:2.0:1772305865.056476:0:65849:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:3.0:1772305865.160822:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005f1fba5b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216595008:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1772305865.160941:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772305865.160944:0:7591:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216595072 00000100:00100000:2.0:1772305865.160999:0:7591:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 433 00000100:00100000:2.0:1772305865.161004:0:7591:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000035a72dc1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216595072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1772305865.161024:0:7591:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 741146624 pending 0 free 3822059520 avail 3813670912 00000100:00100000:2.0:1772305865.161074:0:7591:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000035a72dc1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216595072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305865.161080:0:7591:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 433 00000100:00100000:3.0:1772305865.161108:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000046e97166 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216595072:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1772305865.161151:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005f1fba5b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216595008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1772305865.630067:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305865.630139:0:21399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225338176 00002000:00100000:2.0:1772305865.630184:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (13631488->14680063) req@0000000084f6bd0e x1858396225338176/t0(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:751/0 lens 488/0 e 0 to 0 dl 1772305871 ref 1 fl New:/0/ffffffff rc 0/-1 job:'lhsmtool_posix.0' 00002000:00100000:2.0:1772305865.630209:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 0000000084f6bd0e with x1858396225338176 ext(13631488->14680063) 00002000:00010000:2.0:1772305865.630214:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000084f6bd0e 00000100:00100000:2.0:1772305865.630245:0:21399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2022 00000100:00100000:2.0:1772305865.630253:0:21399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000084f6bd0e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+223:2216:x1858396225338176:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1772305865.634163:0:21399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000084f6bd0e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+225:2216:x1858396225338176:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 Request processed in 3907us (4098us total) trans 4294968286 rc 0/0 00000100:00100000:2.0:1772305865.634175:0:21399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2022 00002000:00100000:2.0:1772305865.634185:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (13631488->14680063) req@0000000084f6bd0e x1858396225338176/t4294968286(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:751/0 lens 488/448 e 0 to 0 dl 1772305871 ref 1 fl Complete:/0/0 rc 0/0 job:'lhsmtool_posix.0' 00002000:00100000:2.0:1772305865.634195:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 0000000084f6bd0e with x1858396225338176 ext(13631488->14680063) 00002000:00010000:2.0:1772305865.634200:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000084f6bd0e 00000100:00100000:3.0:1772305865.672774:0:2991:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1772305865.672805:0:2992:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1772305865.672811:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003dc81c52 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:70aae467-c860-409f-ba1b-742f4d042da6:2991:1858396216595136:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1772305865.672818:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000031fc75b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:2992:1858396216595328:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1772305865.672822:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000046e97166 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:2994:1858396216595264:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305865.672900:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772305865.672904:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305865.672950:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216595136 00000100:00100000:2.0:1772305865.672961:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305865.672988:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216595264 00000100:00100000:1.0:1772305865.673011:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1772305865.673022:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009179893b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2991:x1858396216595136:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305865.673034:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1772305865.673043:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e72c7c57 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:2994:x1858396216595264:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1772305865.673122:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009179893b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2991:x1858396216595136:12345-0@lo:400:kworker/u8:0.0 Request processed in 100us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305865.673128:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e72c7c57 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:2994:x1858396216595264:12345-0@lo:400:kworker/u8:0.0 Request processed in 83us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305865.673131:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000031fc75b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:2992:1858396216595328:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1772305865.673137:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1772305865.673148:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1772305865.673196:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003dc81c52 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:70aae467-c860-409f-ba1b-742f4d042da6:2991:1858396216595136:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305865.673206:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000046e97166 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:2994:1858396216595264:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1772305865.673210:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216595200 00000100:00100000:1.0:1772305865.673236:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1772305865.673241:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005d647dd1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:2993:x1858396216595200:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1772305865.673268:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005d647dd1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:2993:x1858396216595200:12345-0@lo:400:kworker/u8:0.0 Request processed in 28us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305865.673273:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000040:00080000:2.0:1772305865.800787:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305865.800807:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00100000:2.0:1772305865.800849:0:54732:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 13 in log [0xf:0x1:0x0] 00000040:00100000:2.0:1772305865.801011:0:54732:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 14 in log [0xf:0x1:0x0] 00000040:00100000:2.0:1772305865.801037:0:54732:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 15 in log [0xf:0x1:0x0] 00000040:00080000:2.0:1772305865.801066:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 30 count 15 00000040:00080000:2.0:1772305865.801082:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:1.0:1772305866.354316:0:65900:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305866.354321:0:65900:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305866.354378:0:65900:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 30 count 15 00000040:00080000:1.0:1772305866.354384:0:65900:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:2.0:1772305866.440724:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772305866.637951:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305866.638004:0:21399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225338304 00002000:00100000:2.0:1772305866.638045:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (14680064->15728639) req@0000000084d1cb3e x1858396225338304/t0(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:752/0 lens 488/0 e 0 to 0 dl 1772305872 ref 1 fl New:/0/ffffffff rc 0/-1 job:'lhsmtool_posix.0' 00002000:00100000:2.0:1772305866.638054:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 0000000084d1cb3e with x1858396225338304 ext(14680064->15728639) 00002000:00010000:2.0:1772305866.638057:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000084d1cb3e 00000100:00100000:2.0:1772305866.638081:0:21399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2023 00000100:00100000:2.0:1772305866.638087:0:21399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000084d1cb3e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+225:2216:x1858396225338304:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1772305866.641681:0:21399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000084d1cb3e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2216:x1858396225338304:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 Request processed in 3590us (3735us total) trans 4294968287 rc 0/0 00000100:00100000:2.0:1772305866.641693:0:21399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2023 00002000:00100000:2.0:1772305866.641703:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (14680064->15728639) req@0000000084d1cb3e x1858396225338304/t4294968287(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:752/0 lens 488/448 e 0 to 0 dl 1772305872 ref 1 fl Complete:/0/0 rc 0/0 job:'lhsmtool_posix.0' 00002000:00100000:2.0:1772305866.641713:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 0000000084d1cb3e with x1858396225338304 ext(14680064->15728639) 00002000:00010000:2.0:1772305866.641718:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000084d1cb3e 00000100:00100000:2.0:1772305867.648189:0:21399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225338432 00002000:00100000:2.0:1772305867.648240:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (15728640->16777215) req@00000000aefd5242 x1858396225338432/t0(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:753/0 lens 488/0 e 0 to 0 dl 1772305873 ref 1 fl New:/0/ffffffff rc 0/-1 job:'lhsmtool_posix.0' 00002000:00100000:2.0:1772305867.648253:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 00000000aefd5242 with x1858396225338432 ext(15728640->16777215) 00002000:00010000:2.0:1772305867.648259:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000aefd5242 00000100:00100000:2.0:1772305867.648292:0:21399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2024 00000100:00100000:2.0:1772305867.648301:0:21399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000aefd5242 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2216:x1858396225338432:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 00000040:00080000:1.0:1772305867.648396:0:65951:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305867.648400:0:65951:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305867.648461:0:65951:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 30 count 15 00000040:00080000:1.0:1772305867.648465:0:65951:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:2.0:1772305867.652584:0:21399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000aefd5242 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+229:2216:x1858396225338432:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 Request processed in 4280us (4457us total) trans 4294968288 rc 0/0 00000100:00100000:2.0:1772305867.652600:0:21399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2024 00002000:00100000:2.0:1772305867.652609:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (15728640->16777215) req@00000000aefd5242 x1858396225338432/t4294968288(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:753/0 lens 488/448 e 0 to 0 dl 1772305873 ref 1 fl Complete:/0/0 rc 0/0 job:'lhsmtool_posix.0' 00002000:00100000:2.0:1772305867.652616:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 00000000aefd5242 with x1858396225338432 ext(15728640->16777215) 00002000:00010000:2.0:1772305867.652621:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000aefd5242 00000100:00100000:3.0:1772305867.843942:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225338560 00000100:00100000:2.0:1772305867.843969:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225338624 00000100:00100000:1.0:1772305867.843986:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225338496 00000100:00100000:3.0:1772305867.844004:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225338688 00000100:00100000:2.0:1772305867.844018:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225338816 00000100:00100000:1.0:1772305867.844029:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 124 00000100:00100000:1.0:1772305867.844037:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000056897bb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2216:x1858396225338496:12345-192.168.203.30@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1772305867.844046:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 106 00000100:00100000:3.0:1772305867.844057:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ba314d1a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+53:2215:x1858396225338560:12345-192.168.203.30@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1772305867.844063:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1137 00000100:00100000:2.0:1772305867.844073:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000339dc28b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+160:2216:x1858396225338752:12345-192.168.203.30@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1772305867.844102:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000056897bb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2216:x1858396225338496:12345-192.168.203.30@tcp:400:kworker/u8:1.0 Request processed in 63us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305867.844103:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ba314d1a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+53:2215:x1858396225338560:12345-192.168.203.30@tcp:400:kworker/u8:1.0 Request processed in 48us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305867.844120:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 124 00000100:00100000:3.0:1772305867.844125:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 106 00000100:00100000:2.0:1772305867.844125:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000339dc28b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+160:2216:x1858396225338752:12345-192.168.203.30@tcp:400:kworker/u8:1.0 Request processed in 47us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305867.844148:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1137 00000100:00100000:3.0:1772305867.844166:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 107 00000100:00100000:3.0:1772305867.844180:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000815b9e7f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+45:2215:x1858396225338688:12345-192.168.203.30@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1772305867.844224:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000815b9e7f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+45:2215:x1858396225338688:12345-192.168.203.30@tcp:400:kworker/u8:1.0 Request processed in 49us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305867.844241:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 107 00010000:00010000:3.0:1772305868.488852:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1772305868.655813:0:21399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225338944 00002000:00100000:2.0:1772305868.655861:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (16777216->17825791) req@00000000f2dac737 x1858396225338944/t0(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:754/0 lens 488/0 e 0 to 0 dl 1772305874 ref 1 fl New:/0/ffffffff rc 0/-1 job:'lhsmtool_posix.0' 00002000:00100000:2.0:1772305868.655873:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 00000000f2dac737 with x1858396225338944 ext(16777216->17825791) 00002000:00010000:2.0:1772305868.655878:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000f2dac737 00000100:00100000:2.0:1772305868.655904:0:21399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2025 00000100:00100000:2.0:1772305868.655910:0:21399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f2dac737 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+229:2216:x1858396225338944:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1772305868.660019:0:21399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f2dac737 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+231:2216:x1858396225338944:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 Request processed in 4105us (4299us total) trans 4294968289 rc 0/0 00000100:00100000:2.0:1772305868.660029:0:21399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2025 00002000:00100000:2.0:1772305868.660037:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (16777216->17825791) req@00000000f2dac737 x1858396225338944/t4294968289(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:754/0 lens 488/448 e 0 to 0 dl 1772305874 ref 1 fl Complete:/0/0 rc 0/0 job:'lhsmtool_posix.0' 00002000:00100000:2.0:1772305868.660050:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 00000000f2dac737 with x1858396225338944 ext(16777216->17825791) 00002000:00010000:2.0:1772305868.660054:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000f2dac737 00000040:00080000:3.0:1772305868.954121:0:66003:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305868.954126:0:66003:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305868.954187:0:66003:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 30 count 15 00000040:00080000:3.0:1772305868.954191:0:66003:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:1.0:1772305869.665356:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305869.665426:0:21399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225339072 00002000:00100000:2.0:1772305869.665469:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (17825792->18874367) req@0000000031fc75b8 x1858396225339072/t0(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:0/0 lens 488/0 e 0 to 0 dl 1772305875 ref 1 fl New:/0/ffffffff rc 0/-1 job:'lhsmtool_posix.0' 00002000:00100000:2.0:1772305869.665478:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 0000000031fc75b8 with x1858396225339072 ext(17825792->18874367) 00002000:00010000:2.0:1772305869.665482:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000031fc75b8 00000100:00100000:2.0:1772305869.665505:0:21399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2026 00000100:00100000:2.0:1772305869.665510:0:21399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000031fc75b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+231:2216:x1858396225339072:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1772305869.670668:0:21399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000031fc75b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+233:2216:x1858396225339072:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 Request processed in 5115us (5279us total) trans 4294968290 rc 0/0 00000100:00100000:2.0:1772305869.670687:0:21399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2026 00002000:00100000:2.0:1772305869.670700:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (17825792->18874367) req@0000000031fc75b8 x1858396225339072/t4294968290(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:0/0 lens 488/448 e 0 to 0 dl 1772305875 ref 1 fl Complete:/0/0 rc 0/0 job:'lhsmtool_posix.0' 00002000:00100000:2.0:1772305869.670711:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 0000000031fc75b8 with x1858396225339072 ext(17825792->18874367) 00002000:00010000:2.0:1772305869.670718:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000031fc75b8 00000001:00080000:1.0:1772305869.782692:0:6332:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-OST0000: transno 4294968290 is committed 00000040:00080000:3.0:1772305870.259432:0:66056:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305870.259437:0:66056:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305870.259537:0:66056:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 30 count 15 00000040:00080000:3.0:1772305870.259544:0:66056:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:2.0:1772305870.280746:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d2a6474b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216595392:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1772305870.280829:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772305870.281024:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d2a6474b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216595392:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1772305870.281726:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000031e649b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216595456:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1772305870.281752:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305870.281948:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000031e649b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216595456:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1772305870.536783:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1772305870.672039:0:21399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225339200 00002000:00100000:2.0:1772305870.672085:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (18874368->19922943) req@0000000062e7df48 x1858396225339200/t0(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:1/0 lens 488/0 e 0 to 0 dl 1772305876 ref 1 fl New:/0/ffffffff rc 0/-1 job:'lhsmtool_posix.0' 00002000:00100000:2.0:1772305870.672097:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 0000000062e7df48 with x1858396225339200 ext(18874368->19922943) 00002000:00010000:2.0:1772305870.672102:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000062e7df48 00000100:00100000:2.0:1772305870.672133:0:21399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2027 00000100:00100000:2.0:1772305870.672141:0:21399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000062e7df48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+223:2216:x1858396225339200:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1772305870.676482:0:21399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000062e7df48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+225:2216:x1858396225339200:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 Request processed in 4337us (4524us total) trans 4294968291 rc 0/0 00000100:00100000:2.0:1772305870.676494:0:21399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2027 00002000:00100000:2.0:1772305870.676504:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (18874368->19922943) req@0000000062e7df48 x1858396225339200/t4294968291(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:1/0 lens 488/448 e 0 to 0 dl 1772305876 ref 1 fl Complete:/0/0 rc 0/0 job:'lhsmtool_posix.0' 00002000:00100000:2.0:1772305870.676515:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 0000000062e7df48 with x1858396225339200 ext(18874368->19922943) 00002000:00010000:2.0:1772305870.676520:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000062e7df48 00000100:00100000:3.0:1772305870.792834:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000093b46947 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:70aae467-c860-409f-ba1b-742f4d042da6:2994:1858396216595520:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1772305870.792861:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f635dbf9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2991:1858396216595584:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1772305870.792869:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d90d4880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:2993:1858396216595712:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305870.792923:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305870.792928:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772305870.792972:0:54689:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216595520 00000100:00100000:3.0:1772305870.792983:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772305870.793029:0:54689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1772305870.793029:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1772305870.793037:0:54689:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000060da9027 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70aae467-c860-409f-ba1b-742f4d042da6+18:2994:x1858396216595520:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1772305870.793037:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000034cdda9e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:2991:x1858396216595584:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1772305870.793091:0:54689:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000060da9027 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70aae467-c860-409f-ba1b-742f4d042da6+18:2994:x1858396216595520:12345-0@lo:400:kworker/u8:0.0 Request processed in 55us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305870.793092:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000034cdda9e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:2991:x1858396216595584:12345-0@lo:400:kworker/u8:0.0 Request processed in 52us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305870.793101:0:54689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1772305870.793101:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1772305870.793111:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000093b46947 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:70aae467-c860-409f-ba1b-742f4d042da6:2994:1858396216595520:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1772305870.793138:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305870.793152:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b896dfee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2992:1858396216595648:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1772305870.793179:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1772305870.793187:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000269f4b78 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:2993:x1858396216595712:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1772305870.793196:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f635dbf9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2991:1858396216595584:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1772305870.793228:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000269f4b78 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:2993:x1858396216595712:12345-0@lo:400:kworker/u8:0.0 Request processed in 42us (93us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305870.793242:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000040:00080000:1.0:1772305871.552614:0:66107:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305871.552618:0:66107:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305871.552699:0:66107:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 30 count 15 00000040:00080000:1.0:1772305871.552703:0:66107:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:3.0:1772305871.679299:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305871.679373:0:21399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225339328 00002000:00100000:2.0:1772305871.679416:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (19922944->20971519) req@000000009876c25d x1858396225339328/t0(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:2/0 lens 488/0 e 0 to 0 dl 1772305877 ref 1 fl New:/0/ffffffff rc 0/-1 job:'lhsmtool_posix.0' 00002000:00100000:2.0:1772305871.679429:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 000000009876c25d with x1858396225339328 ext(19922944->20971519) 00002000:00010000:2.0:1772305871.679433:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000009876c25d 00000100:00100000:2.0:1772305871.679461:0:21399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2028 00000100:00100000:2.0:1772305871.679468:0:21399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009876c25d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+225:2216:x1858396225339328:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1772305871.683291:0:21399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009876c25d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2216:x1858396225339328:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 Request processed in 3821us (3998us total) trans 4294968292 rc 0/0 00000100:00100000:2.0:1772305871.683302:0:21399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2028 00002000:00100000:2.0:1772305871.683311:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (19922944->20971519) req@000000009876c25d x1858396225339328/t4294968292(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:2/0 lens 488/448 e 0 to 0 dl 1772305877 ref 1 fl Complete:/0/0 rc 0/0 job:'lhsmtool_posix.0' 00002000:00100000:2.0:1772305871.683321:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 000000009876c25d with x1858396225339328 ext(19922944->20971519) 00002000:00010000:2.0:1772305871.683324:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000009876c25d 00010000:00010000:3.0:1772305872.584815:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772305872.686429:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305872.686494:0:21399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225339456 00002000:00100000:2.0:1772305872.686538:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (20971520->22020095) req@00000000f30bfbdf x1858396225339456/t0(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:3/0 lens 488/0 e 0 to 0 dl 1772305878 ref 1 fl New:/0/ffffffff rc 0/-1 job:'lhsmtool_posix.0' 00002000:00100000:2.0:1772305872.686552:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 00000000f30bfbdf with x1858396225339456 ext(20971520->22020095) 00002000:00010000:2.0:1772305872.686557:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000f30bfbdf 00000100:00100000:2.0:1772305872.686592:0:21399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2029 00000100:00100000:2.0:1772305872.686600:0:21399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f30bfbdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2216:x1858396225339456:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1772305872.690880:0:21399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f30bfbdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+229:2216:x1858396225339456:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 Request processed in 4276us (4449us total) trans 4294968293 rc 0/0 00000100:00100000:2.0:1772305872.690900:0:21399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2029 00002000:00100000:2.0:1772305872.690913:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (20971520->22020095) req@00000000f30bfbdf x1858396225339456/t4294968293(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:3/0 lens 488/448 e 0 to 0 dl 1772305878 ref 1 fl Complete:/0/0 rc 0/0 job:'lhsmtool_posix.0' 00002000:00100000:2.0:1772305872.690924:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 00000000f30bfbdf with x1858396225339456 ext(20971520->22020095) 00002000:00010000:2.0:1772305872.690930:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000f30bfbdf 00000100:00100000:2.0:1772305872.963715:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305872.963765:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305872.963784:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225339584 00000100:00100000:2.0:1772305872.963789:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305872.963828:0:54689:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225339520 00000100:00100000:2.0:1772305872.963834:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305872.963836:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225339712 00000100:00100000:3.0:1772305872.963882:0:54689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 126 00000100:00100000:2.0:1772305872.963886:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305872.963886:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 112 00000100:00100000:3.0:1772305872.963896:0:54689:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002a056c68 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2217:x1858396225339520:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:1.0:1772305872.963899:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000085acb02d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+45:2218:x1858396225339712:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1772305872.963928:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305872.963978:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000085acb02d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+45:2218:x1858396225339712:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 73us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305872.963979:0:54689:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002a056c68 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2217:x1858396225339520:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 80us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305872.963995:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 112 00000100:00100000:3.0:1772305872.964001:0:54689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 126 00000100:00100000:3.0:1772305872.964078:0:6308:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225339840 00000100:00100000:2.0:1772305872.964094:0:48470:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225339776 00000100:00100000:3.0:1772305872.964184:0:6308:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1140 00000100:00100000:2.0:1772305872.964193:0:48470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1141 00000100:00100000:3.0:1772305872.964195:0:6308:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d90d4880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+140:2218:x1858396225339840:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1772305872.964203:0:48470:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f635dbf9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f935b4d0-e17f-49c8-8011-4be99ba75430+160:2217:x1858396225339776:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1772305872.964239:0:6308:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d90d4880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+140:2218:x1858396225339840:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 47us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305872.964244:0:48470:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f635dbf9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f935b4d0-e17f-49c8-8011-4be99ba75430+160:2217:x1858396225339776:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 43us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305872.964251:0:6308:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1140 00000100:00100000:2.0:1772305872.964258:0:48470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1141 00000100:00100000:1.0:1772305873.695499:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305873.695562:0:21399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225339968 00002000:00100000:2.0:1772305873.695602:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (22020096->23068671) req@00000000933d69a5 x1858396225339968/t0(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:4/0 lens 488/0 e 0 to 0 dl 1772305879 ref 1 fl New:/0/ffffffff rc 0/-1 job:'lhsmtool_posix.0' 00002000:00100000:2.0:1772305873.695611:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 00000000933d69a5 with x1858396225339968 ext(22020096->23068671) 00002000:00010000:2.0:1772305873.695615:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000933d69a5 00000100:00100000:2.0:1772305873.695665:0:21399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2030 00000100:00100000:2.0:1772305873.695670:0:21399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000933d69a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+229:2216:x1858396225339968:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1772305873.699423:0:21399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000933d69a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+231:2216:x1858396225339968:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 Request processed in 3751us (3930us total) trans 4294968294 rc 0/0 00000100:00100000:2.0:1772305873.699430:0:21399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2030 00002000:00100000:2.0:1772305873.699439:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (22020096->23068671) req@00000000933d69a5 x1858396225339968/t4294968294(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:4/0 lens 488/448 e 0 to 0 dl 1772305879 ref 1 fl Complete:/0/0 rc 0/0 job:'lhsmtool_posix.0' 00002000:00100000:2.0:1772305873.699448:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 00000000933d69a5 with x1858396225339968 ext(22020096->23068671) 00002000:00010000:2.0:1772305873.699452:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000933d69a5 00000040:00080000:2.0:1772305874.144417:0:66209:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305874.144422:0:66209:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305874.144477:0:66209:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 30 count 15 00000040:00080000:2.0:1772305874.144481:0:66209:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:2.0:1772305874.632745:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772305874.703518:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305874.703591:0:21399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225340096 00002000:00100000:2.0:1772305874.703662:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (23068672->24117247) req@00000000a358b8a9 x1858396225340096/t0(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:5/0 lens 488/0 e 0 to 0 dl 1772305880 ref 1 fl New:/0/ffffffff rc 0/-1 job:'lhsmtool_posix.0' 00002000:00100000:2.0:1772305874.703676:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 00000000a358b8a9 with x1858396225340096 ext(23068672->24117247) 00002000:00010000:2.0:1772305874.703682:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000a358b8a9 00000100:00100000:2.0:1772305874.703713:0:21399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2031 00000100:00100000:2.0:1772305874.703721:0:21399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a358b8a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+231:2215:x1858396225340096:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1772305874.707889:0:21399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a358b8a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+233:2215:x1858396225340096:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 Request processed in 4164us (4374us total) trans 4294968295 rc 0/0 00000100:00100000:2.0:1772305874.707903:0:21399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2031 00002000:00100000:2.0:1772305874.707913:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (23068672->24117247) req@00000000a358b8a9 x1858396225340096/t4294968295(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:5/0 lens 488/448 e 0 to 0 dl 1772305880 ref 1 fl Complete:/0/0 rc 0/0 job:'lhsmtool_posix.0' 00002000:00100000:2.0:1772305874.707938:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 00000000a358b8a9 with x1858396225340096 ext(23068672->24117247) 00002000:00010000:2.0:1772305874.707944:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000a358b8a9 00000001:00080000:1.0:1772305874.900231:0:6332:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-OST0000: transno 4294968295 is committed 00000040:00080000:3.0:1772305875.016841:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305875.016847:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00100000:3.0:1772305875.016884:0:54732:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 16 in log [0xf:0x1:0x0] 00000040:00100000:3.0:1772305875.017042:0:54732:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 17 in log [0xf:0x1:0x0] 00000040:00100000:3.0:1772305875.017086:0:54732:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 18 in log [0xf:0x1:0x0] 00000040:00080000:3.0:1772305875.017127:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 30 count 12 00000040:00080000:3.0:1772305875.017133:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:3.0:1772305875.400843:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000081fffd7c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216595776:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1772305875.400926:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305875.401141:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000081fffd7c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216595776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1772305875.401711:0:2992:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1772305875.401733:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008e341f60 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216595840:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1772305875.401763:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305875.401798:0:6309:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216595840 00000100:00100000:3.0:1772305875.401832:0:6309:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 438 00000100:00100000:3.0:1772305875.401838:0:6309:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000036040640 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216595840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1772305875.401853:0:6309:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 740884480 pending 0 free 3810525184 avail 3803185152 00000100:00100000:3.0:1772305875.401899:0:6309:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000036040640 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216595840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305875.401913:0:6309:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 438 00000100:00100000:1.0:1772305875.401929:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008e341f60 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216595840:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1772305875.435191:0:66262:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305875.435195:0:66262:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305875.435274:0:66262:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 30 count 12 00000040:00080000:1.0:1772305875.435280:0:66262:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:1.0:1772305875.713692:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305875.713776:0:21399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225340224 00002000:00100000:2.0:1772305875.713815:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (24117248->25165823) req@000000003b5869ad x1858396225340224/t0(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:6/0 lens 488/0 e 0 to 0 dl 1772305881 ref 1 fl New:/0/ffffffff rc 0/-1 job:'lhsmtool_posix.0' 00002000:00100000:2.0:1772305875.713825:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 000000003b5869ad with x1858396225340224 ext(24117248->25165823) 00002000:00010000:2.0:1772305875.713841:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000003b5869ad 00000100:00100000:2.0:1772305875.713880:0:21399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2032 00000100:00100000:2.0:1772305875.713887:0:21399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003b5869ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+223:2216:x1858396225340224:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1772305875.718690:0:21399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003b5869ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+225:2216:x1858396225340224:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 Request processed in 4801us (5015us total) trans 4294968296 rc 0/0 00000100:00100000:2.0:1772305875.718700:0:21399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2032 00002000:00100000:2.0:1772305875.718709:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (24117248->25165823) req@000000003b5869ad x1858396225340224/t4294968296(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:6/0 lens 488/448 e 0 to 0 dl 1772305881 ref 1 fl Complete:/0/0 rc 0/0 job:'lhsmtool_posix.0' 00002000:00100000:2.0:1772305875.718716:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 000000003b5869ad with x1858396225340224 ext(24117248->25165823) 00002000:00010000:2.0:1772305875.718734:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000003b5869ad 00000100:00100000:2.0:1772305875.912911:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f5fe1428 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2991:1858396216596096:0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772305875.912920:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000093b46947 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:2993:1858396216595968:0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772305875.912949:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ea1c5fa0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:2994:1858396216596032:0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772305875.912962:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305875.912985:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216595904 00000100:00100000:3.0:1772305875.913000:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305875.913044:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1772305875.913051:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000079efc383 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2992:x1858396216595904:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772305875.913065:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1772305875.913070:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001571dacd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:2991:x1858396216596096:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772305875.913117:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000079efc383 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2992:x1858396216595904:12345-0@lo:400:kworker/u8:4.0 Request processed in 64us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305875.913122:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001571dacd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:2991:x1858396216596096:12345-0@lo:400:kworker/u8:4.0 Request processed in 49us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305875.913133:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1772305875.913144:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1772305875.913164:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f5fe1428 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2991:1858396216596096:0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772305875.913176:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772305875.913203:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216595968 00000100:00100000:2.0:1772305875.913233:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1772305875.913236:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b896dfee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:70aae467-c860-409f-ba1b-742f4d042da6:2992:1858396216595904:0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772305875.913245:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b975fc8d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:2993:x1858396216595968:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772305875.913295:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b975fc8d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:2993:x1858396216595968:12345-0@lo:400:kworker/u8:4.0 Request processed in 53us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305875.913302:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1772305875.913328:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000093b46947 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:2993:1858396216595968:0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772305875.913363:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ea1c5fa0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:2994:1858396216596032:0@lo:400:kworker/u8:4.0 00010000:00010000:3.0:1772305876.680710:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772305876.720664:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305876.720712:0:21399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225340352 00002000:00100000:3.0:1772305876.720777:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (25165824->26214399) req@00000000de1a3306 x1858396225340352/t0(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:7/0 lens 488/0 e 0 to 0 dl 1772305882 ref 1 fl New:/0/ffffffff rc 0/-1 job:'lhsmtool_posix.0' 00002000:00100000:3.0:1772305876.720791:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 00000000de1a3306 with x1858396225340352 ext(25165824->26214399) 00002000:00010000:3.0:1772305876.720797:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000de1a3306 00000100:00100000:3.0:1772305876.720832:0:21399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2033 00000100:00100000:3.0:1772305876.720840:0:21399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000de1a3306 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+225:2216:x1858396225340352:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1772305876.725489:0:21399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000de1a3306 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2216:x1858396225340352:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 Request processed in 4647us (4831us total) trans 4294968297 rc 0/0 00000100:00100000:2.0:1772305876.725498:0:21399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2033 00002000:00100000:2.0:1772305876.725505:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (25165824->26214399) req@00000000de1a3306 x1858396225340352/t4294968297(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:7/0 lens 488/448 e 0 to 0 dl 1772305882 ref 1 fl Complete:/0/0 rc 0/0 job:'lhsmtool_posix.0' 00002000:00100000:2.0:1772305876.725512:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 00000000de1a3306 with x1858396225340352 ext(25165824->26214399) 00002000:00010000:2.0:1772305876.725515:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000de1a3306 00000040:00080000:2.0:1772305876.731084:0:66314:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305876.731089:0:66314:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305876.731193:0:66314:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 30 count 12 00000040:00080000:2.0:1772305876.731201:0:66314:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:1.0:1772305877.728890:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305877.728948:0:21399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225340480 00002000:00100000:2.0:1772305877.728989:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (26214400->27262975) req@000000002c720606 x1858396225340480/t0(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:8/0 lens 488/0 e 0 to 0 dl 1772305883 ref 1 fl New:/0/ffffffff rc 0/-1 job:'lhsmtool_posix.0' 00002000:00100000:2.0:1772305877.729001:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 000000002c720606 with x1858396225340480 ext(26214400->27262975) 00002000:00010000:2.0:1772305877.729006:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000002c720606 00000100:00100000:2.0:1772305877.729051:0:21399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2034 00000100:00100000:2.0:1772305877.729059:0:21399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002c720606 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2216:x1858396225340480:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1772305877.733182:0:21399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002c720606 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+229:2216:x1858396225340480:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 Request processed in 4121us (4295us total) trans 4294968298 rc 0/0 00000100:00100000:2.0:1772305877.733190:0:21399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2034 00002000:00100000:2.0:1772305877.733197:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (26214400->27262975) req@000000002c720606 x1858396225340480/t4294968298(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:8/0 lens 488/448 e 0 to 0 dl 1772305883 ref 1 fl Complete:/0/0 rc 0/0 job:'lhsmtool_posix.0' 00002000:00100000:2.0:1772305877.733203:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 000000002c720606 with x1858396225340480 ext(26214400->27262975) 00002000:00010000:2.0:1772305877.733207:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000002c720606 00000040:00080000:1.0:1772305878.017508:0:66365:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305878.017514:0:66365:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305878.017603:0:66365:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 30 count 12 00000040:00080000:1.0:1772305878.017611:0:66365:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:2.0:1772305878.083904:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305878.083934:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305878.083958:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305878.083960:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225340544 00000100:00100000:3.0:1772305878.083970:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225340608 00000100:00100000:2.0:1772305878.083980:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305878.084009:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305878.084024:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 128 00000100:00100000:3.0:1772305878.084026:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225340736 00000100:00100000:1.0:1772305878.084035:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000296a1da5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2217:x1858396225340544:12345-192.168.203.30@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1772305878.084047:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305878.084057:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 116 00000100:00100000:3.0:1772305878.084064:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ea1c5fa0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+53:2218:x1858396225340608:12345-192.168.203.30@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1772305878.084086:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 117 00000100:00100000:2.0:1772305878.084093:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f5fe1428 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+45:2218:x1858396225340736:12345-192.168.203.30@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1772305878.084117:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ea1c5fa0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+53:2218:x1858396225340608:12345-192.168.203.30@tcp:400:kworker/u8:1.0 Request processed in 49us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305878.084118:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000296a1da5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2217:x1858396225340544:12345-192.168.203.30@tcp:400:kworker/u8:1.0 Request processed in 77us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305878.084130:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f5fe1428 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+45:2218:x1858396225340736:12345-192.168.203.30@tcp:400:kworker/u8:1.0 Request processed in 32us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305878.084137:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 116 00000100:00100000:1.0:1772305878.084144:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 128 00000100:00100000:2.0:1772305878.084148:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 117 00000100:00100000:3.0:1772305878.084180:0:6308:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1143 00000100:00100000:3.0:1772305878.084192:0:6308:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b896dfee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+160:2217:x1858396225340800:12345-192.168.203.30@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1772305878.084192:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1144 00000100:00100000:2.0:1772305878.084204:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006392f955 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+140:2218:x1858396225340864:12345-192.168.203.30@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1772305878.084224:0:6308:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b896dfee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+160:2217:x1858396225340800:12345-192.168.203.30@tcp:400:kworker/u8:1.0 Request processed in 36us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305878.084243:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006392f955 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+140:2218:x1858396225340864:12345-192.168.203.30@tcp:400:kworker/u8:1.0 Request processed in 41us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305878.084248:0:6308:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1143 00000100:00100000:2.0:1772305878.084272:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1144 00010000:00010000:2.0:1772305878.728788:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772305878.736910:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305878.736976:0:21399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225340992 00002000:00100000:2.0:1772305878.737018:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (27262976->28311551) req@000000006670e52f x1858396225340992/t0(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:9/0 lens 488/0 e 0 to 0 dl 1772305884 ref 1 fl New:/0/ffffffff rc 0/-1 job:'lhsmtool_posix.0' 00002000:00100000:2.0:1772305878.737028:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 000000006670e52f with x1858396225340992 ext(27262976->28311551) 00002000:00010000:2.0:1772305878.737032:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000006670e52f 00000100:00100000:2.0:1772305878.737072:0:21399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2035 00000100:00100000:2.0:1772305878.737079:0:21399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006670e52f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+229:2216:x1858396225340992:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1772305878.741029:0:21399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006670e52f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+231:2216:x1858396225340992:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 Request processed in 3947us (4121us total) trans 4294968299 rc 0/0 00000100:00100000:2.0:1772305878.741039:0:21399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2035 00002000:00100000:2.0:1772305878.741047:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (27262976->28311551) req@000000006670e52f x1858396225340992/t4294968299(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:9/0 lens 488/448 e 0 to 0 dl 1772305884 ref 1 fl Complete:/0/0 rc 0/0 job:'lhsmtool_posix.0' 00002000:00100000:2.0:1772305878.741056:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 000000006670e52f with x1858396225340992 ext(27262976->28311551) 00002000:00010000:2.0:1772305878.741060:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000006670e52f 00000040:00080000:2.0:1772305879.299400:0:66416:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305879.299404:0:66416:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305879.299458:0:66416:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 30 count 12 00000040:00080000:2.0:1772305879.299463:0:66416:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:1.0:1772305879.745905:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305879.745979:0:21399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225341120 00002000:00100000:2.0:1772305879.746026:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (28311552->29360127) req@00000000b3bfcd21 x1858396225341120/t0(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:10/0 lens 488/0 e 0 to 0 dl 1772305885 ref 1 fl New:/0/ffffffff rc 0/-1 job:'lhsmtool_posix.0' 00002000:00100000:2.0:1772305879.746038:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 00000000b3bfcd21 with x1858396225341120 ext(28311552->29360127) 00002000:00010000:2.0:1772305879.746056:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000b3bfcd21 00000100:00100000:2.0:1772305879.746086:0:21399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2036 00000100:00100000:2.0:1772305879.746093:0:21399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b3bfcd21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+231:2216:x1858396225341120:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1772305879.750608:0:21399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b3bfcd21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+233:2216:x1858396225341120:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 Request processed in 4512us (4709us total) trans 4294968300 rc 0/0 00000100:00100000:2.0:1772305879.750617:0:21399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2036 00002000:00100000:2.0:1772305879.750644:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (28311552->29360127) req@00000000b3bfcd21 x1858396225341120/t4294968300(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:10/0 lens 488/448 e 0 to 0 dl 1772305885 ref 1 fl Complete:/0/0 rc 0/0 job:'lhsmtool_posix.0' 00002000:00100000:2.0:1772305879.750651:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 00000000b3bfcd21 with x1858396225341120 ext(28311552->29360127) 00002000:00010000:2.0:1772305879.750656:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000b3bfcd21 00000100:00100000:3.0:1772305880.520775:0:2991:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1772305880.520797:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c527bff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216596160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1772305880.520800:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000081fffd7c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216596224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1772305880.520873:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305880.520909:0:6309:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216596224 00000100:00100000:1.0:1772305880.520967:0:7591:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216596160 00000100:00100000:3.0:1772305880.520971:0:6309:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 439 00000100:00100000:3.0:1772305880.520978:0:6309:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000df8abf0e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216596224:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1772305880.521014:0:7591:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 440 00002000:00000024:3.0:1772305880.521017:0:6309:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 693436416 pending 0 free 3606052864 avail 3603955712 00000100:00100000:1.0:1772305880.521022:0:7591:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000031e649b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216596160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1772305880.521046:0:7591:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 740753408 pending 0 free 3800039424 avail 3797942272 00000100:00100000:3.0:1772305880.521075:0:6309:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000df8abf0e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216596224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305880.521085:0:6309:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 439 00000100:00100000:1.0:1772305880.521093:0:7591:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000031e649b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216596160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305880.521100:0:7591:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 440 00000100:00100000:2.0:1772305880.521136:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c527bff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216596160:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1772305880.588667:0:66471:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305880.588673:0:66471:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305880.588781:0:66471:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 30 count 12 00000040:00080000:2.0:1772305880.588787:0:66471:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:1.0:1772305880.752756:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305880.752843:0:21399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225341248 00002000:00100000:2.0:1772305880.752892:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (29360128->30408703) req@000000009697532b x1858396225341248/t0(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:11/0 lens 488/0 e 0 to 0 dl 1772305886 ref 1 fl New:/0/ffffffff rc 0/-1 job:'lhsmtool_posix.0' 00002000:00100000:2.0:1772305880.752905:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 000000009697532b with x1858396225341248 ext(29360128->30408703) 00002000:00010000:2.0:1772305880.752911:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000009697532b 00000100:00100000:2.0:1772305880.752946:0:21399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2037 00000100:00100000:2.0:1772305880.752955:0:21399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009697532b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+223:2216:x1858396225341248:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1772305880.757339:0:21399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009697532b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+225:2216:x1858396225341248:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 Request processed in 4383us (4590us total) trans 4294968301 rc 0/0 00000100:00100000:2.0:1772305880.757358:0:21399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2037 00002000:00100000:2.0:1772305880.757366:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (29360128->30408703) req@000000009697532b x1858396225341248/t4294968301(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:11/0 lens 488/448 e 0 to 0 dl 1772305886 ref 1 fl Complete:/0/0 rc 0/0 job:'lhsmtool_posix.0' 00002000:00100000:2.0:1772305880.757373:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 000000009697532b with x1858396225341248 ext(29360128->30408703) 00002000:00010000:2.0:1772305880.757377:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000009697532b 00010000:00010000:3.0:1772305880.776834:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772305881.032947:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003dc81c52 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2991:1858396216596352:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305881.032948:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000046e97166 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:70aae467-c860-409f-ba1b-742f4d042da6:2994:1858396216596288:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1772305881.032952:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fbb012e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2992:1858396216596416:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1772305881.033061:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305881.033076:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305881.033100:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772305881.033158:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305881.033160:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216596288 00000100:00100000:1.0:1772305881.033176:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216596352 00000100:00100000:3.0:1772305881.033201:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1772305881.033207:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fed43c45 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2994:x1858396216596288:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1772305881.033244:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1772305881.033255:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1772305881.033256:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b04e3f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:2991:x1858396216596352:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1772305881.033266:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e47bd691 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:2993:x1858396216596480:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305881.033277:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fed43c45 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2994:x1858396216596288:12345-0@lo:400:kworker/u8:0.0 Request processed in 68us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305881.033285:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1772305881.033318:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b04e3f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:2991:x1858396216596352:12345-0@lo:400:kworker/u8:0.0 Request processed in 65us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305881.033325:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1772305881.033332:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e47bd691 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:2993:x1858396216596480:12345-0@lo:400:kworker/u8:0.0 Request processed in 65us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305881.033342:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000046e97166 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:70aae467-c860-409f-ba1b-742f4d042da6:2994:1858396216596288:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1772305881.033345:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1772305881.033394:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fbb012e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2992:1858396216596416:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305881.033408:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cc2949c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:2993:1858396216596480:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1772305881.762855:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305881.762902:0:21399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225341376 00002000:00100000:2.0:1772305881.762944:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (30408704->31457279) req@000000001a144e44 x1858396225341376/t0(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:12/0 lens 488/0 e 0 to 0 dl 1772305887 ref 1 fl New:/0/ffffffff rc 0/-1 job:'lhsmtool_posix.0' 00002000:00100000:2.0:1772305881.762953:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 000000001a144e44 with x1858396225341376 ext(30408704->31457279) 00002000:00010000:2.0:1772305881.762958:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000001a144e44 00000100:00100000:2.0:1772305881.762991:0:21399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2038 00000100:00100000:2.0:1772305881.762998:0:21399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001a144e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+225:2216:x1858396225341376:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1772305881.767151:0:21399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001a144e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2216:x1858396225341376:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 Request processed in 4151us (4298us total) trans 4294968302 rc 0/0 00000100:00100000:2.0:1772305881.767166:0:21399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2038 00002000:00100000:2.0:1772305881.767175:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ab:0x0] (30408704->31457279) req@000000001a144e44 x1858396225341376/t4294968302(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:12/0 lens 488/448 e 0 to 0 dl 1772305887 ref 1 fl Complete:/0/0 rc 0/0 job:'lhsmtool_posix.0' 00002000:00100000:2.0:1772305881.767183:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 000000001a144e44 with x1858396225341376 ext(30408704->31457279) 00002000:00010000:2.0:1772305881.767187:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000001a144e44 00010000:00010000:3.0:1772305881.800735:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772305882.763141:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225341504 00000100:00100000:1.0:1772305882.763199:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 673 00000100:00100000:1.0:1772305882.763205:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000081fffd7c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+53:93780:x1858396225341504:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1772305882.763329:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000081fffd7c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+53:93780:x1858396225341504:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 122us (270us total) trans 0 rc -125/-125 00000100:00100000:1.0:1772305882.763340:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 673 00000100:00100000:1.0:1772305882.765006:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225341632 00000100:00100000:1.0:1772305882.765031:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 674 00000100:00100000:1.0:1772305882.765035:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005f1fba5b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+53:93780:x1858396225341632:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000040:00080000:1.0:1772305882.765325:0:55653:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x13:0x0].38, 168 off14464 00010000:00010000:1.0:1772305882.765393:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000017162762/0xa5e9c8c58c6ea55 lrc: 3/0,1 mode: --/EX res: [0x200000408:0x87:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305882.765409:0:55653:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000d05ed1ee/0xa5e9c8c58c6ea40 lrc: 2/0,0 mode: PR/PR res: [0x200000408:0x87:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eba4 expref: 44 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305882.765415:0:55653:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 0000000017162762/0xa5e9c8c58c6ea55 lrc: 4/0,1 mode: --/EX res: [0x200000408:0x87:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305882.765443:0:55653:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000d05ed1ee/0xa5e9c8c58c6ea40 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x87:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eba4 expref: 44 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305882.765452:0:55653:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000d05ed1ee/0xa5e9c8c58c6ea40 lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x87:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eba4 expref: 44 pid: 55141 timeout: 1294 lvb_type: 0 00000100:00100000:1.0:1772305882.765462:0:55653:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d0e10cf7 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:55653:1858396216596544:192.168.203.30@tcp:104: 00000100:00100000:1.0:1772305882.765502:0:55653:0:(client.c:2500:ptlrpc_set_wait()) set 000000003ad16ec9 going to sleep for 6 seconds 00000100:00100000:1.0:1772305882.766436:0:55653:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d0e10cf7 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:55653:1858396216596544:192.168.203.30@tcp:104: 00010000:00010000:1.0:1772305882.766451:0:55653:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 0000000017162762/0xa5e9c8c58c6ea55 lrc: 3/0,1 mode: --/EX res: [0x200000408:0x87:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305882.766695:0:7104:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225341696 00010000:00010000:2.0:1772305882.766737:0:7104:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d05ed1ee/0xa5e9c8c58c6ea40 lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x87:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eba4 expref: 45 pid: 55141 timeout: 1294 lvb_type: 0 00000100:00100000:2.0:1772305882.766764:0:7104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3059 00000100:00100000:2.0:1772305882.766768:0:7104:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008df3460f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+45:2216:x1858396225341696:12345-192.168.203.30@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1772305882.766777:0:7104:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1772305882.766782:0:7104:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000d05ed1ee/0xa5e9c8c58c6ea40 lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x87:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eba4 expref: 45 pid: 55141 timeout: 1294 lvb_type: 0 00010000:00010000:2.0:1772305882.766791:0:7104:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000d05ed1ee/0xa5e9c8c58c6ea40 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x87:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eba4 expref: 45 pid: 55141 timeout: 1294 lvb_type: 0 00010000:00010000:2.0:1772305882.766805:0:7104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d05ed1ee/0xa5e9c8c58c6ea40 lrc: 0/0,0 mode: --/PR res: [0x200000408:0x87:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eba4 expref: 45 pid: 55141 timeout: 1294 lvb_type: 0 00010000:00010000:2.0:1772305882.766817:0:7104:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x87:0x0].0x0 (0000000077cfe56e) 00010000:00010000:2.0:1772305882.766822:0:7104:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: 0000000017162762/0xa5e9c8c58c6ea55 lrc: 3/0,1 mode: --/EX res: [0x200000408:0x87:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305882.766830:0:7104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 0000000017162762/0xa5e9c8c58c6ea55 lrc: 3/0,1 mode: EX/EX res: [0x200000408:0x87:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305882.766846:0:7104:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000017162762/0xa5e9c8c58c6ea55 lrc: 4/0,1 mode: EX/EX res: [0x200000408:0x87:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305882.766870:0:7104:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1772305882.766897:0:7104:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008df3460f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+44:2216:x1858396225341696:12345-192.168.203.30@tcp:103:ldlm_bl_02.0 Request processed in 127us (282us total) trans 0 rc 0/0 00010000:00010000:1.0:1772305882.766902:0:55653:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 0000000017162762/0xa5e9c8c58c6ea55 lrc: 3/0,1 mode: EX/EX res: [0x200000408:0x87:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305882.766904:0:7104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3059 00010000:00010000:1.0:1772305882.766915:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000017162762/0xa5e9c8c58c6ea55 lrc: 3/0,1 mode: EX/EX res: [0x200000408:0x87:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305882.766926:0:55653:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000017162762/0xa5e9c8c58c6ea55 lrc: 3/0,1 mode: EX/EX res: [0x200000408:0x87:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305882.766944:0:55653:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000017162762/0xa5e9c8c58c6ea55 lrc: 2/0,0 mode: EX/EX res: [0x200000408:0x87:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305882.766952:0:55653:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000017162762/0xa5e9c8c58c6ea55 lrc: 3/0,0 mode: EX/EX res: [0x200000408:0x87:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305882.766959:0:55653:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000017162762 already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305882.766963:0:55653:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000017162762/0xa5e9c8c58c6ea55 lrc: 3/0,0 mode: EX/EX res: [0x200000408:0x87:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305882.766971:0:55653:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000017162762/0xa5e9c8c58c6ea55 lrc: 4/0,0 mode: EX/EX res: [0x200000408:0x87:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305882.766982:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x87:0x0].0x0 (0000000077cfe56e) 00010000:00010000:1.0:1772305882.766985:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305882.766987:0:55653:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000017162762/0xa5e9c8c58c6ea55 lrc: 2/0,0 mode: --/EX res: [0x200000408:0x87:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305882.766994:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000017162762/0xa5e9c8c58c6ea55 lrc: 0/0,0 mode: --/EX res: [0x200000408:0x87:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1772305882.767062:0:55653:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305882.767066:0:55653:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305882.767145:0:55653:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 30 count 12 00000040:00080000:1.0:1772305882.767153:0:55653:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:1.0:1772305882.767221:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005f1fba5b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+54:93780:x1858396225341632:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 2183us (2255us total) trans 8589934809 rc 0/0 00000100:00100000:1.0:1772305882.767232:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 674 00000040:00080000:3.0:1772305882.767270:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305882.767274:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305882.767921:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 12 00000040:00080000:3.0:1772305882.767928:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:2.0:1772305882.768000:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225341824 00000100:00100000:2.0:1772305882.768026:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 86 00000100:00100000:2.0:1772305882.768030:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000df58eb45 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+54:93780:x1858396225341824:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000001:00080000:2.0:1772305882.768249:0:57054:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934810 00000004:00080000:2.0:1772305882.768587:0:57054:0:(mdd_object.c:3529:mdd_close()) Object [0x200000402:0x320:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1772305882.768717:0:57054:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xb:0x0].8, 64 off8776 00000004:00080000:2.0:1772305882.768723:0:57054:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1194663095659ns, next at 1195663093451ns, rc = 0 00000001:00080000:2.0:1772305882.768730:0:57054:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934810 00010000:00010000:2.0:1772305882.768760:0:57054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000bc6e3b0a/0xa5e9c8c58c6ea5c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x320:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305882.768774:0:57054:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000bc6e3b0a/0xa5e9c8c58c6ea5c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x320:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT gid 18446631280743258432 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305882.768783:0:57054:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000bc6e3b0a/0xa5e9c8c58c6ea5c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x320:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT gid 18446631280743258432 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305882.768791:0:57054:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000bc6e3b0a/0xa5e9c8c58c6ea5c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x320:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT gid 18446631280743258432 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305882.768805:0:57054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000bc6e3b0a/0xa5e9c8c58c6ea5c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x320:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT gid 18446631280743258432 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305882.768812:0:57054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000bc6e3b0a/0xa5e9c8c58c6ea5c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x320:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT gid 18446631280743258432 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305882.768833:0:57054:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1772305882.768909:0:5497:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1772305882.768914:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000df58eb45 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+55:93780:x1858396225341824:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 882us (954us total) trans 8589934810 rc 0/0 00010000:00010000:1.0:1772305882.768916:0:5497:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000bc6e3b0a/0xa5e9c8c58c6ea5c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x320:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT gid 18446631280743258432 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305882.768926:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 86 00010000:00010000:1.0:1772305882.768933:0:5497:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000bc6e3b0a already unused, calling callback (00000000b5e4f3c0) 00010000:00010000:1.0:1772305882.768937:0:5497:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000bc6e3b0a/0xa5e9c8c58c6ea5c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x320:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT gid 18446631280743258432 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305882.768944:0:5497:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000bc6e3b0a/0xa5e9c8c58c6ea5c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x320:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT gid 18446631280743258432 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305882.768955:0:5497:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x320:0x0].0x0 (00000000a16b93f9) 00010000:00010000:1.0:1772305882.768957:0:5497:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1772305882.768960:0:5497:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000bc6e3b0a/0xa5e9c8c58c6ea5c lrc: 1/0,0 mode: --/PW res: [0x200000402:0x320:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT gid 18446631280743258432 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305882.768966:0:5497:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000bc6e3b0a/0xa5e9c8c58c6ea5c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x320:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT gid 18446631280743258432 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305882.768978:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1772305882.768980:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1772305882.768981:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1772305883.172174:0:66574:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305883.172178:0:66574:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305883.172231:0:66574:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 30 count 12 00000040:00080000:1.0:1772305883.172237:0:66574:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:2.0:1772305883.200609:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305883.200686:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225341888 00000100:00100000:1.0:1772305883.200739:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 675 00000100:00100000:1.0:1772305883.200748:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cc2949c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+55:94002:x1858396225341888:12345-192.168.203.30@tcp:501:chlg_load_threa.0 00000100:00100000:1.0:1772305883.201013:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cc2949c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+55:94002:x1858396225341888:12345-192.168.203.30@tcp:501:chlg_load_threa.0 Request processed in 265us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305883.201022:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 675 00000100:00100000:3.0:1772305883.201832:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225341952 00000100:00100000:3.0:1772305883.201861:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 676 00000100:00100000:3.0:1772305883.201864:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004ca53634 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+55:94002:x1858396225341952:12345-192.168.203.30@tcp:503:chlg_load_threa.0 00000100:00100000:3.0:1772305883.202177:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004ca53634 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+55:94002:x1858396225341952:12345-192.168.203.30@tcp:503:chlg_load_threa.0 Request processed in 311us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305883.202184:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 676 00000100:00100000:2.0:1772305883.202962:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305883.203025:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225342016 00000100:00100000:3.0:1772305883.203055:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 677 00000100:00100000:3.0:1772305883.203061:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fbb012e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+55:94002:x1858396225342016:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1772305883.203198:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fbb012e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+55:94002:x1858396225342016:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 136us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305883.203208:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 677 00000100:00100000:2.0:1772305883.203869:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305883.203897:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225342080 00000100:00100000:3.0:1772305883.203928:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 678 00000100:00100000:3.0:1772305883.203934:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dc9c50ef pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+55:94002:x1858396225342080:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1772305883.204069:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dc9c50ef pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+55:94002:x1858396225342080:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 134us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305883.204077:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 678 00000100:00100000:1.0:1772305883.204394:0:54689:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225342144 00000100:00100000:1.0:1772305883.204429:0:54689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 130 00000100:00100000:1.0:1772305883.204438:0:54689:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004f19bb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2215:x1858396225342144:12345-192.168.203.30@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1772305883.204483:0:54689:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004f19bb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2215:x1858396225342144:12345-192.168.203.30@tcp:400:kworker/u8:1.0 Request processed in 46us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305883.204485:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225342208 00000100:00100000:1.0:1772305883.204489:0:54689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 130 00000100:00100000:3.0:1772305883.204529:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225342272 00000100:00100000:1.0:1772305883.204537:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225342336 00000100:00100000:1.0:1772305883.204569:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1145 00000100:00100000:1.0:1772305883.204581:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000090b11f09 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2216:x1858396225342208:12345-192.168.203.30@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1772305883.204613:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000090b11f09 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2216:x1858396225342208:12345-192.168.203.30@tcp:400:kworker/u8:1.0 Request processed in 38us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305883.204620:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1145 00000100:00100000:1.0:1772305883.204686:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1147 00000100:00100000:1.0:1772305883.204692:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000091bd8ecf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+160:2216:x1858396225342336:12345-192.168.203.30@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1772305883.204717:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000091bd8ecf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+160:2216:x1858396225342336:12345-192.168.203.30@tcp:400:kworker/u8:1.0 Request processed in 26us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305883.204724:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1147 00000100:00100000:1.0:1772305883.204778:0:48470:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225342400 00000100:00100000:1.0:1772305883.204801:0:48470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1148 00000100:00100000:1.0:1772305883.204805:0:48470:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001d7e4961 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f935b4d0-e17f-49c8-8011-4be99ba75430+140:2215:x1858396225342400:12345-192.168.203.30@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1772305883.204838:0:48470:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001d7e4961 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f935b4d0-e17f-49c8-8011-4be99ba75430+140:2215:x1858396225342400:12345-192.168.203.30@tcp:400:kworker/u8:1.0 Request processed in 33us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305883.204844:0:48470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1148 00000100:00100000:1.0:1772305883.204893:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305883.205659:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225342528 00000100:00100000:3.0:1772305883.205700:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 680 00000100:00100000:3.0:1772305883.205705:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d7a9133d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+55:94002:x1858396225342528:12345-192.168.203.30@tcp:503:chlg_load_threa.0 00000100:00100000:3.0:1772305883.205780:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d7a9133d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+55:94002:x1858396225342528:12345-192.168.203.30@tcp:503:chlg_load_threa.0 Request processed in 75us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305883.205786:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 680 00000100:00100000:3.0:1772305883.206349:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305883.207125:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00010000:3.0:1772305883.848843:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1772305884.872754:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1772305885.058784:0:66770:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1772305885.058790:0:66770:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x11:0x1:0x0]:0 at index 1 of catalog [0x6:0xa:0x0] 00000040:00080000:1.0:1772305885.058824:0:66770:0:(llog.c:789:llog_process_thread()) stop processing plain 0x11:1:0 index 9 count 2 00000040:00080000:1.0:1772305885.058830:0:66770:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x6:10:0 index 2 count 2 00000100:00100000:1.0:1772305885.077021:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225342720 00000100:00100000:1.0:1772305885.077079:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 683 00000100:00100000:1.0:1772305885.077089:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009a230241 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+55:94443:x1858396225342720:12345-192.168.203.30@tcp:46:lfs.0 00000004:00000080:1.0:1772305885.077130:0:55653:0:(mdt_handler.c:7411:mdt_iocontrol()) handling ioctl cmd 0x424066b3 00000004:00000080:1.0:1772305885.077172:0:55653:0:(mdd_device.c:2125:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=8, endrec=0 00000040:00080000:1.0:1772305885.077239:0:55653:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1772305885.077242:0:55653:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x11:0x1:0x0]:0 at index 1 of catalog [0x6:0xa:0x0] 00000004:00000080:1.0:1772305885.077269:0:55653:0:(mdd_device.c:2095:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl8 endrec = 38 00000040:00080000:1.0:1772305885.077340:0:55653:0:(llog.c:789:llog_process_thread()) stop processing plain 0x11:1:0 index 9 count 2 00000040:00080000:1.0:1772305885.077345:0:55653:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x6:10:0 index 2 count 2 00000004:00000080:1.0:1772305885.077348:0:55653:0:(mdd_device.c:2173:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl8 entries up to 18446744073709551615 00000040:00080000:1.0:1772305885.077378:0:55653:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1772305885.077379:0:55653:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x13:0x1:0x0]:0 at index 1 of catalog [0x5:0xa:0x0] 00000040:00100000:1.0:1772305885.077405:0:55653:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 32 in log [0x13:0x1:0x0] 00000040:00100000:1.0:1772305885.077458:0:55653:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 33 in log [0x13:0x1:0x0] 00000040:00100000:1.0:1772305885.077483:0:55653:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 34 in log [0x13:0x1:0x0] 00000040:00100000:1.0:1772305885.077501:0:55653:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 35 in log [0x13:0x1:0x0] 00000040:00100000:1.0:1772305885.077517:0:55653:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 36 in log [0x13:0x1:0x0] 00000040:00100000:1.0:1772305885.077550:0:55653:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 37 in log [0x13:0x1:0x0] 00000040:00100000:1.0:1772305885.077586:0:55653:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 38 in log [0x13:0x1:0x0] 00000040:00080000:1.0:1772305885.077610:0:55653:0:(llog.c:789:llog_process_thread()) stop processing plain 0x13:1:0 index 38 count 1 00000040:00080000:1.0:1772305885.077613:0:55653:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x5:10:0 index 2 count 2 00000100:00100000:1.0:1772305885.077727:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009a230241 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+55:94443:x1858396225342720:12345-192.168.203.30@tcp:46:lfs.0 Request processed in 639us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305885.077733:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 683 00000001:00080000:3.0:1772305885.144860:0:6332:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-OST0000: transno 4294968302 is committed 00000100:00100000:2.0:1772305885.145485:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216596608 00000100:00100000:2.0:1772305885.145528:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5682 00000100:00100000:2.0:1772305885.145535:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000019fb9065 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216596608:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1772305885.145556:0:10520:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:427 count 1 00010000:00010000:2.0:1772305885.145577:0:10520:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4c26f30/0xa5e9c8c58c6ea63 lrc: 3/0,1 mode: --/PW res: [0x1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305885.145594:0:10520:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6ea24 lrc: 2/0,0 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb9d expref: 222 pid: 18149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305885.145601:0:10520:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1772305885.145602:0:10520:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1772305885.145604:0:10520:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4c26f30/0xa5e9c8c58c6ea63 lrc: 4/0,1 mode: --/PW res: [0x1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305885.145671:0:10520:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6ea24 lrc: 3/0,0 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000030020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb9d expref: 222 pid: 18149 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305885.145687:0:10520:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6ea24 lrc: 4/0,0 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400030020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb9d expref: 222 pid: 18149 timeout: 1297 lvb_type: 0 00000100:00100000:2.0:1772305885.145699:0:10520:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d12426c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:10520:1858396216596672:192.168.203.30@tcp:104: 00000100:00100000:2.0:1772305885.145754:0:10520:0:(client.c:2500:ptlrpc_set_wait()) set 00000000517f499b going to sleep for 6 seconds 00000100:00100000:2.0:1772305885.146719:0:10520:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d12426c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:10520:1858396216596672:192.168.203.30@tcp:104: 00010000:00010000:2.0:1772305885.146741:0:10520:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d4c26f30/0xa5e9c8c58c6ea63 lrc: 3/0,1 mode: --/PW res: [0x1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305885.174790:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00010000:2.0:1772305885.175074:0:10520:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d4c26f30/0xa5e9c8c58c6ea63 lrc: 3/0,1 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305885.175084:0:10520:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4c26f30/0xa5e9c8c58c6ea63 lrc: 3/0,1 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305885.175091:0:10520:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4c26f30/0xa5e9c8c58c6ea63 lrc: 3/0,1 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305885.175096:0:10520:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4c26f30/0xa5e9c8c58c6ea63 lrc: 2/0,0 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305885.175115:0:10520:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1772305885.175162:0:5497:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1772305885.175169:0:5497:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4c26f30/0xa5e9c8c58c6ea63 lrc: 2/0,0 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305885.175181:0:5497:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d4c26f30 already unused, calling callback (00000000b5e4f3c0) 00010000:00010000:1.0:1772305885.175185:0:5497:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4c26f30/0xa5e9c8c58c6ea63 lrc: 2/0,0 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305885.175195:0:5497:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4c26f30/0xa5e9c8c58c6ea63 lrc: 3/0,0 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305885.175211:0:5497:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4c26f30/0xa5e9c8c58c6ea63 lrc: 1/0,0 mode: --/PW res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305885.175218:0:5497:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4c26f30/0xa5e9c8c58c6ea63 lrc: 0/0,0 mode: --/PW res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305885.175237:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1772305885.175239:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1772305885.175241:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1772305885.175502:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000019fb9065 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:2994:x1858396216596608:12345-0@lo:6:osp-syn-0-0.0 Request processed in 29967us (30048us total) trans 4294968303 rc 0/0 00000100:00100000:2.0:1772305885.175509:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5682 00000020:00000080:1.0:1772305885.359258:0:66822:0:(class_obd.c:302:class_handle_ioctl()) cmd = c008667f 00000020:00000080:1.0:1772305885.359266:0:66822:0:(class_obd.c:126:class_resolve_dev_name()) device name lustre-MDT0000 00000020:00000080:1.0:1772305885.359270:0:66822:0:(class_obd.c:133:class_resolve_dev_name()) device name lustre-MDT0000, dev 5 00000020:00000080:1.0:1772305885.359307:0:66822:0:(class_obd.c:302:class_handle_ioctl()) cmd = 424066b2 00000004:00000080:1.0:1772305885.359313:0:66822:0:(mdt_handler.c:7411:mdt_iocontrol()) handling ioctl cmd 0x424066b2 00000004:00000080:1.0:1772305885.359345:0:66822:0:(mdd_device.c:2125:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=8, endrec=0 00000040:00080000:1.0:1772305885.359416:0:66822:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1772305885.359420:0:66822:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x11:0x1:0x0]:0 at index 1 of catalog [0x6:0xa:0x0] 00000004:00000080:1.0:1772305885.359457:0:66822:0:(mdd_device.c:2095:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl8 endrec = 38 00000040:00080000:1.0:1772305885.359556:0:66822:0:(llog.c:789:llog_process_thread()) stop processing plain 0x11:1:0 index 9 count 2 00000040:00080000:1.0:1772305885.359563:0:66822:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x6:10:0 index 2 count 2 00000004:00000080:1.0:1772305885.359567:0:66822:0:(mdd_device.c:2173:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl8 entries up to 18446744073709551615 00000040:00080000:1.0:1772305885.359604:0:66822:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1772305885.359606:0:66822:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x13:0x1:0x0]:0 at index 1 of catalog [0x5:0xa:0x0] 00000040:00080000:1.0:1772305885.360019:0:66822:0:(llog.c:789:llog_process_thread()) stop processing plain 0x13:1:0 index 64768 count 1 00000040:00080000:1.0:1772305885.360024:0:66822:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x5:10:0 index 2 count 2 00000004:00000080:1.0:1772305885.360028:0:66822:0:(mdd_device.c:1983:mdd_changelog_user_purge()) lustre-MDD0000: Purge request: id=8 00000040:00080000:1.0:1772305885.360048:0:66822:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1772305885.360049:0:66822:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x11:0x1:0x0]:0 at index 1 of catalog [0x6:0xa:0x0] 00000040:00100000:1.0:1772305885.360063:0:66822:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 8 in log [0x11:0x1:0x0] 00000040:00080000:1.0:1772305885.360152:0:66822:0:(llog.c:789:llog_process_thread()) stop processing plain 0x11:1:0 index 8 count 1 00000040:00080000:1.0:1772305885.360155:0:66822:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x6:10:0 index 2 count 2 00000004:00000080:1.0:1772305885.360158:0:66822:0:(mdd_device.c:2005:mdd_changelog_user_purge()) turning off changelogs 00000004:02000000:1.0:1772305885.360159:0:66822:0:(mdd_device.c:483:mdd_changelog_off()) lustre-MDD0000: changelog off 00000004:00000080:1.0:1772305885.361264:0:66822:0:(mdd_device.c:2015:mdd_changelog_user_purge()) lustre-MDD0000: Purge changelog entries for user cl8 record=18446744073709551615 00000040:00080000:1.0:1772305885.361292:0:66822:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1772305885.361294:0:66822:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x13:0x1:0x0]:0 at index 1 of catalog [0x5:0xa:0x0] 00000040:00080000:1.0:1772305885.361713:0:66822:0:(llog.c:789:llog_process_thread()) stop processing plain 0x13:1:0 index 64768 count 1 00000040:00080000:1.0:1772305885.361720:0:66822:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x5:10:0 index 2 count 2 00000040:00080000:1.0:1772305885.361759:0:66822:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1772305885.361762:0:66822:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x11:0x1:0x0]:0 at index 1 of catalog [0x6:0xa:0x0] 00000040:00080000:1.0:1772305885.362147:0:66822:0:(llog.c:789:llog_process_thread()) stop processing plain 0x11:1:0 index 64768 count 1 00000040:00080000:1.0:1772305885.362152:0:66822:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x6:10:0 index 2 count 2 00000100:00100000:3.0:1772305885.640754:0:2992:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1772305885.640778:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b2b1cc4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216596736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1772305885.640852:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305885.640886:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c527bff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216596800:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1772305885.640911:0:7591:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216596736 00000100:00100000:3.0:1772305885.640914:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305885.640968:0:7591:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 441 00000100:00100000:1.0:1772305885.640975:0:7591:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003dc81c52 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216596736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1772305885.641010:0:7591:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 693436416 pending 0 free 3606052864 avail 3603955712 00000100:00100000:1.0:1772305885.641072:0:7591:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003dc81c52 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216596736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305885.641087:0:7591:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 441 00000100:00100000:3.0:1772305885.641096:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b2b1cc4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216596736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1772305885.641116:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c527bff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216596800:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1772305885.689686:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225342848 00000100:00100000:1.0:1772305885.689750:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 684 00000100:00100000:1.0:1772305885.689760:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b68984bd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+53:93697:x1858396225342848:12345-192.168.203.30@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1772305885.689868:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b68984bd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+53:93697:x1858396225342848:12345-192.168.203.30@tcp:60:lhsmtool_posix.0 Request processed in 108us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305885.689878:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 684 00000040:00080000:3.0:1772305885.832878:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305885.832885:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00100000:3.0:1772305885.832935:0:54732:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 19 in log [0xf:0x1:0x0] 00000040:00100000:3.0:1772305885.833062:0:54732:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 20 in log [0xf:0x1:0x0] 00000040:00100000:3.0:1772305885.833110:0:54732:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 21 in log [0xf:0x1:0x0] 00000040:00080000:3.0:1772305885.833171:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 30 count 9 00000040:00080000:3.0:1772305885.833178:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:2.0:1772305886.152813:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c527bff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:70aae467-c860-409f-ba1b-742f4d042da6:2992:1858396216596864:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1772305886.152877:0:2993:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1772305886.152893:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002254491d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:2993:1858396216596992:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1772305886.152894:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772305886.152931:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a95f9a22 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216597120:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1772305886.152941:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772305886.152963:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305886.152973:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216596864 00000100:00100000:2.0:1772305886.152990:0:2992:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1772305886.152999:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000166181f2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216597056:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1772305886.153020:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216596928 00000100:00100000:2.0:1772305886.153028:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305886.153039:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1772305886.153050:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001655ed78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2992:x1858396216596864:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1772305886.153058:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216597184 00000100:00100000:2.0:1772305886.153075:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1772305886.153085:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004f878afc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:2994:x1858396216596928:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1772305886.153100:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1772305886.153105:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000001f95630 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:2994:x1858396216597184:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305886.153131:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001655ed78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2992:x1858396216596864:12345-0@lo:400:kworker/u8:0.0 Request processed in 81us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305886.153144:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004f878afc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:2994:x1858396216596928:12345-0@lo:400:kworker/u8:0.0 Request processed in 62us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305886.153154:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000001f95630 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:2994:x1858396216597184:12345-0@lo:400:kworker/u8:0.0 Request processed in 45us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305886.153161:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1772305886.153170:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1772305886.153174:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1772305886.153190:0:48470:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216597120 00000100:00100000:2.0:1772305886.153219:0:48470:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216597056 00000100:00100000:2.0:1772305886.153246:0:48470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1149 00000100:00100000:2.0:1772305886.153256:0:48470:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008907f4c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216597120:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305886.153263:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1150 00000100:00100000:1.0:1772305886.153273:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006c142a39 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:2994:1858396216597184:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305886.153275:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007ce64e92 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:2992:x1858396216597056:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1772305886.153288:0:48470:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008907f4c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216597120:12345-0@lo:400:kworker/u8:0.0 Request processed in 31us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305886.153294:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000830ec897 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:2994:1858396216596928:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1772305886.153297:0:48470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1149 00000100:00100000:3.0:1772305886.153353:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007ce64e92 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:2992:x1858396216597056:12345-0@lo:400:kworker/u8:0.0 Request processed in 78us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305886.153369:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1150 00000400:00000080:1.0:1772305886.240305:0:66918:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1772305886.240314:0:66918:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 223b: Changelog for restore canceled (release case) ========================================================== 14:11:25 (1772305885) 00000100:00100000:2.0:1772305886.261380:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225342912 00000100:00100000:2.0:1772305886.261430:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 685 00000100:00100000:2.0:1772305886.261438:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d6c04740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+44:94612:x1858396225342912:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1772305886.261455:0:55141:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305886.261478:0:55141:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6ea6a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ebb2 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305886.261526:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000349659bf/0xa5e9c8c58c6ea71 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305886.261538:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000349659bf/0xa5e9c8c58c6ea71 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305886.261548:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000349659bf/0xa5e9c8c58c6ea71 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305886.261560:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000cd3f7c05/0xa5e9c8c58c6ea78 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305886.261565:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cd3f7c05/0xa5e9c8c58c6ea78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305886.261570:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cd3f7c05/0xa5e9c8c58c6ea78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305886.261822:0:55141:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000349659bf/0xa5e9c8c58c6ea71 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305886.261828:0:55141:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000349659bf/0xa5e9c8c58c6ea71 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305886.261833:0:55141:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000349659bf/0xa5e9c8c58c6ea71 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305886.261837:0:55141:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000349659bf already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305886.261839:0:55141:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000349659bf/0xa5e9c8c58c6ea71 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305886.261850:0:55141:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000349659bf/0xa5e9c8c58c6ea71 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305886.261860:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:2.0:1772305886.261862:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305886.261865:0:55141:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000349659bf/0xa5e9c8c58c6ea71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305886.261870:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000349659bf/0xa5e9c8c58c6ea71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305886.261879:0:55141:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000cd3f7c05/0xa5e9c8c58c6ea78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305886.261882:0:55141:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cd3f7c05/0xa5e9c8c58c6ea78 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305886.261886:0:55141:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cd3f7c05/0xa5e9c8c58c6ea78 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305886.261889:0:55141:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cd3f7c05 already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305886.261891:0:55141:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cd3f7c05/0xa5e9c8c58c6ea78 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305886.261896:0:55141:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cd3f7c05/0xa5e9c8c58c6ea78 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305886.261903:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbdd0d989 (000000007f5f418e) 00010000:00010000:2.0:1772305886.261906:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305886.261915:0:55141:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cd3f7c05/0xa5e9c8c58c6ea78 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305886.261922:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cd3f7c05/0xa5e9c8c58c6ea78 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305886.261957:0:55141:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6ea6a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ebb2 expref: 45 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305886.261967:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6ea6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ebb2 expref: 45 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305886.261978:0:55141:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000059b20141, rc 0) 00000100:00100000:2.0:1772305886.262033:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d6c04740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+44:94612:x1858396225342912:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 595us (709us total) trans 0 rc 301/301 00000100:00100000:2.0:1772305886.262041:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 685 00000100:00100000:2.0:1772305886.264451:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305886.264499:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225343040 00000100:00100000:3.0:1772305886.264539:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 686 00000100:00100000:3.0:1772305886.264546:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000084e1bde0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+44:94612:x1858396225343040:12345-192.168.203.30@tcp:36:lfs.0 00010000:00010000:3.0:1772305886.264579:0:55141:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1772305886.264595:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6e983 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb65 expref: 44 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.264610:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:3.0:1772305886.264614:0:55141:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1772305886.264758:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6ea7f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.264774:0:55141:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e8f0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb3b expref: 52 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.264783:0:55141:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6ea7f lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.264815:0:55141:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e8f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb3b expref: 52 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.264842:0:55141:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6e8f0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eb3b expref: 52 pid: 55141 timeout: 1298 lvb_type: 0 00000100:00100000:3.0:1772305886.264856:0:55141:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000000ce11a0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:55141:1858396216597248:192.168.203.30@tcp:104: 00000100:00100000:3.0:1772305886.264910:0:55141:0:(client.c:2500:ptlrpc_set_wait()) set 000000002fb1e96d going to sleep for 6 seconds 00000100:00100000:3.0:1772305886.265710:0:55141:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000000ce11a0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:55141:1858396216597248:192.168.203.30@tcp:104: 00010000:00010000:3.0:1772305886.265730:0:55141:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6ea7f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305886.265884:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00010000:3.0:1772305886.266073:0:55141:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6ea7f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.266085:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6ea7f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.266110:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000bce5ea16/0xa5e9c8c58c6ea86 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.266121:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000bce5ea16/0xa5e9c8c58c6ea86 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.266131:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000bce5ea16/0xa5e9c8c58c6ea86 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1772305886.267256:0:55141:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000408:0x88:0x0]: returning size 512 00010000:00010000:3.0:1772305886.267263:0:55141:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6ea7f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.267283:0:55141:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6ea7f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.267290:0:55141:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6ea7f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.267297:0:55141:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000009fea887 already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305886.267300:0:55141:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6ea7f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.267307:0:55141:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6ea7f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.267315:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:3.0:1772305886.267319:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305886.267321:0:55141:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6ea7f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.267328:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6ea7f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1772305886.267339:0:55141:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000084e1bde0 reply state 000000002b63f208 transno 8589934811 ns: mdt-lustre-MDT0000_UUID lock: 00000000bce5ea16/0xa5e9c8c58c6ea86 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305886.267395:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000084e1bde0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+45:94612:x1858396225343040:12345-192.168.203.30@tcp:36:lfs.0 Request processed in 2848us (2945us total) trans 8589934811 rc 0/0 00000100:00100000:3.0:1772305886.267404:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 686 00000100:00100000:3.0:1772305886.283767:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305886.283865:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305886.283893:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225343296 00000100:00100000:1.0:1772305886.283935:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 688 00000100:00100000:1.0:1772305886.283943:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000537dbec0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+53:94622:x1858396225343296:12345-192.168.203.30@tcp:36:mkdir.0 00000100:00100000:1.0:1772305886.284100:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000537dbec0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+52:94622:x1858396225343296:12345-192.168.203.30@tcp:36:mkdir.0 Request processed in 157us (237us total) trans 0 rc -17/-17 00000100:00100000:1.0:1772305886.284107:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 688 00000100:00100000:3.0:1772305886.284894:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305886.284936:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225343360 00000100:00100000:1.0:1772305886.284966:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 689 00000100:00100000:1.0:1772305886.284971:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cc3c0696 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+52:94622:x1858396225343360:12345-192.168.203.30@tcp:101:mkdir.0 00010000:00010000:1.0:1772305886.284979:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305886.284995:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000017162762/0xa5e9c8c58c6ea8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ebb9 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305886.285028:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000949f0123/0xa5e9c8c58c6ea94 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305886.285040:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000949f0123/0xa5e9c8c58c6ea94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305886.285049:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000949f0123/0xa5e9c8c58c6ea94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305886.285060:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6ea9b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305886.285066:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6ea9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305886.285080:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6ea9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305886.285124:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6eaa2 lrc: 3/1,0 mode: --/PR res: [0x200000408:0x88:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305886.285130:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6eaa2 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x88:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305886.285135:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6eaa2 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x88:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1772305886.285165:0:54698:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000408:0x88:0x0]: returning size 512 00000004:00200000:1.0:1772305886.285168:0:54698:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1772305886.285183:0:54698:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6eaa2 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x88:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305886.285194:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000949f0123/0xa5e9c8c58c6ea94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305886.285200:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000949f0123/0xa5e9c8c58c6ea94 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305886.285207:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000949f0123/0xa5e9c8c58c6ea94 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305886.285214:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000949f0123 already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305886.285217:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000949f0123/0xa5e9c8c58c6ea94 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305886.285237:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000949f0123/0xa5e9c8c58c6ea94 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305886.285249:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:1.0:1772305886.285252:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305886.285256:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000949f0123/0xa5e9c8c58c6ea94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305886.285263:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000949f0123/0xa5e9c8c58c6ea94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305886.285274:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6ea9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305886.285281:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6ea9b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305886.285288:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6ea9b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305886.285294:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000048d87789 already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305886.285297:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6ea9b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305886.285302:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6ea9b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305886.285308:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbdd0d989 (0000000060b58ddc) 00010000:00010000:1.0:1772305886.285309:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305886.285319:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6ea9b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305886.285326:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6ea9b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305886.285357:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000017162762/0xa5e9c8c58c6ea8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ebb9 expref: 54 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305886.285369:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6eaa2 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x88:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ebb9 expref: 53 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305886.285377:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x88:0x0].0x0 (0000000094db6ce7) 00010000:00010000:1.0:1772305886.285379:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1772305886.285382:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000748ac5ea, rc 0) 00000100:00100000:1.0:1772305886.285412:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cc3c0696 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+53:94622:x1858396225343360:12345-192.168.203.30@tcp:101:mkdir.0 Request processed in 441us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305886.285418:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 689 00000100:00100000:3.0:1772305886.290999:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225343424 00000100:00100000:3.0:1772305886.291040:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 690 00000100:00100000:3.0:1772305886.291046:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008a2db6aa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+53:94625:x1858396225343424:12345-192.168.203.30@tcp:101:rm.0 00010000:00010000:3.0:1772305886.291060:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305886.291076:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6eaa9 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x88:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ebc0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.291118:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6eab0 lrc: 3/1,0 mode: --/CR res: [0x200000408:0x88:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.291127:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6eab0 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x88:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.291135:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6eab0 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x88:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.291188:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6eab7 lrc: 3/1,0 mode: --/PR res: [0x200000408:0x88:0x0].0x46626822 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.291197:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6eab7 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x88:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.291205:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6eab7 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x88:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.291270:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6eab0 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x88:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.291285:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6eab0 lrc: 2/0,0 mode: CR/CR res: [0x200000408:0x88:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.291290:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6eab0 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x88:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.291295:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d90d1abd already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305886.291298:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6eab0 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x88:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.291303:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6eab0 lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x88:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.291312:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x88:0x0].0x0 (0000000094db6ce7) 00010000:00010000:3.0:1772305886.291315:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305886.291318:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6eab0 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x88:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.291322:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6eab0 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x88:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.291334:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6eab7 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x88:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.291337:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6eab7 lrc: 2/0,0 mode: PR/PR res: [0x200000408:0x88:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.291342:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6eab7 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x88:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.291353:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000099c1b7e6 already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305886.291356:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6eab7 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x88:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.291360:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6eab7 lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x88:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.291367:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x88:0x0].0x46626822 (0000000050807621) 00010000:00010000:3.0:1772305886.291369:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305886.291370:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6eab7 lrc: 2/0,0 mode: --/PR res: [0x200000408:0x88:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.291374:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6eab7 lrc: 0/0,0 mode: --/PR res: [0x200000408:0x88:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.291405:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6eaa9 lrc: 1/0,0 mode: --/CR res: [0x200000408:0x88:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ebc0 expref: 54 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.291412:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6eaa9 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x88:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ebc0 expref: 54 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.291423:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000009fea887, rc 0) 00000100:00100000:3.0:1772305886.291466:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008a2db6aa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+53:94625:x1858396225343424:12345-192.168.203.30@tcp:101:rm.0 Request processed in 419us (515us total) trans 0 rc 301/301 00000100:00100000:3.0:1772305886.291473:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 690 00000100:00100000:3.0:1772305886.297407:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00010000:2.0:1772305886.299670:0:2977:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c12bdb6b/0xa5e9c8c58c6eacc lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x88:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305886.299679:0:2977:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c12bdb6b/0xa5e9c8c58c6eacc lrc: 2/0,0 mode: PW/PW res: [0x200000408:0x88:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305886.299685:0:2977:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c12bdb6b/0xa5e9c8c58c6eacc lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x88:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305886.299689:0:2977:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c12bdb6b already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305886.299691:0:2977:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c12bdb6b/0xa5e9c8c58c6eacc lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x88:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305886.299707:0:2977:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c12bdb6b/0xa5e9c8c58c6eacc lrc: 4/0,0 mode: PW/PW res: [0x200000408:0x88:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305886.299716:0:2977:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x88:0x0].0x46626822 (000000005046deb8) 00010000:00010000:2.0:1772305886.299719:0:2977:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305886.299721:0:2977:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c12bdb6b/0xa5e9c8c58c6eacc lrc: 2/0,0 mode: --/PW res: [0x200000408:0x88:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305886.299725:0:2977:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c12bdb6b/0xa5e9c8c58c6eacc lrc: 0/0,0 mode: --/PW res: [0x200000408:0x88:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305886.300275:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305886.308744:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225343744 00000100:00100000:3.0:1772305886.308798:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 692 00000100:00100000:3.0:1772305886.308804:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e5656ec5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+55:94628:x1858396225343744:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1772305886.308827:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305886.308844:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6eae1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ebce expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.308890:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6eae8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.308900:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6eae8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.308908:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6eae8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.308917:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6eaef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.308921:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6eaef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.308925:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6eaef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.309006:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000bce5ea16/0xa5e9c8c58c6eaf6 lrc: 3/1,0 mode: --/PR res: [0x200000408:0x88:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.309011:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000bce5ea16/0xa5e9c8c58c6eaf6 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x88:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.309030:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000bce5ea16/0xa5e9c8c58c6eaf6 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x88:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1772305886.309053:0:54698:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000408:0x88:0x0]: returning size 512 00000004:00200000:3.0:1772305886.309056:0:54698:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1772305886.309072:0:54698:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000bce5ea16/0xa5e9c8c58c6eaf6 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x88:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.309083:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6eae8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.309089:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6eae8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.309096:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6eae8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.309102:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000099c1b7e6 already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305886.309105:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6eae8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.309112:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6eae8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.309124:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:3.0:1772305886.309127:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305886.309131:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6eae8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.309137:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6eae8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.309155:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6eaef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.309162:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6eaef lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.309168:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6eaef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.309172:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d90d1abd already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305886.309174:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6eaef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.309177:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6eaef lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.309183:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbdd0d989 (0000000050807621) 00010000:00010000:3.0:1772305886.309184:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305886.309186:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6eaef lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.309189:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6eaef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.309211:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6eae1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ebce expref: 57 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.309219:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000bce5ea16/0xa5e9c8c58c6eaf6 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x88:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ebce expref: 56 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.309232:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x88:0x0].0x0 (00000000af7c637f) 00010000:00010000:3.0:1772305886.309234:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1772305886.309236:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000bce5ea16, rc 0) 00000100:00100000:3.0:1772305886.309286:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e5656ec5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+56:94628:x1858396225343744:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 481us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305886.309295:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 692 00000100:00100000:3.0:1772305886.383936:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305886.387419:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225343936 00000100:00100000:3.0:1772305886.387468:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 694 00000100:00100000:3.0:1772305886.387476:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b4c9e93d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+57:94654:x1858396225343936:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1772305886.387489:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305886.387504:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6eb0b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ebdc expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.387553:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6eb12 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.387565:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6eb12 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.387575:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6eb12 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.387590:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6eb19 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.387598:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6eb19 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.387615:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6eb19 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1772305886.388030:0:54698:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 10752 00010000:00010000:3.0:1772305886.388132:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6eb12 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.388141:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6eb12 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.388148:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6eb12 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.388155:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d90d1abd already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305886.388160:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6eb12 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.388168:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6eb12 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.388179:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (000000006b52a2ed) 00010000:00010000:3.0:1772305886.388182:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305886.388185:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6eb12 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.388192:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6eb12 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.388203:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6eb19 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.388216:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6eb19 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.388223:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6eb19 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.388229:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000099c1b7e6 already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305886.388232:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6eb19 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.388239:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6eb19 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.388246:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (0000000050807621) 00010000:00010000:3.0:1772305886.388249:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305886.388251:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6eb19 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.388257:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6eb19 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.388283:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6eb0b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ebdc expref: 59 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.388292:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6eb0b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ebdc expref: 59 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305886.388301:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000009fea887, rc 0) 00000100:00100000:3.0:1772305886.388349:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b4c9e93d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+58:94654:x1858396225343936:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 873us (984us total) trans 8589934814 rc 301/301 00000100:00100000:3.0:1772305886.388358:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 694 00000100:00100000:3.0:1772305886.389412:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305886.390742:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225344128 00000100:00100000:3.0:1772305886.390777:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 695 00000100:00100000:3.0:1772305886.390784:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000085cfa606 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+59:94654:x1858396225344128:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1772305886.390839:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000085cfa606 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+59:94654:x1858396225344128:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 Request processed in 54us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305886.390847:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 695 00010000:00010000:3.0:1772305886.920851:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1772305887.271952:0:67063:0:(class_obd.c:302:class_handle_ioctl()) cmd = c008667f 00000020:00000080:2.0:1772305887.271959:0:67063:0:(class_obd.c:126:class_resolve_dev_name()) device name lustre-MDT0000 00000020:00000080:2.0:1772305887.271963:0:67063:0:(class_obd.c:133:class_resolve_dev_name()) device name lustre-MDT0000, dev 5 00000020:00000080:2.0:1772305887.271982:0:67063:0:(class_obd.c:302:class_handle_ioctl()) cmd = 424066b1 00000004:00000080:2.0:1772305887.271987:0:67063:0:(mdt_handler.c:7411:mdt_iocontrol()) handling ioctl cmd 0x424066b1 00000040:00080000:2.0:1772305887.272161:0:67063:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x11:0x0].9, 80 off8912 00000004:00000080:2.0:1772305887.272182:0:67063:0:(mdd_device.c:1821:mdd_changelog_user_register()) lustre-MDD0000: registered changelog user 'cl9', mask 0x0 00000004:02000000:2.0:1772305887.272185:0:67063:0:(mdd_device.c:460:mdd_changelog_on()) lustre-MDD0000: changelog on 00000100:00100000:1.0:1772305887.304219:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225344192 00000100:00100000:1.0:1772305887.304273:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 696 00000100:00100000:1.0:1772305887.304279:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bb572c47 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+44:94689:x1858396225344192:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1772305887.304300:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305887.304325:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000017162762/0xa5e9c8c58c6eb27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ebe3 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.304373:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6eb2e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.304385:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6eb2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.304409:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6eb2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.304425:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000949f0123/0xa5e9c8c58c6eb35 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.304433:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000949f0123/0xa5e9c8c58c6eb35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.304441:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000949f0123/0xa5e9c8c58c6eb35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.304540:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000d7b9e4ff/0xa5e9c8c58c6eb3c lrc: 3/1,0 mode: --/PR res: [0x200000408:0x88:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.304546:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d7b9e4ff/0xa5e9c8c58c6eb3c lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x88:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.304551:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d7b9e4ff/0xa5e9c8c58c6eb3c lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x88:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1772305887.304575:0:54698:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000408:0x88:0x0]: returning size 512 00000004:00200000:1.0:1772305887.304577:0:54698:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1772305887.304592:0:54698:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000d7b9e4ff/0xa5e9c8c58c6eb3c lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x88:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.304600:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6eb2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.304604:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6eb2e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.304615:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6eb2e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.304620:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000048d87789 already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305887.304622:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6eb2e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.304667:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6eb2e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.304678:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:1.0:1772305887.304681:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305887.304685:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6eb2e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.304689:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6eb2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.304700:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000949f0123/0xa5e9c8c58c6eb35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.304707:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000949f0123/0xa5e9c8c58c6eb35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.304714:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000949f0123/0xa5e9c8c58c6eb35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.304721:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000949f0123 already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305887.304723:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000949f0123/0xa5e9c8c58c6eb35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.304738:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000949f0123/0xa5e9c8c58c6eb35 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.304747:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbdd0d989 (0000000060b58ddc) 00010000:00010000:1.0:1772305887.304750:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305887.304752:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000949f0123/0xa5e9c8c58c6eb35 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.304757:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000949f0123/0xa5e9c8c58c6eb35 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbdd0d989 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.304782:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000017162762/0xa5e9c8c58c6eb27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ebe3 expref: 46 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.304790:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000d7b9e4ff/0xa5e9c8c58c6eb3c lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x88:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ebe3 expref: 45 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.304795:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x88:0x0].0x0 (00000000af7c637f) 00010000:00010000:1.0:1772305887.304797:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1772305887.304798:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d7b9e4ff, rc 0) 00000100:00100000:1.0:1772305887.304843:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bb572c47 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+45:94689:x1858396225344192:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 564us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305887.304849:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 696 00000100:00100000:1.0:1772305887.305937:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225344256 00000100:00100000:1.0:1772305887.305970:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 697 00000100:00100000:1.0:1772305887.305976:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ca0bf648 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+45:94689:x1858396225344256:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1772305887.305987:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305887.306003:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6eb43 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x88:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ebea expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.306035:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6eb4a lrc: 3/1,0 mode: --/CR res: [0x200000408:0x88:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.306046:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6eb4a lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x88:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.306055:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6eb4a lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x88:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.306068:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6eb51 lrc: 3/1,0 mode: --/PR res: [0x200000408:0x88:0x0].0x46626822 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.306075:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6eb51 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x88:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.306083:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6eb51 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x88:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.306153:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6eb58 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x322:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.306162:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6eb58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x322:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.306170:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6eb58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x322:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1772305887.306205:0:54698:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x322:0x0]: returning size 0 00000004:00200000:1.0:1772305887.306215:0:54698:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1772305887.306228:0:54698:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6eb58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x322:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.306238:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6eb58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x322:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.306245:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6eb4a lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x88:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.306252:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6eb4a lrc: 2/0,0 mode: CR/CR res: [0x200000408:0x88:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.306258:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6eb4a lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x88:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.306263:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a178fe80 already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305887.306266:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6eb4a lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x88:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.306271:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6eb4a lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x88:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.306280:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x88:0x0].0x0 (00000000af7c637f) 00010000:00010000:1.0:1772305887.306283:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305887.306285:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6eb4a lrc: 2/0,0 mode: --/CR res: [0x200000408:0x88:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.306290:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6eb4a lrc: 0/0,0 mode: --/CR res: [0x200000408:0x88:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.306301:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6eb51 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x88:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.306314:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6eb51 lrc: 2/0,0 mode: PR/PR res: [0x200000408:0x88:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.306320:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6eb51 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x88:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.306325:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000295bd7c already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305887.306327:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6eb51 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x88:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.306333:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6eb51 lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x88:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.306340:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x88:0x0].0x46626822 (00000000663af6c8) 00010000:00010000:1.0:1772305887.306342:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305887.306344:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6eb51 lrc: 2/0,0 mode: --/PR res: [0x200000408:0x88:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.306350:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6eb51 lrc: 0/0,0 mode: --/PR res: [0x200000408:0x88:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.306371:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6eb43 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x88:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ebea expref: 47 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.306383:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6eb58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x322:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ebea expref: 46 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.306389:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x322:0x0].0x0 (000000003892ce01) 00010000:00010000:1.0:1772305887.306397:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1772305887.306401:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000025cc37fd, rc 0) 00000100:00100000:1.0:1772305887.306437:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ca0bf648 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+46:94689:x1858396225344256:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 459us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305887.306446:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 697 00000100:00100000:1.0:1772305887.307622:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225344320 00000100:00100000:1.0:1772305887.307710:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5683 00000100:00100000:1.0:1772305887.307725:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008700166c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+140:2218:x1858396225344320:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1772305887.307741:0:10520:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305887.307757:0:10520:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6eb5f lrc: 2/0,0 mode: --/PR res: [0x1ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ebf1 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1772305887.307779:0:10520:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x1ac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1772305887.307798:0:10520:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305887.307801:0:10520:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305887.307807:0:10520:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6eb5f lrc: 3/0,0 mode: PR/PR res: [0x1ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ebf1 expref: 141 pid: 10520 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1772305887.307823:0:10520:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6eb5f lrc: 3/0,0 mode: PR/PR res: [0x1ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ebf1 expref: 141 pid: 10520 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1772305887.307835:0:10520:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001cde7dd0, rc 0) 00000100:00100000:1.0:1772305887.307869:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008700166c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+141:2218:x1858396225344320:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 152us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305887.307878:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5683 00000100:00100000:1.0:1772305887.308846:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225344384 00000100:00100000:1.0:1772305887.308880:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 698 00000100:00100000:1.0:1772305887.308887:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ea41a322 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+46:94689:x1858396225344384:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1772305887.308905:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305887.308915:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6eb66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ebf8 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.308947:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6eb6d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.308957:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6eb6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.308966:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6eb6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1772305887.309001:0:54698:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:1.0:1772305887.309004:0:54698:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 104 stripe count 1 MDT count 1 00000004:00010000:1.0:1772305887.309020:0:54698:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6eb6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.309036:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6eb66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ebf8 expref: 48 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.309049:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6eb6d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ebf8 expref: 47 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.309056:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:1.0:1772305887.309059:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1772305887.309061:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d142a9ac, rc 0) 00000100:00100000:1.0:1772305887.309096:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ea41a322 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+47:94689:x1858396225344384:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 209us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305887.309114:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 698 00000100:00100000:1.0:1772305887.309946:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225344448 00000100:00100000:1.0:1772305887.309976:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 699 00000100:00100000:1.0:1772305887.309982:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000017da2918 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+47:94689:x1858396225344448:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1772305887.309990:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305887.310000:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6eb74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ebff expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.310031:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6eb7b lrc: 3/1,0 mode: --/PR res: [0x200000408:0x88:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.310041:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6eb7b lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x88:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.310049:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6eb7b lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x88:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1772305887.310077:0:54698:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000408:0x88:0x0]: returning size 512 00000004:00200000:1.0:1772305887.310080:0:54698:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1772305887.310097:0:54698:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6eb7b lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x88:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.310116:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6eb74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ebff expref: 49 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.310131:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6eb7b lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x88:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ebff expref: 48 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.310138:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x88:0x0].0x0 (00000000af7c637f) 00010000:00010000:1.0:1772305887.310148:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1772305887.310150:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c609f04e, rc 0) 00000100:00100000:1.0:1772305887.310181:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000017da2918 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+48:94689:x1858396225344448:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 199us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305887.310187:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 699 00000100:00100000:1.0:1772305887.311811:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225344576 00000100:00100000:1.0:1772305887.311851:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 700 00000100:00100000:1.0:1772305887.311857:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f7182bde pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+48:94689:x1858396225344576:12345-192.168.203.30@tcp:58:lfs.0 00000040:00080000:1.0:1772305887.312021:0:54698:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xf:0x0].30, 136 off12272 00000100:00100000:1.0:1772305887.312068:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f7182bde pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+48:94689:x1858396225344576:12345-192.168.203.30@tcp:58:lfs.0 Request processed in 211us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305887.312074:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 700 00000040:00080000:3.0:1772305887.601263:0:67112:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305887.601269:0:67112:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305887.601357:0:67112:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 31 count 10 00000040:00080000:3.0:1772305887.601363:0:67112:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:3.0:1772305887.882718:0:54732:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005305bb6d pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:54732:1858396216597312:192.168.203.30@tcp:107:hsm_cdtr.0 00000040:00080000:3.0:1772305887.882791:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305887.882794:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305887.882857:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 31 count 10 00000040:00080000:3.0:1772305887.882864:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:1.0:1772305887.883253:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225344640 00000100:00100000:1.0:1772305887.883298:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 701 00000100:00100000:1.0:1772305887.883303:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ee2653a9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+59:94700:x1858396225344640:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1772305887.883325:0:54698:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x322:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1772305887.883380:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ee2653a9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+59:94700:x1858396225344640:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 76us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305887.883385:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 701 00000100:00100000:1.0:1772305887.884512:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225344768 00000100:00100000:1.0:1772305887.884541:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 702 00000100:00100000:1.0:1772305887.884548:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002fdda37a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+59:94700:x1858396225344768:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1772305887.884560:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305887.884579:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6eb82 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ec06 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.884688:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6eb89 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.884705:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6eb89 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.884716:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6eb89 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.884730:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6eb90 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xc5924575 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.884739:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6eb90 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xc5924575 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.884746:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6eb90 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xc5924575 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.884794:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6eb97 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x322:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.884802:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6eb97 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x322:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.884806:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6eb97 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x322:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1772305887.884813:0:54698:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x322:0x0]: returning size 0 00010000:00010000:1.0:1772305887.884887:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6eb89 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.884902:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6eb89 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.884909:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6eb89 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.884915:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006a4f0137 already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305887.884918:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6eb89 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.884926:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6eb89 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.884938:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (00000000c78481f6) 00010000:00010000:1.0:1772305887.884942:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305887.884946:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6eb89 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.884951:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6eb89 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.884960:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6eb90 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xc5924575 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.884963:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6eb90 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xc5924575 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.884967:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6eb90 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xc5924575 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.884979:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000748ac5ea already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305887.884980:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6eb90 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xc5924575 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.884984:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6eb90 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xc5924575 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.884988:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xc5924575 (00000000663af6c8) 00010000:00010000:1.0:1772305887.884990:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305887.884991:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6eb90 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xc5924575 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.884995:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6eb90 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xc5924575 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.885017:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6eb82 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec06 expref: 62 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.885024:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6eb97 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x322:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec06 expref: 61 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.885029:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x322:0x0].0x0 (000000003892ce01) 00010000:00010000:1.0:1772305887.885031:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1772305887.885032:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000295bd7c, rc 0) 00000100:00100000:1.0:1772305887.885058:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002fdda37a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+61:94700:x1858396225344768:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 512us (587us total) trans 8589934816 rc 0/0 00000100:00100000:1.0:1772305887.885063:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 702 00000100:00100000:3.0:1772305887.886100:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305887.886259:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305887.886299:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225344896 00000100:00100000:1.0:1772305887.886329:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5684 00000100:00100000:1.0:1772305887.886334:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000026c4ebe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2216:x1858396225344896:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1772305887.886356:0:10520:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a178fe80/0xa5e9c8c58c6eba5 lrc: 3/1,0 mode: --/PR res: [0x1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.886366:0:10520:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305887.886368:0:10520:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305887.886372:0:10520:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a178fe80/0xa5e9c8c58c6eba5 lrc: 3/1,0 mode: PR/PR res: [0x1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.886385:0:10520:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a178fe80/0xa5e9c8c58c6eba5 lrc: 3/1,0 mode: PR/PR res: [0x1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.886401:0:10520:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a178fe80/0xa5e9c8c58c6eba5 lrc: 3/1,0 mode: PR/PR res: [0x1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.886405:0:10520:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a178fe80/0xa5e9c8c58c6eba5 lrc: 2/0,0 mode: PR/PR res: [0x1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.886419:0:10520:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1772305887.886453:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000026c4ebe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2216:x1858396225344896:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 Request processed in 118us (195us total) trans 0 rc 0/0 00010000:00010000:3.0:1772305887.886458:0:38581:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1772305887.886458:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5684 00010000:00010000:3.0:1772305887.886466:0:38581:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a178fe80/0xa5e9c8c58c6eba5 lrc: 2/0,0 mode: PR/PR res: [0x1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305887.886477:0:38581:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a178fe80 already unused, calling callback (00000000b5e4f3c0) 00010000:00010000:3.0:1772305887.886487:0:38581:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a178fe80/0xa5e9c8c58c6eba5 lrc: 2/0,0 mode: PR/PR res: [0x1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305887.886495:0:38581:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a178fe80/0xa5e9c8c58c6eba5 lrc: 3/0,0 mode: PR/PR res: [0x1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305887.886508:0:38581:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a178fe80/0xa5e9c8c58c6eba5 lrc: 1/0,0 mode: --/PR res: [0x1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305887.886515:0:38581:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a178fe80/0xa5e9c8c58c6eba5 lrc: 0/0,0 mode: --/PR res: [0x1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305887.886527:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1772305887.886529:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1772305887.886532:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1772305887.887185:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305887.887227:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225345024 00000100:00100000:1.0:1772305887.887253:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 703 00000100:00100000:1.0:1772305887.887257:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a9712d04 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+60:94700:x1858396225345024:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1772305887.887311:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a9712d04 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+60:94700:x1858396225345024:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 52us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305887.887326:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 703 00000100:00100000:3.0:1772305887.888665:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305887.888688:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225345088 00000100:00100000:1.0:1772305887.888713:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 704 00000100:00100000:1.0:1772305887.888717:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ca19f1dd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+60:94700:x1858396225345088:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1772305887.888725:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305887.888736:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000017162762/0xa5e9c8c58c6ebac lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ec0d expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.888779:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000949f0123/0xa5e9c8c58c6ebb3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x322:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.888787:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000949f0123/0xa5e9c8c58c6ebb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x322:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.888793:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000949f0123/0xa5e9c8c58c6ebb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x322:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1772305887.888816:0:54698:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x322:0x0]: returning size 0 00000004:00200000:1.0:1772305887.888819:0:54698:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1772305887.888830:0:54698:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000949f0123/0xa5e9c8c58c6ebb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x322:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.888836:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000949f0123/0xa5e9c8c58c6ebb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x322:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.888848:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000017162762/0xa5e9c8c58c6ebac lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec0d expref: 62 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.888857:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000949f0123/0xa5e9c8c58c6ebb3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x322:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec0d expref: 61 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.888868:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x322:0x0].0x0 (000000003892ce01) 00010000:00010000:1.0:1772305887.888870:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1772305887.888872:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000949f0123, rc 0) 00000100:00100000:1.0:1772305887.888901:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ca19f1dd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+61:94700:x1858396225345088:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 182us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305887.888908:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 704 00000100:00100000:1.0:1772305887.889854:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225345152 00000100:00100000:1.0:1772305887.889879:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5685 00000100:00100000:1.0:1772305887.889883:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007e04257c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2215:x1858396225345152:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1772305887.889890:0:10520:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305887.889902:0:10520:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048d87789/0xa5e9c8c58c6ebba lrc: 2/0,0 mode: --/PR res: [0x1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ec14 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.889918:0:10520:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305887.889921:0:10520:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305887.889927:0:10520:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048d87789/0xa5e9c8c58c6ebba lrc: 3/0,0 mode: PR/PR res: [0x1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec14 expref: 228 pid: 10520 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1772305887.889940:0:10520:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000048d87789/0xa5e9c8c58c6ebba lrc: 3/0,0 mode: PR/PR res: [0x1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec14 expref: 228 pid: 10520 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1772305887.889950:0:10520:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000048d87789, rc 0) 00000100:00100000:1.0:1772305887.889977:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007e04257c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+228:2215:x1858396225345152:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 94us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305887.889982:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5685 00000100:00100000:3.0:1772305887.890880:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305887.890913:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225345280 00000100:00100000:1.0:1772305887.890941:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 705 00000100:00100000:1.0:1772305887.890945:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f63ede85 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+61:94700:x1858396225345280:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1772305887.890990:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f63ede85 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+61:94700:x1858396225345280:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 44us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305887.890999:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 705 00000100:00100000:3.0:1772305887.892135:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305887.892179:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225345344 00000100:00100000:1.0:1772305887.892217:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 706 00000100:00100000:1.0:1772305887.892222:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000059055e9c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+61:94700:x1858396225345344:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1772305887.892230:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305887.892241:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6ebc1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x322:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ec1b expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.892263:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6ebc8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x322:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.892274:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6ebc8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x322:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.892280:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6ebc8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x322:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.892339:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6ebc1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x322:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec1b expref: 63 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.892356:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6ebc8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x322:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec1b expref: 62 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.892377:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x322:0x0].0x0 (000000003892ce01) 00010000:00010000:1.0:1772305887.892379:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1772305887.892381:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000748ac5ea, rc 0) 00000100:00100000:1.0:1772305887.892418:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000059055e9c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+62:94700:x1858396225345344:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 195us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305887.892425:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 706 00000100:00100000:1.0:1772305887.893699:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225345408 00000100:00100000:1.0:1772305887.893742:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 707 00000100:00100000:1.0:1772305887.893747:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000080a03438 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+62:94700:x1858396225345408:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1772305887.893764:0:54698:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x322:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1772305887.893826:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000080a03438 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+62:94700:x1858396225345408:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 78us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305887.893834:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 707 00000100:00100000:3.0:1772305887.894715:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305887.894758:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225345472 00000100:00100000:1.0:1772305887.894798:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5686 00000100:00100000:1.0:1772305887.894803:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ccd4edae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+228:2216:x1858396225345472:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1772305887.894833:0:10520:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006a4f0137/0xa5e9c8c58c6ebcf lrc: 3/1,0 mode: --/PR res: [0x1ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.894846:0:10520:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305887.894848:0:10520:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305887.894853:0:10520:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a4f0137/0xa5e9c8c58c6ebcf lrc: 3/1,0 mode: PR/PR res: [0x1ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.894862:0:10520:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a4f0137/0xa5e9c8c58c6ebcf lrc: 3/1,0 mode: PR/PR res: [0x1ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.894896:0:10520:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006a4f0137/0xa5e9c8c58c6ebcf lrc: 3/1,0 mode: PR/PR res: [0x1ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.894905:0:10520:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a4f0137/0xa5e9c8c58c6ebcf lrc: 2/0,0 mode: PR/PR res: [0x1ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305887.894926:0:10520:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1772305887.894950:0:5497:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1772305887.894956:0:5497:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a4f0137/0xa5e9c8c58c6ebcf lrc: 2/0,0 mode: PR/PR res: [0x1ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305887.894968:0:5497:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006a4f0137 already unused, calling callback (00000000b5e4f3c0) 00010000:00010000:2.0:1772305887.894972:0:5497:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a4f0137/0xa5e9c8c58c6ebcf lrc: 2/0,0 mode: PR/PR res: [0x1ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305887.894978:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ccd4edae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+228:2216:x1858396225345472:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 Request processed in 171us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305887.894995:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5686 00010000:00010000:2.0:1772305887.894996:0:5497:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a4f0137/0xa5e9c8c58c6ebcf lrc: 3/0,0 mode: PR/PR res: [0x1ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305887.895026:0:5497:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a4f0137/0xa5e9c8c58c6ebcf lrc: 1/0,0 mode: --/PR res: [0x1ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305887.895034:0:5497:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a4f0137/0xa5e9c8c58c6ebcf lrc: 0/0,0 mode: --/PR res: [0x1ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305887.895047:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1772305887.895049:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1772305887.895051:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1772305887.895706:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305887.895749:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225345600 00000100:00100000:1.0:1772305887.895787:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 708 00000100:00100000:1.0:1772305887.895794:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000903941fe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+62:94700:x1858396225345600:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000040:00080000:1.0:1772305887.896058:0:54698:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x13:0x0].40, 168 off14768 00000040:00080000:1.0:1772305887.896203:0:54698:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x13:0x0].41, 168 off14936 00000001:00080000:1.0:1772305887.896210:0:54698:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934817 00000040:00080000:1.0:1772305887.896281:0:54698:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305887.896286:0:54698:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305887.896353:0:54698:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 31 count 10 00000040:00080000:1.0:1772305887.896363:0:54698:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:1.0:1772305887.896432:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000903941fe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+63:94700:x1858396225345600:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 636us (724us total) trans 8589934817 rc 0/0 00000100:00100000:1.0:1772305887.896441:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 708 00000040:00080000:3.0:1772305887.896498:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305887.896502:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305887.897030:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 10 00000040:00080000:3.0:1772305887.897036:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:2.0:1772305887.897384:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225345728 00000100:00100000:2.0:1772305887.897413:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 89 00000100:00100000:2.0:1772305887.897417:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000025a49646 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+63:94700:x1858396225345728:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1772305887.897584:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000025a49646 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+64:94700:x1858396225345728:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 164us (240us total) trans 8589934818 rc 0/0 00000100:00100000:2.0:1772305887.897592:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 89 00000100:00100000:3.0:1772305888.324010:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225345792 00000100:00100000:3.0:1772305888.324065:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 132 00000100:00100000:1.0:1772305888.324065:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225345856 00000100:00100000:3.0:1772305888.324076:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000088bb74d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2215:x1858396225345792:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1772305888.324106:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 124 00000100:00100000:1.0:1772305888.324115:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000013b6c8cf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+64:2216:x1858396225345856:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1772305888.324116:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225345920 00000100:00100000:2.0:1772305888.324161:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225345984 00000100:00100000:3.0:1772305888.324165:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000088bb74d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2215:x1858396225345792:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 88us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305888.324178:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 132 00000100:00100000:1.0:1772305888.324195:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000013b6c8cf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+64:2216:x1858396225345856:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 79us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305888.324198:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225346112 00000100:00100000:1.0:1772305888.324208:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 124 00000100:00100000:2.0:1772305888.324237:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1151 00000100:00100000:3.0:1772305888.324238:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225346048 00000100:00100000:2.0:1772305888.324247:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000052a7c972 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+222:2215:x1858396225345920:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:3.0:1772305888.324273:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 125 00000100:00100000:3.0:1772305888.324280:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005305bb6d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+48:2215:x1858396225346048:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1772305888.324287:0:48470:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225346176 00000100:00100000:2.0:1772305888.324288:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000052a7c972 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+222:2215:x1858396225345920:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 40us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305888.324299:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1151 00000100:00100000:3.0:1772305888.324317:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005305bb6d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+48:2215:x1858396225346048:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 36us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305888.324325:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1152 00000100:00100000:3.0:1772305888.324326:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 125 00000100:00100000:1.0:1772305888.324336:0:48470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1153 00000100:00100000:2.0:1772305888.324340:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009b761bc8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+228:2216:x1858396225345984:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1772305888.324346:0:48470:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000016a92645 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f935b4d0-e17f-49c8-8011-4be99ba75430+160:2216:x1858396225346112:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:3.0:1772305888.324355:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1154 00000100:00100000:3.0:1772305888.324361:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b830b726 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+141:2215:x1858396225346176:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1772305888.324389:0:48470:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000016a92645 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f935b4d0-e17f-49c8-8011-4be99ba75430+160:2216:x1858396225346112:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 43us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305888.324397:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009b761bc8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+228:2216:x1858396225345984:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 60us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305888.324400:0:48470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1153 00000100:00100000:2.0:1772305888.324412:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1152 00000100:00100000:3.0:1772305888.324449:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b830b726 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+141:2215:x1858396225346176:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 85us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305888.324459:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1154 00000100:00100000:1.0:1772305888.918140:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225346304 00000100:00100000:1.0:1772305888.918197:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 709 00000100:00100000:1.0:1772305888.918206:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000082992e06 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+48:94709:x1858396225346304:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1772305888.918228:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305888.918247:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6ebd6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x322:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ec22 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305888.918341:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000017162762/0xa5e9c8c58c6ebdd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x322:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305888.918357:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000017162762/0xa5e9c8c58c6ebdd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x322:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305888.918371:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000017162762/0xa5e9c8c58c6ebdd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x322:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1772305888.918385:0:54698:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x322:0x0]: returning size 0 00010000:00010000:1.0:1772305888.918494:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6ebd6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x322:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec22 expref: 51 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305888.918515:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000017162762/0xa5e9c8c58c6ebdd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x322:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec22 expref: 50 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305888.918523:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x322:0x0].0x0 (000000003892ce01) 00010000:00010000:1.0:1772305888.918526:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1772305888.918529:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000017162762, rc 0) 00000100:00100000:1.0:1772305888.918587:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000082992e06 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+50:94709:x1858396225346304:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 381us (510us total) trans 8589934819 rc 0/0 00000100:00100000:1.0:1772305888.918595:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 709 00000100:00100000:2.0:1772305888.919920:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305888.919965:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225346368 00000100:00100000:3.0:1772305888.920012:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5687 00000100:00100000:3.0:1772305888.920018:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000068687bb0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+141:2218:x1858396225346368:12345-192.168.203.30@tcp:1:lfs.0 00010000:00010000:3.0:1772305888.920051:0:6307:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009fea887/0xa5e9c8c58c6ebeb lrc: 3/0,1 mode: --/PW res: [0x1ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305888.920069:0:6307:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6eb5f lrc: 2/0,0 mode: PR/PR res: [0x1ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ebf1 expref: 141 pid: 10520 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1772305888.920079:0:6307:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000048d87789/0xa5e9c8c58c6ebba lrc: 2/0,0 mode: PR/PR res: [0x1ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec14 expref: 227 pid: 10520 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1772305888.920096:0:6307:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1772305888.920099:0:6307:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1772305888.920101:0:6307:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009fea887/0xa5e9c8c58c6ebeb lrc: 5/0,1 mode: --/PW res: [0x1ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305888.920137:0:6307:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000048d87789/0xa5e9c8c58c6ebba lrc: 3/0,0 mode: PR/PR res: [0x1ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec14 expref: 227 pid: 10520 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1772305888.920149:0:6307:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000048d87789/0xa5e9c8c58c6ebba lrc: 4/0,0 mode: PR/PR res: [0x1ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec14 expref: 227 pid: 10520 timeout: 1300 lvb_type: 1 00000100:00100000:3.0:1772305888.920161:0:6307:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f45a42e9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6307:1858396216597376:192.168.203.30@tcp:104: 00010000:00010000:3.0:1772305888.920237:0:6307:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6eb5f lrc: 3/0,0 mode: PR/PR res: [0x1ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ebf1 expref: 141 pid: 10520 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1772305888.920246:0:6307:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6eb5f lrc: 4/0,0 mode: PR/PR res: [0x1ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ebf1 expref: 141 pid: 10520 timeout: 1300 lvb_type: 1 00000100:00100000:3.0:1772305888.920257:0:6307:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005215dd7f pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6307:1858396216597440:192.168.203.30@tcp:104: 00000100:00100000:3.0:1772305888.920286:0:6307:0:(client.c:2500:ptlrpc_set_wait()) set 00000000cccfd3c0 going to sleep for 6 seconds 00000100:00100000:3.0:1772305888.921480:0:6307:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005215dd7f pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6307:1858396216597440:192.168.203.30@tcp:104: 00000100:00100000:3.0:1772305888.921984:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305888.922029:0:7104:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225346432 00010000:00010000:2.0:1772305888.922054:0:7104:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6eb5f lrc: 4/0,0 mode: PR/PR res: [0x1ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ebf1 expref: 142 pid: 10520 timeout: 1300 lvb_type: 1 00000100:00100000:2.0:1772305888.922094:0:7104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3062 00000100:00100000:2.0:1772305888.922102:0:7104:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cba49044 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+142:2216:x1858396225346432:12345-192.168.203.30@tcp:103:ldlm_bl_06.0 00000100:00100000:1.0:1772305888.922113:0:6307:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f45a42e9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6307:1858396216597376:192.168.203.30@tcp:104: 00010000:00010000:2.0:1772305888.922114:0:7104:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1772305888.922136:0:7104:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6eb5f lrc: 4/0,0 mode: PR/PR res: [0x1ac:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ebf1 expref: 142 pid: 10520 timeout: 1300 lvb_type: 1 00010000:00010000:1.0:1772305888.922141:0:6307:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000009fea887/0xa5e9c8c58c6ebeb lrc: 3/0,1 mode: --/PW res: [0x1ac:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305888.922153:0:7104:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6eb5f lrc: 3/0,0 mode: PR/PR res: [0x1ac:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ebf1 expref: 142 pid: 10520 timeout: 1300 lvb_type: 1 00010000:00010000:2.0:1772305888.922190:0:7104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6eb5f lrc: 0/0,0 mode: --/PR res: [0x1ac:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ebf1 expref: 142 pid: 10520 timeout: 1300 lvb_type: 1 00010000:00010000:2.0:1772305888.922208:0:7104:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1772305888.922247:0:7104:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cba49044 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+141:2216:x1858396225346432:12345-192.168.203.30@tcp:103:ldlm_bl_06.0 Request processed in 146us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305888.922255:0:7104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3062 00000100:00100000:1.0:1772305888.922356:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305888.922381:0:7104:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225346496 00010000:00010000:2.0:1772305888.922399:0:7104:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000048d87789/0xa5e9c8c58c6ebba lrc: 4/0,0 mode: PR/PR res: [0x1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec14 expref: 228 pid: 10520 timeout: 1300 lvb_type: 1 00000100:00100000:2.0:1772305888.922457:0:7104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3063 00000100:00100000:2.0:1772305888.922463:0:7104:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b2b1cc4f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+228:2215:x1858396225346496:12345-192.168.203.30@tcp:103:ldlm_bl_07.0 00010000:00010000:2.0:1772305888.922473:0:7104:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1772305888.922482:0:7104:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000048d87789/0xa5e9c8c58c6ebba lrc: 4/0,0 mode: PR/PR res: [0x1ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec14 expref: 228 pid: 10520 timeout: 1300 lvb_type: 1 00010000:00010000:2.0:1772305888.922493:0:7104:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000048d87789/0xa5e9c8c58c6ebba lrc: 3/0,0 mode: PR/PR res: [0x1ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec14 expref: 228 pid: 10520 timeout: 1300 lvb_type: 1 00010000:00010000:2.0:1772305888.922510:0:7104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048d87789/0xa5e9c8c58c6ebba lrc: 0/0,0 mode: --/PR res: [0x1ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec14 expref: 228 pid: 10520 timeout: 1300 lvb_type: 1 00010000:00010000:2.0:1772305888.922521:0:7104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1772305888.922523:0:7104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1772305888.922526:0:7104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009fea887/0xa5e9c8c58c6ebeb lrc: 3/0,1 mode: PW/PW res: [0x1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305888.922535:0:7104:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009fea887/0xa5e9c8c58c6ebeb lrc: 4/0,1 mode: PW/PW res: [0x1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305888.922562:0:7104:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1772305888.922589:0:6307:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000009fea887/0xa5e9c8c58c6ebeb lrc: 3/0,1 mode: PW/PW res: [0x1ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305888.922594:0:7104:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b2b1cc4f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2215:x1858396225346496:12345-192.168.203.30@tcp:103:ldlm_bl_07.0 Request processed in 128us (237us total) trans 0 rc 0/0 00010000:00010000:1.0:1772305888.922610:0:6307:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009fea887/0xa5e9c8c58c6ebeb lrc: 3/0,1 mode: PW/PW res: [0x1ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305888.922611:0:7104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3063 00010000:00010000:1.0:1772305888.922674:0:6307:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009fea887/0xa5e9c8c58c6ebeb lrc: 3/0,1 mode: PW/PW res: [0x1ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305888.922683:0:6307:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009fea887/0xa5e9c8c58c6ebeb lrc: 2/0,0 mode: PW/PW res: [0x1ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305888.922714:0:6307:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1772305888.922759:0:5496:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1772305888.922764:0:5496:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009fea887/0xa5e9c8c58c6ebeb lrc: 3/0,0 mode: PW/PW res: [0x1ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305888.922788:0:5496:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000009fea887 already unused, calling callback (00000000b5e4f3c0) 00010000:00010000:3.0:1772305888.922792:0:5496:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009fea887/0xa5e9c8c58c6ebeb lrc: 3/0,0 mode: PW/PW res: [0x1ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305888.922800:0:5496:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009fea887/0xa5e9c8c58c6ebeb lrc: 4/0,0 mode: PW/PW res: [0x1ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305888.922814:0:5496:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009fea887/0xa5e9c8c58c6ebeb lrc: 2/0,0 mode: --/PW res: [0x1ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305888.922822:0:5496:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009fea887/0xa5e9c8c58c6ebeb lrc: 0/0,0 mode: --/PW res: [0x1ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305888.922844:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1772305888.922846:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1772305888.922847:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772305888.922859:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000068687bb0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+140:2218:x1858396225346368:12345-192.168.203.30@tcp:1:lfs.0 Request processed in 2839us (2941us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305888.922869:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5687 00000100:00100000:1.0:1772305888.923698:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305888.923733:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225346624 00000100:00100000:2.0:1772305888.923783:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 90 00000100:00100000:2.0:1772305888.923790:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000830ec897 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+50:94709:x1858396225346624:12345-192.168.203.30@tcp:35:lfs.0 00000004:00010000:2.0:1772305888.923841:0:57054:0:(mdt_open.c:1862:mdt_hsm_release()) ### [0x200000402:0x322:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: 0000000017162762/0xa5e9c8c58c6ebdd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x322:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec22 expref: 50 pid: 54698 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1772305888.924075:0:57054:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x13:0x0].42, 168 off15104 00000001:00080000:2.0:1772305888.924178:0:57054:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934820 00000001:00080000:2.0:1772305888.924674:0:57054:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934820 00010000:00010000:2.0:1772305888.924728:0:57054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6ebf2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x322:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305888.924744:0:57054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000466ce4ab/0xa5e9c8c58c6ead3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x322:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ebc7 expref: 63 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305888.924755:0:57054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6eb58 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x322:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ebea expref: 51 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305888.924763:0:57054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000949f0123/0xa5e9c8c58c6ebb3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x322:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec0d expref: 63 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305888.924771:0:57054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6ebc8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x322:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec1b expref: 63 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305888.924778:0:57054:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6ebf2 lrc: 7/0,1 mode: --/EX res: [0x200000402:0x322:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305888.924808:0:57054:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6ebc8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x322:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec1b expref: 63 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305888.924821:0:57054:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6ebc8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x322:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec1b expref: 63 pid: 54698 timeout: 1300 lvb_type: 0 00000100:00100000:2.0:1772305888.924843:0:57054:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b82f8f38 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:57054:1858396216597504:192.168.203.30@tcp:104: 00010000:00010000:2.0:1772305888.924909:0:57054:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000949f0123/0xa5e9c8c58c6ebb3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x322:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec0d expref: 63 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305888.924920:0:57054:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000949f0123/0xa5e9c8c58c6ebb3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x322:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec0d expref: 63 pid: 54698 timeout: 1300 lvb_type: 0 00000100:00100000:2.0:1772305888.924931:0:57054:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003397d536 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:57054:1858396216597568:192.168.203.30@tcp:104: 00010000:00010000:2.0:1772305888.924971:0:57054:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6eb58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x322:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ebea expref: 51 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305888.924983:0:57054:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6eb58 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x322:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ebea expref: 51 pid: 54698 timeout: 1300 lvb_type: 0 00000100:00100000:2.0:1772305888.924993:0:57054:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d12426c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:57054:1858396216597632:192.168.203.30@tcp:104: 00010000:00010000:2.0:1772305888.925034:0:57054:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000466ce4ab/0xa5e9c8c58c6ead3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x322:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ebc7 expref: 63 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305888.925043:0:57054:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000466ce4ab/0xa5e9c8c58c6ead3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x322:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ebc7 expref: 63 pid: 54698 timeout: 1300 lvb_type: 0 00000100:00100000:2.0:1772305888.925054:0:57054:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d6661384 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:57054:1858396216597696:192.168.203.30@tcp:104: 00000100:00100000:2.0:1772305888.925081:0:57054:0:(client.c:2500:ptlrpc_set_wait()) set 000000005a045cf4 going to sleep for 6 seconds 00000100:00100000:2.0:1772305888.925779:0:57054:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b82f8f38 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:57054:1858396216597504:192.168.203.30@tcp:104: 00000100:00100000:2.0:1772305888.926066:0:57054:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003397d536 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:57054:1858396216597568:192.168.203.30@tcp:104: 00000100:00100000:2.0:1772305888.926082:0:57054:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d12426c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:57054:1858396216597632:192.168.203.30@tcp:104: 00000100:00100000:2.0:1772305888.926091:0:57054:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d6661384 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:57054:1858396216597696:192.168.203.30@tcp:104: 00010000:00010000:2.0:1772305888.926116:0:57054:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6ebf2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x322:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305888.926358:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305888.926394:0:7104:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225346688 00000100:00100000:2.0:1772305888.926395:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00010000:3.0:1772305888.926418:0:7104:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6ebc8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x322:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec1b expref: 64 pid: 54698 timeout: 1300 lvb_type: 0 00000100:00100000:2.0:1772305888.926430:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305888.926451:0:7104:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225346752 00000100:00100000:1.0:1772305888.926464:0:5494:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225346816 00010000:00010000:3.0:1772305888.926468:0:7104:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000949f0123/0xa5e9c8c58c6ebb3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x322:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec0d expref: 65 pid: 54698 timeout: 1300 lvb_type: 0 00010000:00010000:1.0:1772305888.926486:0:5494:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6eb58 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x322:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ebea expref: 52 pid: 54698 timeout: 1300 lvb_type: 0 00000100:00100000:3.0:1772305888.926500:0:7104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3064 00000100:00100000:2.0:1772305888.926505:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305888.926512:0:7104:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d6661384 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+65:2216:x1858396225346688:12345-192.168.203.30@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1772305888.926526:0:7104:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1772305888.926528:0:5494:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225346880 00010000:00010000:3.0:1772305888.926540:0:7104:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6ebc8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x322:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec1b expref: 66 pid: 54698 timeout: 1300 lvb_type: 0 00000100:00100000:2.0:1772305888.926543:0:6323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3065 00010000:00010000:1.0:1772305888.926545:0:5494:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000466ce4ab/0xa5e9c8c58c6ead3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x322:0x0].0x0 bits 0x9/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ebc7 expref: 66 pid: 54698 timeout: 1300 lvb_type: 0 00000100:00100000:2.0:1772305888.926556:0:6323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d12426c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+66:2215:x1858396225346752:12345-192.168.203.30@tcp:103:ldlm_bl_04.0 00010000:00010000:2.0:1772305888.926572:0:6323:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1772305888.926580:0:6323:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000949f0123/0xa5e9c8c58c6ebb3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x322:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec0d expref: 66 pid: 54698 timeout: 1300 lvb_type: 0 00000100:00100000:1.0:1772305888.926583:0:5494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3066 00000100:00100000:1.0:1772305888.926593:0:5494:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003397d536 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+52:2216:x1858396225346816:12345-192.168.203.30@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1772305888.926598:0:6323:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000949f0123/0xa5e9c8c58c6ebb3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x322:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec0d expref: 66 pid: 54698 timeout: 1300 lvb_type: 0 00010000:00010000:1.0:1772305888.926605:0:5494:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1772305888.926613:0:5494:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6eb58 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x322:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ebea expref: 52 pid: 54698 timeout: 1300 lvb_type: 0 00010000:00010000:2.0:1772305888.926618:0:6323:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000949f0123/0xa5e9c8c58c6ebb3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x322:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec0d expref: 66 pid: 54698 timeout: 1300 lvb_type: 0 00010000:00010000:3.0:1772305888.926663:0:7104:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6ebc8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x322:0x0].0x0 bits 0x20/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec1b expref: 66 pid: 54698 timeout: 1300 lvb_type: 0 00010000:00010000:1.0:1772305888.926688:0:5494:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6eb58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x322:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ebea expref: 52 pid: 54698 timeout: 1300 lvb_type: 0 00010000:00010000:2.0:1772305888.926706:0:6323:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x322:0x0].0x0 (000000003892ce01) 00010000:00010000:3.0:1772305888.926708:0:7104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6ebc8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x322:0x0].0x0 bits 0x20/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec1b expref: 65 pid: 54698 timeout: 1300 lvb_type: 0 00010000:00010000:2.0:1772305888.926713:0:6323:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6ebf2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x322:0x0].0x0 bits 0x28/0x0 rrc: 10 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305888.926739:0:6323:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6ebf2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x322:0x0].0x0 bits 0x28/0x0 rrc: 8 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305888.926747:0:6323:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1772305888.926754:0:7104:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x322:0x0].0x0 (000000003892ce01) 00010000:00010000:1.0:1772305888.926756:0:5494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6eb58 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x322:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ebea expref: 52 pid: 54698 timeout: 1300 lvb_type: 0 00010000:00010000:3.0:1772305888.926761:0:7104:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6ebf2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x322:0x0].0x0 bits 0x28/0x0 rrc: 8 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305888.926778:0:7104:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6ebf2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x322:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305888.926785:0:6323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d12426c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+64:2215:x1858396225346752:12345-192.168.203.30@tcp:103:ldlm_bl_04.0 Request processed in 228us (386us total) trans 0 rc 0/0 00010000:00010000:3.0:1772305888.926796:0:7104:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1772305888.926797:0:5494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x322:0x0].0x0 (000000003892ce01) 00000100:00100000:2.0:1772305888.926800:0:6323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3065 00010000:00010000:1.0:1772305888.926809:0:5494:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6ebf2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x322:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305888.926818:0:5494:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6ebf2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x322:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305888.926828:0:6323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3067 00000100:00100000:3.0:1772305888.926831:0:7104:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d6661384 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+63:2216:x1858396225346688:12345-192.168.203.30@tcp:103:ldlm_bl_03.0 Request processed in 316us (470us total) trans 0 rc 0/0 00010000:00010000:1.0:1772305888.926832:0:5494:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1772305888.926839:0:6323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b82f8f38 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+63:2217:x1858396225346880:12345-192.168.203.30@tcp:103:ldlm_bl_01.0 00000100:00100000:3.0:1772305888.926847:0:7104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3064 00010000:00010000:2.0:1772305888.926850:0:6323:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1772305888.926858:0:6323:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000466ce4ab/0xa5e9c8c58c6ead3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x322:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ebc7 expref: 63 pid: 54698 timeout: 1300 lvb_type: 0 00000100:00100000:1.0:1772305888.926866:0:5494:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003397d536 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+51:2216:x1858396225346816:12345-192.168.203.30@tcp:103:ldlm_bl_03.0 Request processed in 269us (433us total) trans 0 rc 0/0 00010000:00010000:2.0:1772305888.926877:0:6323:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000466ce4ab/0xa5e9c8c58c6ead3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x322:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ebc7 expref: 62 pid: 54698 timeout: 1300 lvb_type: 0 00000100:00100000:1.0:1772305888.926882:0:5494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3066 00010000:00010000:2.0:1772305888.926898:0:6323:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000466ce4ab/0xa5e9c8c58c6ead3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x322:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ebc7 expref: 62 pid: 54698 timeout: 1300 lvb_type: 0 00010000:00010000:2.0:1772305888.926910:0:6323:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x322:0x0].0x0 (000000003892ce01) 00010000:00010000:2.0:1772305888.926914:0:6323:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6ebf2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x322:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305888.926922:0:6323:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6ebf2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x322:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305888.926930:0:6323:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6ebf2 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x322:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305888.926962:0:6323:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1772305888.926980:0:57054:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6ebf2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x322:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305888.926987:0:6323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b82f8f38 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+61:2217:x1858396225346880:12345-192.168.203.30@tcp:103:ldlm_bl_01.0 Request processed in 148us (487us total) trans 0 rc 0/0 00010000:00010000:3.0:1772305888.927000:0:57054:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6ebf2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x322:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305888.927004:0:6323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3067 00000001:00080000:3.0:1772305888.927176:0:57054:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934820 00000040:00080000:3.0:1772305888.927537:0:57054:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x13:0x0].43, 168 off15272 00000040:00080000:3.0:1772305888.927581:0:57054:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x13:0x0].44, 168 off15440 00000001:00080000:3.0:1772305888.927588:0:57054:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934820 00000100:00100000:3.0:1772305888.927747:0:57054:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004f1a5774 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:57054:1858396216597760:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1772305888.927789:0:57054:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305888.927814:0:57054:0:(client.c:2500:ptlrpc_set_wait()) set 00000000da4e042e going to sleep for 6 seconds 00000100:00100000:1.0:1772305888.927835:0:57220:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216597760 00000100:00100000:1.0:1772305888.927871:0:57220:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1772305888.927875:0:57220:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c2aa533e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:57054:x1858396216597760:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1772305888.927942:0:57220:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c2aa533e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:57054:x1858396216597760:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 66us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305888.927950:0:57220:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1772305888.927992:0:57054:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004f1a5774 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:57054:1858396216597760:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:3.0:1772305888.928120:0:57054:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934820 00000001:00080000:3.0:1772305888.928210:0:57054:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934820 00010000:00010000:3.0:1772305888.928227:0:57054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6ebf2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x322:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305888.928238:0:57054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6ebf2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x322:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305888.928246:0:57054:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6ebf2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x322:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305888.928252:0:57054:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000059b20141 already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305888.928255:0:57054:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6ebf2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x322:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305888.928262:0:57054:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6ebf2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x322:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305888.928273:0:57054:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x322:0x0].0x0 (000000003892ce01) 00010000:00010000:3.0:1772305888.928276:0:57054:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1772305888.928279:0:57054:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6ebf2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x322:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305888.928286:0:57054:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6ebf2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x322:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1772305888.928552:0:57054:0:(mdd_object.c:3529:mdd_close()) Object [0x200000408:0x89:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1772305888.928735:0:57054:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xd:0x0].9, 64 off8816 00000004:00080000:3.0:1772305888.928744:0:57054:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1200823116206ns, next at 1201823112883ns, rc = 0 00000001:00080000:3.0:1772305888.928753:0:57054:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934820 00010000:00010000:3.0:1772305888.928851:0:57054:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x322:0x0].0x0 (000000003892ce01) 00010000:00010000:3.0:1772305888.928856:0:57054:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1772305888.928863:0:57054:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000017162762/0xa5e9c8c58c6ebdd lrc: 0/0,0 mode: --/PW res: [0x200000402:0x322:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec22 expref: 50 pid: 54698 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1772305888.928980:0:57054:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x13:0x0].45, 168 off15608 00000001:00080000:3.0:1772305888.928985:0:57054:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934820 00000100:00100000:3.0:1772305888.929064:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000830ec897 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+49:94709:x1858396225346624:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 5274us (5367us total) trans 8589934820 rc 0/0 00000100:00100000:3.0:1772305888.929072:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 90 00010000:00010000:3.0:1772305888.968759:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1772305888.978269:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305888.978362:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225346944 00000100:00100000:1.0:1772305888.978422:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 710 00000100:00100000:1.0:1772305888.978430:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006f4c803f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+49:94718:x1858396225346944:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1772305888.978454:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305888.978472:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6ebf9 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x88:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ec29 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305888.978519:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6ec00 lrc: 3/1,0 mode: --/CR res: [0x200000408:0x88:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305888.978531:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6ec00 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x88:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305888.978552:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6ec00 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x88:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305888.978562:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000367b2753/0xa5e9c8c58c6ec07 lrc: 3/1,0 mode: --/PR res: [0x200000408:0x88:0x0].0x46626822 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305888.978567:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000367b2753/0xa5e9c8c58c6ec07 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x88:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305888.978571:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000367b2753/0xa5e9c8c58c6ec07 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x88:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305888.978730:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6ec0e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x322:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305888.978736:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6ec0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x322:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305888.978741:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6ec0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x322:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1772305888.978766:0:54698:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x322:0x0]: returning size 0 00000004:00200000:1.0:1772305888.978769:0:54698:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1772305888.978782:0:54698:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6ec0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x322:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305888.978798:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6ec0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x322:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305888.978803:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6ec00 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x88:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305888.978814:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6ec00 lrc: 2/0,0 mode: CR/CR res: [0x200000408:0x88:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305888.978818:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6ec00 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x88:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305888.978822:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000089168eb already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305888.978825:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6ec00 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x88:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305888.978830:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6ec00 lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x88:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305888.978839:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x88:0x0].0x0 (00000000af7c637f) 00010000:00010000:1.0:1772305888.978841:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305888.978843:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6ec00 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x88:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305888.978847:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6ec00 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x88:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305888.978855:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000367b2753/0xa5e9c8c58c6ec07 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x88:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305888.978859:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000367b2753/0xa5e9c8c58c6ec07 lrc: 2/0,0 mode: PR/PR res: [0x200000408:0x88:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305888.978863:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000367b2753/0xa5e9c8c58c6ec07 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x88:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305888.978873:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000367b2753 already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305888.978874:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000367b2753/0xa5e9c8c58c6ec07 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x88:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305888.978878:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000367b2753/0xa5e9c8c58c6ec07 lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x88:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305888.978882:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x88:0x0].0x46626822 (00000000663af6c8) 00010000:00010000:1.0:1772305888.978883:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305888.978884:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000367b2753/0xa5e9c8c58c6ec07 lrc: 2/0,0 mode: --/PR res: [0x200000408:0x88:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305888.978888:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000367b2753/0xa5e9c8c58c6ec07 lrc: 0/0,0 mode: --/PR res: [0x200000408:0x88:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305888.978916:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6ebf9 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x88:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec29 expref: 51 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305888.978928:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6ec0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x322:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec29 expref: 50 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305888.978935:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x322:0x0].0x0 (0000000060b58ddc) 00010000:00010000:1.0:1772305888.978937:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1772305888.978939:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a84c62ba, rc 0) 00000100:00100000:1.0:1772305888.978988:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006f4c803f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+50:94718:x1858396225346944:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 559us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305888.978994:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 710 00000100:00100000:1.0:1772305888.981429:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305888.981475:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225347072 00000100:00100000:3.0:1772305888.981502:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 711 00000100:00100000:3.0:1772305888.981506:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000676f9e41 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+50:94718:x1858396225347072:12345-192.168.203.30@tcp:58:lfs.0 00010000:00010000:3.0:1772305888.981547:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6ec15 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x322:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305888.981558:0:54698:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6ec0e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x322:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec29 expref: 50 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305888.981563:0:54698:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6ec15 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x322:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305888.981598:0:54698:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6ec0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x322:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec29 expref: 50 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305888.981607:0:54698:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6ec0e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x322:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec29 expref: 50 pid: 54698 timeout: 1300 lvb_type: 0 00000100:00100000:3.0:1772305888.981616:0:54698:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004f1a5774 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:54698:1858396216597824:192.168.203.30@tcp:104: 00000100:00100000:3.0:1772305888.981701:0:54698:0:(client.c:2500:ptlrpc_set_wait()) set 00000000b81e9b83 going to sleep for 6 seconds 00000100:00100000:3.0:1772305888.982477:0:54698:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004f1a5774 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:54698:1858396216597824:192.168.203.30@tcp:104: 00010000:00010000:3.0:1772305888.982493:0:54698:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6ec15 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x322:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305888.982620:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305888.982698:0:6323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225347136 00010000:00010000:2.0:1772305888.982719:0:6323:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6ec0e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x322:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec29 expref: 51 pid: 54698 timeout: 1300 lvb_type: 0 00000100:00100000:2.0:1772305888.982756:0:6323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3068 00000100:00100000:2.0:1772305888.982761:0:6323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f92b146e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+51:2215:x1858396225347136:12345-192.168.203.30@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1772305888.982772:0:6323:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1772305888.982779:0:6323:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6ec0e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x322:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec29 expref: 51 pid: 54698 timeout: 1300 lvb_type: 0 00010000:00010000:2.0:1772305888.982790:0:6323:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6ec0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x322:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec29 expref: 51 pid: 54698 timeout: 1300 lvb_type: 0 00010000:00010000:2.0:1772305888.982805:0:6323:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6ec0e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x322:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec29 expref: 51 pid: 54698 timeout: 1300 lvb_type: 0 00010000:00010000:2.0:1772305888.982818:0:6323:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x322:0x0].0x0 (0000000060b58ddc) 00010000:00010000:2.0:1772305888.982822:0:6323:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6ec15 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x322:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305888.982830:0:6323:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6ec15 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x322:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305888.982851:0:6323:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6ec15 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x322:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305888.982876:0:6323:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1772305888.982913:0:54698:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6ec15 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x322:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305888.982914:0:6323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f92b146e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+50:2215:x1858396225347136:12345-192.168.203.30@tcp:103:ldlm_bl_02.0 Request processed in 149us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305888.982930:0:6323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3068 00010000:00010000:3.0:1772305888.982931:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6ec15 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x322:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1772305888.983112:0:54698:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xf:0x0].31, 136 off12408 00000100:00100000:3.0:1772305888.983157:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000676f9e41 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+49:94718:x1858396225347072:12345-192.168.203.30@tcp:58:lfs.0 Request processed in 1649us (1731us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305888.983163:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 711 00000100:00100000:3.0:1772305889.930413:0:54732:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000df58eb45 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:54732:1858396216597888:192.168.203.30@tcp:107:hsm_cdtr.0 00000040:00080000:3.0:1772305889.930480:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305889.930483:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305889.930557:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 32 count 11 00000040:00080000:3.0:1772305889.930572:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:2.0:1772305889.992799:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1772305890.266288:0:54724:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934815 is committed 00000001:00080000:3.0:1772305890.266313:0:54724:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934819 is committed 00000001:00080000:3.0:1772305890.266326:0:54724:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934817 is committed 00000001:00080000:3.0:1772305890.266341:0:54724:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934820 is committed 00000001:00080000:3.0:1772305890.266346:0:54724:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934818 is committed 00000004:00080000:3.0:1772305890.266367:0:54724:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000100:00100000:1.0:1772305890.266598:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216597952 00000100:00100000:1.0:1772305890.266692:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5688 00000100:00100000:1.0:1772305890.266701:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c412627e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216597952:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1772305890.266729:0:6307:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:428 count 1 00002000:00010000:1.0:1772305890.266759:0:6307:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x1ac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1772305890.266766:0:6307:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6ec1c lrc: 3/0,1 mode: --/PW res: [0x1ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305890.266778:0:6307:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305890.266781:0:6307:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305890.266785:0:6307:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6ec1c lrc: 3/0,1 mode: PW/PW res: [0x1ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305890.266798:0:6307:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6ec1c lrc: 3/0,1 mode: PW/PW res: [0x1ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305890.266807:0:6307:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6ec1c lrc: 3/0,1 mode: PW/PW res: [0x1ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305890.266815:0:6307:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6ec1c lrc: 2/0,0 mode: PW/PW res: [0x1ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305890.266834:0:6307:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1772305890.267341:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c412627e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:2994:x1858396216597952:12345-0@lo:6:osp-syn-1-0.0 Request processed in 639us (781us total) trans 4294968342 rc 0/0 00000100:00100000:1.0:1772305890.267349:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5688 00000040:00080000:3.0:1772305890.574981:0:67271:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305890.574985:0:67271:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305890.575032:0:67271:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 32 count 11 00000040:00080000:3.0:1772305890.575036:0:67271:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:3.0:1772305890.591957:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305890.592008:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225347200 00000100:00100000:1.0:1772305890.592070:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 712 00000100:00100000:1.0:1772305890.592089:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004f1a5774 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+46:94736:x1858396225347200:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1772305890.592110:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305890.592132:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000367b2753/0xa5e9c8c58c6ec23 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x88:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ec30 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305890.592190:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6ec2a lrc: 3/1,0 mode: --/CR res: [0x200000408:0x88:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305890.592204:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6ec2a lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x88:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305890.592218:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6ec2a lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x88:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305890.592234:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e326753f/0xa5e9c8c58c6ec31 lrc: 3/1,0 mode: --/PR res: [0x200000408:0x88:0x0].0x46626822 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305890.592241:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e326753f/0xa5e9c8c58c6ec31 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x88:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305890.592247:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e326753f/0xa5e9c8c58c6ec31 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x88:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305890.592376:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000008260c3b/0xa5e9c8c58c6ec38 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x322:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305890.592386:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000008260c3b/0xa5e9c8c58c6ec38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x322:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305890.592394:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000008260c3b/0xa5e9c8c58c6ec38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x322:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1772305890.592437:0:54698:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x322:0x0]: returning size 0 00000004:00200000:1.0:1772305890.592441:0:54698:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1772305890.592458:0:54698:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 0000000008260c3b/0xa5e9c8c58c6ec38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x322:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305890.592469:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000008260c3b/0xa5e9c8c58c6ec38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x322:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305890.592477:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6ec2a lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x88:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305890.592483:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6ec2a lrc: 2/0,0 mode: CR/CR res: [0x200000408:0x88:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305890.592490:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6ec2a lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x88:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305890.592496:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000089168eb already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305890.592499:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6ec2a lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x88:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305890.592507:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6ec2a lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x88:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305890.592519:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x88:0x0].0x0 (00000000af7c637f) 00010000:00010000:1.0:1772305890.592523:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305890.592527:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6ec2a lrc: 2/0,0 mode: --/CR res: [0x200000408:0x88:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305890.592533:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6ec2a lrc: 0/0,0 mode: --/CR res: [0x200000408:0x88:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305890.592553:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e326753f/0xa5e9c8c58c6ec31 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x88:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305890.592559:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e326753f/0xa5e9c8c58c6ec31 lrc: 2/0,0 mode: PR/PR res: [0x200000408:0x88:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305890.592565:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000e326753f/0xa5e9c8c58c6ec31 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x88:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305890.592571:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e326753f already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305890.592573:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e326753f/0xa5e9c8c58c6ec31 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x88:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305890.592579:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e326753f/0xa5e9c8c58c6ec31 lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x88:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305890.592589:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x88:0x0].0x46626822 (00000000663af6c8) 00010000:00010000:1.0:1772305890.592592:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305890.592594:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000e326753f/0xa5e9c8c58c6ec31 lrc: 2/0,0 mode: --/PR res: [0x200000408:0x88:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305890.592600:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e326753f/0xa5e9c8c58c6ec31 lrc: 0/0,0 mode: --/PR res: [0x200000408:0x88:0x0].0x46626822 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305890.592676:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000367b2753/0xa5e9c8c58c6ec23 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x88:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec30 expref: 48 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305890.592691:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000008260c3b/0xa5e9c8c58c6ec38 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x322:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec30 expref: 47 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305890.592711:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x322:0x0].0x0 (0000000060b58ddc) 00010000:00010000:1.0:1772305890.592714:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1772305890.592717:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000008260c3b, rc 0) 00000100:00100000:1.0:1772305890.592775:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004f1a5774 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+47:94736:x1858396225347200:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 687us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305890.592784:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 712 00000100:00100000:2.0:1772305890.595310:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305890.595356:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225347328 00000100:00100000:1.0:1772305890.595395:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 713 00000100:00100000:1.0:1772305890.595401:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009adfd4b0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+47:94736:x1858396225347328:12345-192.168.203.30@tcp:58:lfs.0 00000040:00080000:1.0:1772305890.595498:0:54698:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305890.595502:0:54698:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305890.595547:0:54698:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 32 count 11 00000040:00080000:1.0:1772305890.595554:0:54698:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:1.0:1772305890.595798:0:54698:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xf:0x0].32, 136 off12544 00000100:00100000:1.0:1772305890.595856:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009adfd4b0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+47:94736:x1858396225347328:12345-192.168.203.30@tcp:58:lfs.0 Request processed in 453us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305890.595865:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 713 00000100:00100000:3.0:1772305890.760759:0:2992:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1772305890.760783:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004c826b2e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216598016:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1772305890.760848:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305890.760881:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000043720844 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216598080:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1772305890.760913:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305890.760958:0:7591:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 443 00000100:00100000:1.0:1772305890.760965:0:7591:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000077cfb39c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:2992:x1858396216598016:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1772305890.760971:0:6310:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 444 00000100:00100000:3.0:1772305890.760980:0:6310:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000047d67c26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216598080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1772305890.761001:0:7591:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 693436416 pending 0 free 3606052864 avail 3603955712 00002000:00000024:3.0:1772305890.761016:0:6310:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 741539840 pending 0 free 3829399552 avail 3827302400 00000100:00100000:1.0:1772305890.761051:0:7591:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000077cfb39c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:2992:x1858396216598016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305890.761058:0:7591:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 443 00000100:00100000:3.0:1772305890.761069:0:6310:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000047d67c26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216598080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305890.761077:0:6310:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 444 00000040:00100000:3.0:1772305890.761165:0:54719:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 8 in log [0xb:0x1:0x0] 00000040:00080000:2.0:1772305890.880892:0:67322:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305890.880897:0:67322:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305890.880952:0:67322:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 33 count 12 00000040:00080000:2.0:1772305890.880958:0:67322:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:3.0:1772305890.952740:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305890.952746:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305890.952789:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 33 count 12 00000040:00080000:3.0:1772305890.952796:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:3.0:1772305890.952841:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305890.952843:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00010000:00010000:3.0:1772305890.952901:0:54732:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6ec15 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x322:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305890.952912:0:54732:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6ec15 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x322:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305890.952918:0:54732:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6ec15 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x322:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305890.952923:0:54732:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000009fea887 already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305890.952925:0:54732:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6ec15 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x322:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305890.952930:0:54732:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6ec15 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x322:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305890.952943:0:54732:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x322:0x0].0x0 (0000000060b58ddc) 00010000:00010000:3.0:1772305890.952945:0:54732:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1772305890.952947:0:54732:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6ec15 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x322:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305890.952951:0:54732:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6ec15 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x322:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1772305890.952967:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 32 count 12 00000040:00080000:3.0:1772305890.952970:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 4 count 2 00000100:00100000:3.0:1772305890.953014:0:54732:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000043720844 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:54732:1858396216598144:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1772305890.953082:0:54732:0:(client.c:2500:ptlrpc_set_wait()) set 00000000b81e9b83 going to sleep for 6 seconds 00000100:00100000:3.0:1772305890.954365:0:54732:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000043720844 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:54732:1858396216598144:192.168.203.30@tcp:107:hsm_cdtr.0 00000040:00080000:3.0:1772305890.954406:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305890.954408:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305890.954457:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 33 count 12 00000040:00080000:3.0:1772305890.954463:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772305891.016834:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1772305891.272822:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008df3460f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:70aae467-c860-409f-ba1b-742f4d042da6:2992:1858396216598208:0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772305891.272871:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a3ed84e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:2993:1858396216598272:0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772305891.272880:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009b6b3602 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216598400:0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772305891.272904:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772305891.272928:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305891.272942:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305891.272951:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000339dc28b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216598464:0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772305891.272979:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d23582b4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:2993:1858396216598528:0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772305891.272991:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216598400 00000100:00100000:3.0:1772305891.272995:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772305891.273013:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305891.273026:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216598464 00000100:00100000:1.0:1772305891.273059:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1155 00000100:00100000:1.0:1772305891.273065:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000038ede71c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216598400:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772305891.273068:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216598272 00000100:00100000:3.0:1772305891.273071:0:6308:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1156 00000100:00100000:3.0:1772305891.273080:0:6308:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000043720844 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:2992:x1858396216598464:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772305891.273105:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216598528 00000100:00100000:1.0:1772305891.273111:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000038ede71c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216598400:12345-0@lo:400:kworker/u8:4.0 Request processed in 46us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305891.273118:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1155 00000100:00100000:3.0:1772305891.273142:0:6308:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000043720844 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:2992:x1858396216598464:12345-0@lo:400:kworker/u8:4.0 Request processed in 61us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305891.273146:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1772305891.273156:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000096c63f8a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:2993:x1858396216598272:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772305891.273166:0:6308:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1156 00000100:00100000:1.0:1772305891.273185:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009b6b3602 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216598400:0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772305891.273208:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000096c63f8a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:2993:x1858396216598272:12345-0@lo:400:kworker/u8:4.0 Request processed in 52us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305891.273212:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216598336 00000100:00100000:2.0:1772305891.273215:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1772305891.273233:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1772305891.273239:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009e643511 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:2993:x1858396216598528:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772305891.273245:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1772305891.273254:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000df58eb45 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:2994:x1858396216598336:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772305891.273280:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009e643511 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:2993:x1858396216598528:12345-0@lo:400:kworker/u8:4.0 Request processed in 40us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305891.273287:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1772305891.273306:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000df58eb45 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:2994:x1858396216598336:12345-0@lo:400:kworker/u8:4.0 Request processed in 51us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305891.273313:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1772305891.273318:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d23582b4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:2993:1858396216598528:0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772305891.273340:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a3ed84e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:2993:1858396216598272:0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772305891.273345:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000002b05fb2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:2994:1858396216598336:0@lo:400:kworker/u8:4.0 00010000:00010000:3.0:1772305892.040770:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1772305892.227911:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305892.227971:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225347392 00000100:00100000:2.0:1772305892.228023:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 714 00000100:00100000:2.0:1772305892.228030:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cd2082b2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+54:94760:x1858396225347392:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1772305892.228058:0:55141:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x322:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1772305892.228143:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cd2082b2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+54:94760:x1858396225347392:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 113us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305892.228149:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 714 00000100:00100000:3.0:1772305892.228491:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305892.228529:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225347456 00000100:00100000:3.0:1772305892.228566:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 715 00000100:00100000:3.0:1772305892.228573:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000026c4ebe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+54:94761:x1858396225347456:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1772305892.228689:0:55653:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x322:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1772305892.228767:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000026c4ebe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+54:94761:x1858396225347456:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 193us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305892.228778:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 715 00000100:00100000:3.0:1772305892.229990:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305892.231221:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225347584 00000100:00100000:3.0:1772305892.231248:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 717 00000100:00100000:3.0:1772305892.231253:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008df3460f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+54:94760:x1858396225347584:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1772305892.231266:0:55653:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x322:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1772305892.231312:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008df3460f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+54:94760:x1858396225347584:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 58us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305892.231318:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 717 00000100:00100000:1.0:1772305892.232879:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305892.232914:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225347712 00000100:00100000:1.0:1772305892.232950:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 718 00000100:00100000:1.0:1772305892.232956:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000be70edad pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+54:94760:x1858396225347712:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1772305892.232968:0:55653:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305892.232983:0:55653:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000367b2753/0xa5e9c8c58c6ec54 lrc: 2/0,0 mode: --/CW res: [0x200000408:0x88:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ec37 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305892.233918:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e326753f/0xa5e9c8c58c6ec5b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x323:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305892.233945:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e326753f/0xa5e9c8c58c6ec5b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x323:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305892.233956:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e326753f/0xa5e9c8c58c6ec5b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x323:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1772305892.233967:0:55653:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x323:0x0]: returning size 0 00010000:00010000:1.0:1772305892.234018:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000367b2753/0xa5e9c8c58c6ec54 lrc: 0/0,0 mode: --/CW res: [0x200000408:0x88:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec37 expref: 57 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305892.234037:0:55653:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000e326753f/0xa5e9c8c58c6ec5b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x323:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec37 expref: 56 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305892.234045:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x323:0x0].0x0 (00000000663af6c8) 00010000:00010000:1.0:1772305892.234049:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1772305892.234053:0:55653:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e326753f, rc 0) 00000100:00100000:1.0:1772305892.234094:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000be70edad pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+56:94760:x1858396225347712:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 1137us (1216us total) trans 8589934821 rc 0/0 00000100:00100000:1.0:1772305892.234103:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 718 00000100:00100000:1.0:1772305892.235660:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305892.235689:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225347840 00000100:00100000:1.0:1772305892.235725:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 719 00000100:00100000:1.0:1772305892.235733:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000caaee5d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+56:94760:x1858396225347840:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1772305892.235763:0:55653:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1772305892.235776:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e326753f/0xa5e9c8c58c6ec5b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x323:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec37 expref: 56 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305892.235798:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x323:0x0].0x0 (00000000663af6c8) 00010000:00010000:1.0:1772305892.235805:0:55653:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1772305892.235820:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6ec69 lrc: 3/0,1 mode: --/CW res: [0x200000408:0x88:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305892.235829:0:55653:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6eb7b lrc: 2/0,0 mode: PR/PR res: [0x200000408:0x88:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ebff expref: 46 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305892.235835:0:55653:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6ec69 lrc: 4/0,1 mode: --/CW res: [0x200000408:0x88:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305892.235860:0:55653:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6eb7b lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x88:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ebff expref: 46 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305892.235870:0:55653:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6eb7b lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x88:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ebff expref: 46 pid: 54698 timeout: 1304 lvb_type: 0 00000100:00100000:1.0:1772305892.235879:0:55653:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005254ed4a pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:55653:1858396216598592:192.168.203.30@tcp:104: 00000100:00100000:1.0:1772305892.235933:0:55653:0:(client.c:2500:ptlrpc_set_wait()) set 00000000a51451eb going to sleep for 6 seconds 00010000:00010000:1.0:1772305892.237024:0:55653:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6ec69 lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x88:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305892.237032:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6ec69 lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x88:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305892.237046:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000081644fa4/0xa5e9c8c58c6ec70 lrc: 3/0,1 mode: --/PW res: [0x200000408:0x88:0x0].0x30fb3754 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305892.237067:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000081644fa4/0xa5e9c8c58c6ec70 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x88:0x0].0x30fb3754 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305892.237075:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000081644fa4/0xa5e9c8c58c6ec70 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x88:0x0].0x30fb3754 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305892.237142:0:55653:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6ec69 lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x88:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305892.237150:0:55653:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6ec69 lrc: 2/0,0 mode: CW/CW res: [0x200000408:0x88:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305892.237157:0:55653:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6ec69 lrc: 3/0,0 mode: CW/CW res: [0x200000408:0x88:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305892.237163:0:55653:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000089168eb already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305892.237165:0:55653:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6ec69 lrc: 3/0,0 mode: CW/CW res: [0x200000408:0x88:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305892.237172:0:55653:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6ec69 lrc: 4/0,0 mode: CW/CW res: [0x200000408:0x88:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305892.237180:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x88:0x0].0x0 (00000000af7c637f) 00010000:00010000:1.0:1772305892.237183:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305892.237185:0:55653:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6ec69 lrc: 2/0,0 mode: --/CW res: [0x200000408:0x88:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305892.237192:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6ec69 lrc: 0/0,0 mode: --/CW res: [0x200000408:0x88:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305892.237213:0:55653:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000081644fa4/0xa5e9c8c58c6ec70 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x88:0x0].0x30fb3754 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305892.237220:0:55653:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000081644fa4/0xa5e9c8c58c6ec70 lrc: 2/0,0 mode: PW/PW res: [0x200000408:0x88:0x0].0x30fb3754 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305892.237226:0:55653:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000081644fa4/0xa5e9c8c58c6ec70 lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x88:0x0].0x30fb3754 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305892.237232:0:55653:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000081644fa4 already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305892.237234:0:55653:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000081644fa4/0xa5e9c8c58c6ec70 lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x88:0x0].0x30fb3754 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305892.237239:0:55653:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000081644fa4/0xa5e9c8c58c6ec70 lrc: 4/0,0 mode: PW/PW res: [0x200000408:0x88:0x0].0x30fb3754 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305892.237247:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x88:0x0].0x30fb3754 (0000000094db6ce7) 00010000:00010000:1.0:1772305892.237250:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305892.237251:0:55653:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000081644fa4/0xa5e9c8c58c6ec70 lrc: 2/0,0 mode: --/PW res: [0x200000408:0x88:0x0].0x30fb3754 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305892.237257:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000081644fa4/0xa5e9c8c58c6ec70 lrc: 0/0,0 mode: --/PW res: [0x200000408:0x88:0x0].0x30fb3754 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305892.237306:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000caaee5d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+55:94760:x1858396225347840:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 1574us (1649us total) trans 0 rc -2/-2 00000100:00100000:1.0:1772305892.237312:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 719 00000100:00100000:2.0:1772305892.238081:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225347968 00000100:00100000:2.0:1772305892.238114:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 720 00000100:00100000:2.0:1772305892.238118:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000096e59de2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+55:94760:x1858396225347968:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1772305892.238126:0:55653:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305892.238138:0:55653:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cd3f7c05/0xa5e9c8c58c6ec77 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x323:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ec3e expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305892.238158:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000349659bf/0xa5e9c8c58c6ec7e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x323:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305892.238166:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000349659bf/0xa5e9c8c58c6ec7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x323:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305892.238173:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000349659bf/0xa5e9c8c58c6ec7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x323:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305892.238224:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cd3f7c05/0xa5e9c8c58c6ec77 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x323:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec3e expref: 57 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305892.238243:0:55653:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000349659bf/0xa5e9c8c58c6ec7e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x323:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec3e expref: 56 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305892.238249:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x323:0x0].0x0 (000000001c98e839) 00010000:00010000:2.0:1772305892.238251:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1772305892.238253:0:55653:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000349659bf, rc 0) 00000100:00100000:2.0:1772305892.238285:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000096e59de2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+56:94760:x1858396225347968:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 165us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305892.238292:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 720 00000100:00100000:1.0:1772305892.239136:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225348096 00000100:00100000:1.0:1772305892.239176:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 721 00000100:00100000:1.0:1772305892.239182:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000161e896c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+56:94760:x1858396225348096:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1772305892.239213:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c6ec85 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x323:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305892.239220:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c6ec85 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x323:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305892.239225:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c6ec85 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x323:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1772305892.239398:0:55653:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000161e896c reply state 0000000074320a22 transno 8589934822 ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c6ec85 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x323:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305892.239463:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000161e896c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+58:94760:x1858396225348096:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 281us (374us total) trans 8589934822 rc 0/0 00000100:00100000:1.0:1772305892.239472:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 721 00010000:00010000:2.0:1772305892.239898:0:2978:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c6ec85 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x323:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305892.239905:0:2978:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c6ec85 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x323:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305892.239909:0:2978:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c6ec85 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x323:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305892.239913:0:2978:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000776565ed already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305892.239915:0:2978:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c6ec85 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x323:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305892.239918:0:2978:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c6ec85 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x323:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305892.239925:0:2978:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x323:0x0].0x0 (000000001c98e839) 00010000:00010000:2.0:1772305892.239927:0:2978:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1772305892.239934:0:2978:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c6ec85 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x323:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305892.239938:0:2978:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c6ec85 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x323:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305892.240153:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225348160 00000100:00100000:1.0:1772305892.240177:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 722 00000100:00100000:1.0:1772305892.240181:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005d647dd1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+57:94760:x1858396225348160:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1772305892.240189:0:55653:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305892.240196:0:55653:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000007cea572/0xa5e9c8c58c6ec8c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x323:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ec45 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305892.240217:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000007cea572/0xa5e9c8c58c6ec8c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x323:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec45 expref: 58 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305892.240224:0:55653:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000007cea572/0xa5e9c8c58c6ec8c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x323:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec45 expref: 58 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305892.240236:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x323:0x0].0x0 (000000001c98e839) 00010000:00010000:1.0:1772305892.240238:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1772305892.240240:0:55653:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000007cea572, rc 0) 00000100:00100000:1.0:1772305892.240264:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005d647dd1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+58:94760:x1858396225348160:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 82us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305892.240270:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 722 00000100:00100000:2.0:1772305892.240975:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225348224 00000100:00100000:2.0:1772305892.241001:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 91 00000100:00100000:2.0:1772305892.241004:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ba314d1a pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+58:94760:x1858396225348224:12345-192.168.203.30@tcp:49:lhsmtool_posix.0 00000100:00100000:2.0:1772305892.241051:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ba314d1a pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+58:94760:x1858396225348224:12345-192.168.203.30@tcp:49:lhsmtool_posix.0 Request processed in 46us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305892.241056:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 91 00000100:00100000:1.0:1772305892.241736:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225348352 00000100:00100000:1.0:1772305892.241766:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 723 00000100:00100000:1.0:1772305892.241771:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000815b9e7f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+58:94760:x1858396225348352:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1772305892.241810:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000815b9e7f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+58:94760:x1858396225348352:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 40us (103us total) trans 0 rc -125/-125 00000100:00100000:1.0:1772305892.241816:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 723 00000100:00100000:2.0:1772305892.242401:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225348480 00000100:00100000:2.0:1772305892.242431:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 92 00000100:00100000:2.0:1772305892.242434:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000081fffd7c pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+58:94760:x1858396225348480:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1772305892.242578:0:57054:0:(mdd_object.c:3529:mdd_close()) Object [0x200000402:0x323:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:2.0:1772305892.242673:0:57054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000e235ac0b/0xa5e9c8c58c6ec93 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x323:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305892.242682:0:57054:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e235ac0b/0xa5e9c8c58c6ec93 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x323:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 18446631280743258432 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305892.242689:0:57054:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e235ac0b/0xa5e9c8c58c6ec93 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x323:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 18446631280743258432 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305892.242695:0:57054:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000e235ac0b/0xa5e9c8c58c6ec93 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x323:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 18446631280743258432 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305892.242707:0:57054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000e235ac0b/0xa5e9c8c58c6ec93 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x323:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 18446631280743258432 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305892.242711:0:57054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e235ac0b/0xa5e9c8c58c6ec93 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x323:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 18446631280743258432 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305892.242726:0:57054:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1772305892.242742:0:5497:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1772305892.242747:0:5497:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000e235ac0b/0xa5e9c8c58c6ec93 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x323:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 18446631280743258432 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305892.242756:0:5497:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e235ac0b already unused, calling callback (00000000b5e4f3c0) 00010000:00010000:1.0:1772305892.242758:0:5497:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e235ac0b/0xa5e9c8c58c6ec93 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x323:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 18446631280743258432 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305892.242764:0:5497:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e235ac0b/0xa5e9c8c58c6ec93 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x323:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 18446631280743258432 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305892.242774:0:5497:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x323:0x0].0x0 (000000001c98e839) 00010000:00010000:1.0:1772305892.242776:0:5497:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1772305892.242785:0:5497:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000e235ac0b/0xa5e9c8c58c6ec93 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x323:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 18446631280743258432 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305892.242790:0:5497:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e235ac0b/0xa5e9c8c58c6ec93 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x323:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 18446631280743258432 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305892.242792:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000081fffd7c pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+59:94760:x1858396225348480:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 355us (427us total) trans 8589934823 rc 0/0 00000100:00100000:2.0:1772305892.242805:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 92 00010000:00010000:1.0:1772305892.242811:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1772305892.242814:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1772305892.242818:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772305892.243524:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225348608 00000100:00100000:1.0:1772305892.243558:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 724 00000100:00100000:1.0:1772305892.243562:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005f1fba5b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+59:94760:x1858396225348608:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000040:00080000:1.0:1772305892.243768:0:55653:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x13:0x0].46, 168 off15776 00010000:00010000:1.0:1772305892.243821:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000081644fa4/0xa5e9c8c58c6ec9a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x322:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305892.243831:0:55653:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 0000000008260c3b/0xa5e9c8c58c6ec38 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x322:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec30 expref: 45 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305892.243837:0:55653:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 0000000081644fa4/0xa5e9c8c58c6ec9a lrc: 4/0,1 mode: --/EX res: [0x200000402:0x322:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305892.243860:0:55653:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 0000000008260c3b/0xa5e9c8c58c6ec38 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x322:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec30 expref: 45 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305892.243872:0:55653:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 0000000008260c3b/0xa5e9c8c58c6ec38 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x322:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec30 expref: 45 pid: 54698 timeout: 1304 lvb_type: 0 00000100:00100000:1.0:1772305892.243886:0:55653:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000fb2f2c9 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:55653:1858396216598656:192.168.203.30@tcp:104: 00000100:00100000:1.0:1772305892.243952:0:55653:0:(client.c:2500:ptlrpc_set_wait()) set 000000001e15beb9 going to sleep for 6 seconds 00000100:00100000:1.0:1772305892.244755:0:55653:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000fb2f2c9 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:55653:1858396216598656:192.168.203.30@tcp:104: 00010000:00010000:1.0:1772305892.244778:0:55653:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 0000000081644fa4/0xa5e9c8c58c6ec9a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x322:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305892.244910:0:6323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225348672 00010000:00010000:1.0:1772305892.244932:0:6323:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 0000000008260c3b/0xa5e9c8c58c6ec38 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x322:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec30 expref: 46 pid: 54698 timeout: 1304 lvb_type: 0 00000100:00100000:1.0:1772305892.244966:0:6323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3070 00000100:00100000:1.0:1772305892.244974:0:6323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000df58eb45 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+46:2215:x1858396225348672:12345-192.168.203.30@tcp:103:ldlm_bl_08.0 00010000:00010000:1.0:1772305892.244988:0:6323:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1772305892.244994:0:6323:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 0000000008260c3b/0xa5e9c8c58c6ec38 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x322:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec30 expref: 46 pid: 54698 timeout: 1304 lvb_type: 0 00010000:00010000:1.0:1772305892.245007:0:6323:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 0000000008260c3b/0xa5e9c8c58c6ec38 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x322:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec30 expref: 46 pid: 54698 timeout: 1304 lvb_type: 0 00010000:00010000:1.0:1772305892.245024:0:6323:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000008260c3b/0xa5e9c8c58c6ec38 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x322:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec30 expref: 46 pid: 54698 timeout: 1304 lvb_type: 0 00010000:00010000:1.0:1772305892.245039:0:6323:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x322:0x0].0x0 (0000000060b58ddc) 00010000:00010000:1.0:1772305892.245042:0:6323:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: 0000000081644fa4/0xa5e9c8c58c6ec9a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x322:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305892.245050:0:6323:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 0000000081644fa4/0xa5e9c8c58c6ec9a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x322:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305892.245070:0:6323:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000081644fa4/0xa5e9c8c58c6ec9a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x322:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305892.245101:0:6323:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1772305892.245141:0:6323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000df58eb45 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+45:2215:x1858396225348672:12345-192.168.203.30@tcp:103:ldlm_bl_08.0 Request processed in 163us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305892.245155:0:6323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3070 00000040:00080000:1.0:1772305892.245585:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305892.245589:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305892.246094:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 12 00000040:00080000:1.0:1772305892.246104:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:1.0:1772305892.513392:0:67424:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305892.513398:0:67424:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305892.513461:0:67424:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 33 count 12 00000040:00080000:1.0:1772305892.513466:0:67424:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:2.0:1772305892.539880:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305892.541018:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225348800 00000100:00100000:1.0:1772305892.541058:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 726 00000100:00100000:1.0:1772305892.541064:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a3ed84e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+60:94776:x1858396225348800:12345-192.168.203.30@tcp:503:chlg_load_threa.0 00000100:00100000:1.0:1772305892.541282:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a3ed84e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+60:94776:x1858396225348800:12345-192.168.203.30@tcp:503:chlg_load_threa.0 Request processed in 217us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305892.541292:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 726 00000100:00100000:1.0:1772305892.541972:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305892.542959:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225348928 00000100:00100000:2.0:1772305892.542989:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 728 00000100:00100000:2.0:1772305892.542994:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000002b05fb2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+60:94776:x1858396225348928:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1772305892.543114:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000002b05fb2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+60:94776:x1858396225348928:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 119us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305892.543120:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 728 00000100:00100000:1.0:1772305892.543803:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305892.544483:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305892.545448:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305892.546377:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225349184 00000100:00100000:2.0:1772305892.546413:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 732 00000100:00100000:2.0:1772305892.546420:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d23582b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+60:94776:x1858396225349184:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1772305892.546528:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d23582b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+60:94776:x1858396225349184:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 108us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305892.546537:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 732 00010000:00010000:3.0:1772305893.064760:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772305893.443668:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305893.443728:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305893.443746:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225349248 00000100:00100000:1.0:1772305893.443770:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305893.443807:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 134 00000100:00100000:1.0:1772305893.443815:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305893.443816:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a974db7c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2216:x1858396225349248:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:3.0:1772305893.443842:0:18149:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225349440 00000100:00100000:1.0:1772305893.443854:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305893.443887:0:18149:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225349376 00000100:00100000:2.0:1772305893.443887:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a974db7c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2216:x1858396225349248:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 69us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305893.443908:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 134 00000100:00100000:3.0:1772305893.443921:0:18149:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225349568 00000100:00100000:1.0:1772305893.443952:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305893.443961:0:18149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1157 00000100:00100000:3.0:1772305893.443969:0:18149:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ae1f1e77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2215:x1858396225349440:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1772305893.444001:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225349504 00000100:00100000:3.0:1772305893.444021:0:18149:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ae1f1e77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2215:x1858396225349440:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 48us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305893.444044:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 130 00000100:00100000:1.0:1772305893.444051:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007e97bd92 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+45:2216:x1858396225349504:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1772305893.444104:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007e97bd92 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+45:2216:x1858396225349504:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 53us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305893.444112:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 130 00000100:00100000:3.0:1772305893.444117:0:18149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1157 00000100:00100000:2.0:1772305893.444125:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1159 00000100:00100000:2.0:1772305893.444132:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a870219c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+160:2215:x1858396225349568:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1772305893.444156:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a870219c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+160:2215:x1858396225349568:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 25us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305893.444163:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1159 00000100:00100000:3.0:1772305893.444240:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305893.444282:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225349632 00000100:00100000:2.0:1772305893.444304:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1160 00000100:00100000:2.0:1772305893.444307:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cba49044 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+140:2216:x1858396225349632:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1772305893.444334:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cba49044 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+140:2216:x1858396225349632:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 26us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305893.444342:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1160 00010000:00010000:3.0:1772305894.088750:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772305894.442554:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305894.442654:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225349696 00000100:00100000:2.0:1772305894.442715:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 733 00000100:00100000:2.0:1772305894.442722:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a85e5eb6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+60:95217:x1858396225349696:12345-192.168.203.30@tcp:46:lfs.0 00000004:00000080:2.0:1772305894.442759:0:55653:0:(mdt_handler.c:7411:mdt_iocontrol()) handling ioctl cmd 0x424066b3 00000004:00000080:2.0:1772305894.442791:0:55653:0:(mdd_device.c:2125:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=9, endrec=0 00000040:00080000:2.0:1772305894.442880:0:55653:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1772305894.442884:0:55653:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x11:0x1:0x0]:0 at index 1 of catalog [0x6:0xa:0x0] 00000004:00000080:2.0:1772305894.442938:0:55653:0:(mdd_device.c:2095:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl9 endrec = 46 00000040:00080000:2.0:1772305894.443016:0:55653:0:(llog.c:789:llog_process_thread()) stop processing plain 0x11:1:0 index 10 count 2 00000040:00080000:2.0:1772305894.443030:0:55653:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x6:10:0 index 2 count 2 00000004:00000080:2.0:1772305894.443036:0:55653:0:(mdd_device.c:2173:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl9 entries up to 18446744073709551615 00000040:00080000:2.0:1772305894.443073:0:55653:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1772305894.443075:0:55653:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x13:0x1:0x0]:0 at index 1 of catalog [0x5:0xa:0x0] 00000040:00100000:2.0:1772305894.443100:0:55653:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 39 in log [0x13:0x1:0x0] 00000040:00100000:2.0:1772305894.443153:0:55653:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 40 in log [0x13:0x1:0x0] 00000040:00100000:2.0:1772305894.443176:0:55653:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 41 in log [0x13:0x1:0x0] 00000040:00100000:2.0:1772305894.443207:0:55653:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 42 in log [0x13:0x1:0x0] 00000040:00100000:2.0:1772305894.443227:0:55653:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 43 in log [0x13:0x1:0x0] 00000040:00100000:2.0:1772305894.443253:0:55653:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 44 in log [0x13:0x1:0x0] 00000040:00100000:2.0:1772305894.443284:0:55653:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 45 in log [0x13:0x1:0x0] 00000040:00100000:2.0:1772305894.443329:0:55653:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 46 in log [0x13:0x1:0x0] 00000040:00080000:2.0:1772305894.443358:0:55653:0:(llog.c:789:llog_process_thread()) stop processing plain 0x13:1:0 index 46 count 1 00000040:00080000:2.0:1772305894.443363:0:55653:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x5:10:0 index 2 count 2 00000100:00100000:2.0:1772305894.443442:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a85e5eb6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+60:95217:x1858396225349696:12345-192.168.203.30@tcp:46:lfs.0 Request processed in 720us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305894.443449:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 733 00000020:00000080:3.0:1772305894.737864:0:67668:0:(class_obd.c:302:class_handle_ioctl()) cmd = c008667f 00000020:00000080:3.0:1772305894.737876:0:67668:0:(class_obd.c:126:class_resolve_dev_name()) device name lustre-MDT0000 00000020:00000080:3.0:1772305894.737881:0:67668:0:(class_obd.c:133:class_resolve_dev_name()) device name lustre-MDT0000, dev 5 00000020:00000080:3.0:1772305894.737943:0:67668:0:(class_obd.c:302:class_handle_ioctl()) cmd = 424066b2 00000004:00000080:3.0:1772305894.737951:0:67668:0:(mdt_handler.c:7411:mdt_iocontrol()) handling ioctl cmd 0x424066b2 00000004:00000080:3.0:1772305894.737996:0:67668:0:(mdd_device.c:2125:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=9, endrec=0 00000040:00080000:3.0:1772305894.738086:0:67668:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1772305894.738090:0:67668:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x11:0x1:0x0]:0 at index 1 of catalog [0x6:0xa:0x0] 00000004:00000080:3.0:1772305894.738127:0:67668:0:(mdd_device.c:2095:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl9 endrec = 46 00000040:00080000:3.0:1772305894.738188:0:67668:0:(llog.c:789:llog_process_thread()) stop processing plain 0x11:1:0 index 10 count 2 00000040:00080000:3.0:1772305894.738196:0:67668:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x6:10:0 index 2 count 2 00000004:00000080:3.0:1772305894.738201:0:67668:0:(mdd_device.c:2173:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl9 entries up to 18446744073709551615 00000040:00080000:3.0:1772305894.738235:0:67668:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1772305894.738238:0:67668:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x13:0x1:0x0]:0 at index 1 of catalog [0x5:0xa:0x0] 00000040:00080000:3.0:1772305894.738744:0:67668:0:(llog.c:789:llog_process_thread()) stop processing plain 0x13:1:0 index 64768 count 1 00000040:00080000:3.0:1772305894.738751:0:67668:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x5:10:0 index 2 count 2 00000004:00000080:3.0:1772305894.738756:0:67668:0:(mdd_device.c:1983:mdd_changelog_user_purge()) lustre-MDD0000: Purge request: id=9 00000040:00080000:3.0:1772305894.738778:0:67668:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1772305894.738780:0:67668:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x11:0x1:0x0]:0 at index 1 of catalog [0x6:0xa:0x0] 00000040:00100000:3.0:1772305894.738794:0:67668:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 9 in log [0x11:0x1:0x0] 00000040:00080000:3.0:1772305894.738878:0:67668:0:(llog.c:789:llog_process_thread()) stop processing plain 0x11:1:0 index 9 count 1 00000040:00080000:3.0:1772305894.738883:0:67668:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x6:10:0 index 2 count 2 00000004:00000080:3.0:1772305894.738888:0:67668:0:(mdd_device.c:2005:mdd_changelog_user_purge()) turning off changelogs 00000004:02000000:3.0:1772305894.738889:0:67668:0:(mdd_device.c:483:mdd_changelog_off()) lustre-MDD0000: changelog off 00000004:00000080:3.0:1772305894.738891:0:67668:0:(mdd_device.c:2015:mdd_changelog_user_purge()) lustre-MDD0000: Purge changelog entries for user cl9 record=18446744073709551615 00000040:00080000:3.0:1772305894.738914:0:67668:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1772305894.738916:0:67668:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x13:0x1:0x0]:0 at index 1 of catalog [0x5:0xa:0x0] 00000040:00080000:3.0:1772305894.739305:0:67668:0:(llog.c:789:llog_process_thread()) stop processing plain 0x13:1:0 index 64768 count 1 00000040:00080000:3.0:1772305894.739310:0:67668:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x5:10:0 index 2 count 2 00000040:00080000:3.0:1772305894.739334:0:67668:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1772305894.739335:0:67668:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x11:0x1:0x0]:0 at index 1 of catalog [0x6:0xa:0x0] 00000040:00080000:3.0:1772305894.739793:0:67668:0:(llog.c:789:llog_process_thread()) stop processing plain 0x11:1:0 index 64768 count 1 00000040:00080000:3.0:1772305894.739800:0:67668:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x6:10:0 index 2 count 2 00000040:00080000:3.0:1772305895.042288:0:67716:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1772305895.042293:0:67716:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x11:0x1:0x0]:0 at index 1 of catalog [0x6:0xa:0x0] 00000040:00080000:3.0:1772305895.042785:0:67716:0:(llog.c:789:llog_process_thread()) stop processing plain 0x11:1:0 index 64768 count 1 00000040:00080000:3.0:1772305895.042798:0:67716:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x6:10:0 index 2 count 2 00000100:00100000:1.0:1772305895.073557:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225349760 00000100:00100000:1.0:1772305895.073655:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 734 00000100:00100000:1.0:1772305895.073664:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009b6b3602 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+60:94654:x1858396225349760:12345-192.168.203.30@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1772305895.073767:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009b6b3602 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+60:94654:x1858396225349760:12345-192.168.203.30@tcp:60:lhsmtool_posix.0 Request processed in 102us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305895.073775:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 734 00010000:00010000:3.0:1772305895.112780:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1772305895.304798:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305895.304804:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00100000:1.0:1772305895.304833:0:54732:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 22 in log [0xf:0x1:0x0] 00000040:00100000:1.0:1772305895.304908:0:54732:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 23 in log [0xf:0x1:0x0] 00000040:00100000:1.0:1772305895.304928:0:54732:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 24 in log [0xf:0x1:0x0] 00000040:00080000:1.0:1772305895.304952:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 33 count 9 00000040:00080000:1.0:1772305895.304958:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000400:00000080:3.0:1772305895.646073:0:67768:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:3.0:1772305895.646079:0:67768:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 224A: Changelog for remove ============ 14:11:35 (1772305895) 00000100:00100000:1.0:1772305895.749367:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305895.749447:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225349888 00000100:00100000:2.0:1772305895.749503:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 735 00000100:00100000:2.0:1772305895.749511:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a9a770cc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+56:95419:x1858396225349888:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1772305895.749533:0:55653:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305895.749553:0:55653:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cd3f7c05/0xa5e9c8c58c6eca1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ec4c expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.749664:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e235ac0b/0xa5e9c8c58c6eca8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.749679:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e235ac0b/0xa5e9c8c58c6eca8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.749709:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e235ac0b/0xa5e9c8c58c6eca8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.749726:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6ecaf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.749735:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6ecaf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.749743:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6ecaf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1772305895.749853:0:55653:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 10752 00010000:00010000:2.0:1772305895.749988:0:55653:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e235ac0b/0xa5e9c8c58c6eca8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.749998:0:55653:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e235ac0b/0xa5e9c8c58c6eca8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.750007:0:55653:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000e235ac0b/0xa5e9c8c58c6eca8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.750015:0:55653:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e235ac0b already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305895.750018:0:55653:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e235ac0b/0xa5e9c8c58c6eca8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.750026:0:55653:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e235ac0b/0xa5e9c8c58c6eca8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.750038:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (000000006b52a2ed) 00010000:00010000:2.0:1772305895.750047:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305895.750051:0:55653:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000e235ac0b/0xa5e9c8c58c6eca8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.750059:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e235ac0b/0xa5e9c8c58c6eca8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.750072:0:55653:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6ecaf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.750079:0:55653:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6ecaf lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.750086:0:55653:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6ecaf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.750093:0:55653:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000059b20141 already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305895.750095:0:55653:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6ecaf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.750101:0:55653:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6ecaf lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.750109:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (000000002ab31ac6) 00010000:00010000:2.0:1772305895.750111:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305895.750113:0:55653:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6ecaf lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.750118:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6ecaf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.750159:0:55653:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000cd3f7c05/0xa5e9c8c58c6eca1 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec4c expref: 58 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.750168:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cd3f7c05/0xa5e9c8c58c6eca1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec4c expref: 58 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.750178:0:55653:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000cd3f7c05, rc 0) 00000100:00100000:2.0:1772305895.750231:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a9a770cc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+57:95419:x1858396225349888:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 720us (868us total) trans 8589934825 rc 301/301 00000100:00100000:2.0:1772305895.750240:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 735 00000100:00100000:2.0:1772305895.751370:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225350016 00000100:00100000:2.0:1772305895.751402:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 93 00000100:00100000:2.0:1772305895.751408:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000ad6883e pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+57:95419:x1858396225350016:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1772305895.751549:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000ad6883e pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+58:95419:x1858396225350016:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 140us (239us total) trans 8589934826 rc 0/0 00000100:00100000:2.0:1772305895.751559:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 93 00000100:00100000:2.0:1772305895.752611:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225350080 00000100:00100000:2.0:1772305895.752666:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 736 00000100:00100000:2.0:1772305895.752673:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000de99bf0b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+58:95419:x1858396225350080:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1772305895.752725:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000de99bf0b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+58:95419:x1858396225350080:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 Request processed in 52us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305895.752736:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 736 00000100:00100000:1.0:1772305895.760001:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305895.760094:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225350144 00000100:00100000:2.0:1772305895.760147:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 737 00000100:00100000:2.0:1772305895.760167:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ad14d1c8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+45:95420:x1858396225350144:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1772305895.760183:0:55653:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305895.760201:0:55653:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cd3f7c05/0xa5e9c8c58c6ecbd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ec53 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.760251:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6ecc4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.760265:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6ecc4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.760275:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6ecc4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.760290:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e235ac0b/0xa5e9c8c58c6eccb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.760298:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e235ac0b/0xa5e9c8c58c6eccb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.760306:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e235ac0b/0xa5e9c8c58c6eccb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.760371:0:55653:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6ecc4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.760379:0:55653:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6ecc4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.760387:0:55653:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6ecc4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.760400:0:55653:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000059b20141 already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305895.760403:0:55653:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6ecc4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.760411:0:55653:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6ecc4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.760422:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:2.0:1772305895.760425:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305895.760429:0:55653:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6ecc4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.760436:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6ecc4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.760447:0:55653:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e235ac0b/0xa5e9c8c58c6eccb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.760454:0:55653:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e235ac0b/0xa5e9c8c58c6eccb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.760460:0:55653:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000e235ac0b/0xa5e9c8c58c6eccb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.760467:0:55653:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e235ac0b already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305895.760469:0:55653:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e235ac0b/0xa5e9c8c58c6eccb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.760476:0:55653:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e235ac0b/0xa5e9c8c58c6eccb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.760491:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc16fdd55 (000000002ab31ac6) 00010000:00010000:2.0:1772305895.760494:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305895.760496:0:55653:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000e235ac0b/0xa5e9c8c58c6eccb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.760503:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e235ac0b/0xa5e9c8c58c6eccb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.760532:0:55653:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000cd3f7c05/0xa5e9c8c58c6ecbd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec53 expref: 46 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.760541:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cd3f7c05/0xa5e9c8c58c6ecbd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec53 expref: 46 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.760550:0:55653:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000cd3f7c05, rc 0) 00000100:00100000:2.0:1772305895.760612:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ad14d1c8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+45:95420:x1858396225350144:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 446us (618us total) trans 0 rc 301/301 00000100:00100000:2.0:1772305895.760621:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 737 00000100:00100000:2.0:1772305895.762604:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225350272 00000100:00100000:2.0:1772305895.762658:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 738 00000100:00100000:2.0:1772305895.762665:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000afa5cf5e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+45:95420:x1858396225350272:12345-192.168.203.30@tcp:36:lfs.0 00010000:00010000:2.0:1772305895.762695:0:55653:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1772305895.762708:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6eb6d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ebf8 expref: 45 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.762722:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:2.0:1772305895.762733:0:55653:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1772305895.762775:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d4c26f30/0xa5e9c8c58c6ecd2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.762787:0:55653:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000a8209eab/0xa5e9c8c58c6eb04 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ebd5 expref: 57 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.762796:0:55653:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d4c26f30/0xa5e9c8c58c6ecd2 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.762826:0:55653:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000a8209eab/0xa5e9c8c58c6eb04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ebd5 expref: 57 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.762838:0:55653:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000a8209eab/0xa5e9c8c58c6eb04 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ebd5 expref: 57 pid: 54698 timeout: 1307 lvb_type: 0 00000100:00100000:2.0:1772305895.762852:0:55653:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fd7b4ff5 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:55653:1858396216598720:192.168.203.30@tcp:104: 00000100:00100000:2.0:1772305895.762905:0:55653:0:(client.c:2500:ptlrpc_set_wait()) set 000000004fc0f9e2 going to sleep for 6 seconds 00000100:00100000:2.0:1772305895.763770:0:55653:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fd7b4ff5 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:55653:1858396216598720:192.168.203.30@tcp:104: 00010000:00010000:2.0:1772305895.763788:0:55653:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 00000000d4c26f30/0xa5e9c8c58c6ecd2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305895.763974:0:6323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225350336 00010000:00010000:1.0:1772305895.763991:0:6323:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a8209eab/0xa5e9c8c58c6eb04 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ebd5 expref: 58 pid: 54698 timeout: 1307 lvb_type: 0 00000100:00100000:1.0:1772305895.764017:0:6323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3071 00000100:00100000:1.0:1772305895.764021:0:6323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000008d2aeef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+58:2215:x1858396225350336:12345-192.168.203.30@tcp:103:ldlm_bl_06.0 00010000:00010000:1.0:1772305895.764029:0:6323:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1772305895.764032:0:6323:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000a8209eab/0xa5e9c8c58c6eb04 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ebd5 expref: 58 pid: 54698 timeout: 1307 lvb_type: 0 00010000:00010000:1.0:1772305895.764040:0:6323:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000a8209eab/0xa5e9c8c58c6eb04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ebd5 expref: 58 pid: 54698 timeout: 1307 lvb_type: 0 00010000:00010000:1.0:1772305895.764050:0:6323:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a8209eab/0xa5e9c8c58c6eb04 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ebd5 expref: 58 pid: 54698 timeout: 1307 lvb_type: 0 00010000:00010000:1.0:1772305895.764059:0:6323:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:1.0:1772305895.764061:0:6323:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: 00000000d4c26f30/0xa5e9c8c58c6ecd2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305895.764066:0:6323:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000d4c26f30/0xa5e9c8c58c6ecd2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305895.764070:0:6323:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d4c26f30/0xa5e9c8c58c6ecd2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305895.764085:0:6323:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1772305895.764110:0:6323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000008d2aeef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+57:2215:x1858396225350336:12345-192.168.203.30@tcp:103:ldlm_bl_06.0 Request processed in 87us (180us total) trans 0 rc 0/0 00010000:00010000:2.0:1772305895.764111:0:55653:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 00000000d4c26f30/0xa5e9c8c58c6ecd2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.764122:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d4c26f30/0xa5e9c8c58c6ecd2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305895.764132:0:6323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3071 00010000:00010000:2.0:1772305895.764146:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000bc6e3b0a/0xa5e9c8c58c6ecd9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.764164:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000bc6e3b0a/0xa5e9c8c58c6ecd9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.764174:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000bc6e3b0a/0xa5e9c8c58c6ecd9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1772305895.764811:0:55653:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000408:0x8a:0x0]: returning size 512 00010000:00010000:2.0:1772305895.764818:0:55653:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d4c26f30/0xa5e9c8c58c6ecd2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.764826:0:55653:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d4c26f30/0xa5e9c8c58c6ecd2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.764832:0:55653:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d4c26f30/0xa5e9c8c58c6ecd2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.764839:0:55653:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d4c26f30 already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305895.764842:0:55653:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d4c26f30/0xa5e9c8c58c6ecd2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.764848:0:55653:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d4c26f30/0xa5e9c8c58c6ecd2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.764858:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:2.0:1772305895.764861:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305895.764864:0:55653:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d4c26f30/0xa5e9c8c58c6ecd2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.764870:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d4c26f30/0xa5e9c8c58c6ecd2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1772305895.764888:0:55653:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000afa5cf5e reply state 00000000bc04d3c8 transno 8589934827 ns: mdt-lustre-MDT0000_UUID lock: 00000000bc6e3b0a/0xa5e9c8c58c6ecd9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305895.764945:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000afa5cf5e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+46:95420:x1858396225350272:12345-192.168.203.30@tcp:36:lfs.0 Request processed in 2280us (2402us total) trans 8589934827 rc 0/0 00000100:00100000:2.0:1772305895.764953:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 738 00010000:00010000:2.0:1772305895.765447:0:2977:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000bc6e3b0a/0xa5e9c8c58c6ecd9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.765456:0:2977:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000bc6e3b0a/0xa5e9c8c58c6ecd9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.765463:0:2977:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000bc6e3b0a/0xa5e9c8c58c6ecd9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.765470:0:2977:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000bc6e3b0a already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305895.765472:0:2977:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000bc6e3b0a/0xa5e9c8c58c6ecd9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.765479:0:2977:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000bc6e3b0a/0xa5e9c8c58c6ecd9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.765489:0:2977:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc16fdd55 (00000000922630d0) 00010000:00010000:2.0:1772305895.765491:0:2977:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305895.765494:0:2977:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000bc6e3b0a/0xa5e9c8c58c6ecd9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.765500:0:2977:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000bc6e3b0a/0xa5e9c8c58c6ecd9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305895.768752:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305895.768804:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225350400 00000100:00100000:2.0:1772305895.768847:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 739 00000100:00100000:2.0:1772305895.768853:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f45a42e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+45:95421:x1858396225350400:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:2.0:1772305895.768871:0:55653:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305895.768884:0:55653:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cd3f7c05/0xa5e9c8c58c6ece0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ec5a expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.768923:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e235ac0b/0xa5e9c8c58c6ece7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.768933:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e235ac0b/0xa5e9c8c58c6ece7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.768942:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e235ac0b/0xa5e9c8c58c6ece7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.768955:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6ecee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.768962:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6ecee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.768968:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6ecee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.769039:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000046ff413b/0xa5e9c8c58c6ecf5 lrc: 3/1,0 mode: --/PR res: [0x200000408:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.769048:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000046ff413b/0xa5e9c8c58c6ecf5 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.769065:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000046ff413b/0xa5e9c8c58c6ecf5 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1772305895.769092:0:55653:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000408:0x8a:0x0]: returning size 512 00000004:00200000:2.0:1772305895.769096:0:55653:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1772305895.769119:0:55653:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 0000000046ff413b/0xa5e9c8c58c6ecf5 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.769129:0:55653:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e235ac0b/0xa5e9c8c58c6ece7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.769135:0:55653:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e235ac0b/0xa5e9c8c58c6ece7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.769141:0:55653:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000e235ac0b/0xa5e9c8c58c6ece7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.769148:0:55653:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e235ac0b already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305895.769150:0:55653:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e235ac0b/0xa5e9c8c58c6ece7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.769156:0:55653:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e235ac0b/0xa5e9c8c58c6ece7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.769165:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:2.0:1772305895.769168:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305895.769171:0:55653:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000e235ac0b/0xa5e9c8c58c6ece7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.769177:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e235ac0b/0xa5e9c8c58c6ece7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.769194:0:55653:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6ecee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.769201:0:55653:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6ecee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.769207:0:55653:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6ecee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.769213:0:55653:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000059b20141 already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305895.769216:0:55653:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6ecee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.769222:0:55653:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6ecee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.769230:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc16fdd55 (000000002ab31ac6) 00010000:00010000:2.0:1772305895.769233:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305895.769235:0:55653:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6ecee lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.769241:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000059b20141/0xa5e9c8c58c6ecee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.769264:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cd3f7c05/0xa5e9c8c58c6ece0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec5a expref: 47 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.769274:0:55653:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000046ff413b/0xa5e9c8c58c6ecf5 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec5a expref: 46 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.769293:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8a:0x0].0x0 (00000000aa411403) 00010000:00010000:2.0:1772305895.769295:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1772305895.769297:0:55653:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000046ff413b, rc 0) 00000100:00100000:2.0:1772305895.769337:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f45a42e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+46:95421:x1858396225350400:12345-192.168.203.30@tcp:101:bash.0 Request processed in 482us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305895.769346:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 739 00000100:00100000:2.0:1772305895.770263:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225350464 00000100:00100000:2.0:1772305895.770294:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 740 00000100:00100000:2.0:1772305895.770300:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e9981b7b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+46:95421:x1858396225350464:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:2.0:1772305895.770309:0:55653:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305895.770320:0:55653:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f9809b02/0xa5e9c8c58c6ecfc lrc: 2/0,0 mode: --/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ec61 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.770348:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000007745523f/0xa5e9c8c58c6ed03 lrc: 3/1,0 mode: --/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.770358:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007745523f/0xa5e9c8c58c6ed03 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.770366:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007745523f/0xa5e9c8c58c6ed03 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.770378:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000060ddea38/0xa5e9c8c58c6ed0a lrc: 3/1,0 mode: --/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.770385:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000060ddea38/0xa5e9c8c58c6ed0a lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.770404:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000060ddea38/0xa5e9c8c58c6ed0a lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.770438:0:55653:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000007745523f/0xa5e9c8c58c6ed03 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.770447:0:55653:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000007745523f/0xa5e9c8c58c6ed03 lrc: 2/0,0 mode: CR/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.770454:0:55653:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000007745523f/0xa5e9c8c58c6ed03 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.770460:0:55653:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000007745523f already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305895.770463:0:55653:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007745523f/0xa5e9c8c58c6ed03 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.770469:0:55653:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007745523f/0xa5e9c8c58c6ed03 lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.770478:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8a:0x0].0x0 (00000000aa411403) 00010000:00010000:2.0:1772305895.770480:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305895.770482:0:55653:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000007745523f/0xa5e9c8c58c6ed03 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.770488:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007745523f/0xa5e9c8c58c6ed03 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.770498:0:55653:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000060ddea38/0xa5e9c8c58c6ed0a lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.770517:0:55653:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000060ddea38/0xa5e9c8c58c6ed0a lrc: 2/0,0 mode: PR/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.770524:0:55653:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000060ddea38/0xa5e9c8c58c6ed0a lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.770530:0:55653:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000060ddea38 already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305895.770533:0:55653:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000060ddea38/0xa5e9c8c58c6ed0a lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.770539:0:55653:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000060ddea38/0xa5e9c8c58c6ed0a lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.770547:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8a:0x0].0xd149d755 (00000000fc961c4f) 00010000:00010000:2.0:1772305895.770550:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305895.770552:0:55653:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000060ddea38/0xa5e9c8c58c6ed0a lrc: 2/0,0 mode: --/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.770559:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000060ddea38/0xa5e9c8c58c6ed0a lrc: 0/0,0 mode: --/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.770581:0:55653:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000f9809b02/0xa5e9c8c58c6ecfc lrc: 1/0,0 mode: --/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec61 expref: 47 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.770605:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f9809b02/0xa5e9c8c58c6ecfc lrc: 0/0,0 mode: --/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec61 expref: 47 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.770614:0:55653:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f9809b02, rc 0) 00000100:00100000:2.0:1772305895.770675:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e9981b7b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+46:95421:x1858396225350464:12345-192.168.203.30@tcp:101:bash.0 Request processed in 374us (455us total) trans 0 rc 301/301 00000100:00100000:2.0:1772305895.770686:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 740 00000100:00100000:2.0:1772305895.774804:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225350528 00000100:00100000:2.0:1772305895.774837:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 741 00000100:00100000:2.0:1772305895.774843:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f5cccb82 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+57:95422:x1858396225350528:12345-192.168.203.30@tcp:101:rm.0 00010000:00010000:2.0:1772305895.774855:0:55653:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305895.774867:0:55653:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000436f6222/0xa5e9c8c58c6ed11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ec68 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.774900:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000001cd42ccb/0xa5e9c8c58c6ed18 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.774912:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000001cd42ccb/0xa5e9c8c58c6ed18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.774922:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000001cd42ccb/0xa5e9c8c58c6ed18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.774934:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000021b53144/0xa5e9c8c58c6ed1f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.774942:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000021b53144/0xa5e9c8c58c6ed1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.774950:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000021b53144/0xa5e9c8c58c6ed1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.775019:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000003e79ccc6/0xa5e9c8c58c6ed26 lrc: 3/1,0 mode: --/PR res: [0x200000408:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.775035:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000003e79ccc6/0xa5e9c8c58c6ed26 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8a:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.775043:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000003e79ccc6/0xa5e9c8c58c6ed26 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8a:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1772305895.775070:0:55653:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000408:0x8a:0x0]: returning size 512 00000004:00200000:2.0:1772305895.775074:0:55653:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1772305895.775089:0:55653:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 000000003e79ccc6/0xa5e9c8c58c6ed26 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8a:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.775099:0:55653:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000001cd42ccb/0xa5e9c8c58c6ed18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.775106:0:55653:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000001cd42ccb/0xa5e9c8c58c6ed18 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.775113:0:55653:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000001cd42ccb/0xa5e9c8c58c6ed18 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.775120:0:55653:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000001cd42ccb already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305895.775123:0:55653:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001cd42ccb/0xa5e9c8c58c6ed18 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.775130:0:55653:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001cd42ccb/0xa5e9c8c58c6ed18 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.775139:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:2.0:1772305895.775142:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305895.775150:0:55653:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000001cd42ccb/0xa5e9c8c58c6ed18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.775158:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001cd42ccb/0xa5e9c8c58c6ed18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.775170:0:55653:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000021b53144/0xa5e9c8c58c6ed1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.775177:0:55653:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000021b53144/0xa5e9c8c58c6ed1f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.775184:0:55653:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000021b53144/0xa5e9c8c58c6ed1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.775191:0:55653:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000021b53144 already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305895.775193:0:55653:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000021b53144/0xa5e9c8c58c6ed1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.775200:0:55653:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000021b53144/0xa5e9c8c58c6ed1f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.775209:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc16fdd55 (00000000922630d0) 00010000:00010000:2.0:1772305895.775211:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305895.775213:0:55653:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000021b53144/0xa5e9c8c58c6ed1f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.775220:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000021b53144/0xa5e9c8c58c6ed1f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc16fdd55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.775241:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000436f6222/0xa5e9c8c58c6ed11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec68 expref: 59 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.775259:0:55653:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000003e79ccc6/0xa5e9c8c58c6ed26 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8a:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec68 expref: 58 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.775267:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8a:0x0].0x0 (00000000aa411403) 00010000:00010000:2.0:1772305895.775269:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1772305895.775271:0:55653:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003e79ccc6, rc 0) 00000100:00100000:2.0:1772305895.775306:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f5cccb82 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+58:95422:x1858396225350528:12345-192.168.203.30@tcp:101:rm.0 Request processed in 462us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305895.775314:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 741 00000100:00100000:3.0:1772305895.776466:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305895.776522:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225350592 00000100:00100000:2.0:1772305895.776560:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 742 00000100:00100000:2.0:1772305895.776566:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005215dd7f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+58:95422:x1858396225350592:12345-192.168.203.30@tcp:101:rm.0 00010000:00010000:2.0:1772305895.776576:0:55653:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305895.776601:0:55653:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e7775746/0xa5e9c8c58c6ed2d lrc: 2/0,0 mode: --/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ec6f expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.776651:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000bc6e3b0a/0xa5e9c8c58c6ed34 lrc: 3/1,0 mode: --/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.776661:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000bc6e3b0a/0xa5e9c8c58c6ed34 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.776669:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000bc6e3b0a/0xa5e9c8c58c6ed34 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.776681:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000d4c26f30/0xa5e9c8c58c6ed3b lrc: 3/1,0 mode: --/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.776701:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d4c26f30/0xa5e9c8c58c6ed3b lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.776709:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d4c26f30/0xa5e9c8c58c6ed3b lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.776739:0:55653:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000bc6e3b0a/0xa5e9c8c58c6ed34 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.776747:0:55653:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000bc6e3b0a/0xa5e9c8c58c6ed34 lrc: 2/0,0 mode: CR/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.776754:0:55653:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000bc6e3b0a/0xa5e9c8c58c6ed34 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.776760:0:55653:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000bc6e3b0a already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305895.776763:0:55653:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000bc6e3b0a/0xa5e9c8c58c6ed34 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.776769:0:55653:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000bc6e3b0a/0xa5e9c8c58c6ed34 lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.776777:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8a:0x0].0x0 (00000000aa411403) 00010000:00010000:2.0:1772305895.776779:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305895.776781:0:55653:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000bc6e3b0a/0xa5e9c8c58c6ed34 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.776787:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000bc6e3b0a/0xa5e9c8c58c6ed34 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.776808:0:55653:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000d4c26f30/0xa5e9c8c58c6ed3b lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.776814:0:55653:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d4c26f30/0xa5e9c8c58c6ed3b lrc: 2/0,0 mode: PR/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.776820:0:55653:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d4c26f30/0xa5e9c8c58c6ed3b lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.776826:0:55653:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d4c26f30 already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305895.776828:0:55653:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d4c26f30/0xa5e9c8c58c6ed3b lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.776834:0:55653:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d4c26f30/0xa5e9c8c58c6ed3b lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.776843:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8a:0x0].0xd149d755 (000000003080597a) 00010000:00010000:2.0:1772305895.776845:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305895.776847:0:55653:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d4c26f30/0xa5e9c8c58c6ed3b lrc: 2/0,0 mode: --/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.776853:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d4c26f30/0xa5e9c8c58c6ed3b lrc: 0/0,0 mode: --/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.776875:0:55653:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000e7775746/0xa5e9c8c58c6ed2d lrc: 1/0,0 mode: --/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec6f expref: 59 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.776883:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e7775746/0xa5e9c8c58c6ed2d lrc: 0/0,0 mode: --/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec6f expref: 59 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.776903:0:55653:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e7775746, rc 0) 00000100:00100000:2.0:1772305895.776938:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005215dd7f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+58:95422:x1858396225350592:12345-192.168.203.30@tcp:101:rm.0 Request processed in 371us (476us total) trans 0 rc 301/301 00000100:00100000:2.0:1772305895.776946:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 742 00000100:00100000:2.0:1772305895.777958:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225350656 00000100:00100000:2.0:1772305895.777988:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 743 00000100:00100000:2.0:1772305895.777994:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ed1d7a7d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+58:95422:x1858396225350656:12345-192.168.203.30@tcp:101:rm.0 00010000:00010000:2.0:1772305895.778003:0:55653:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305895.778013:0:55653:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e8ea7e31/0xa5e9c8c58c6ed42 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ec76 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.778039:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6ed49 lrc: 3/1,0 mode: --/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.778048:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6ed49 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.778056:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6ed49 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.778067:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6ed50 lrc: 3/1,0 mode: --/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.778074:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6ed50 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.778081:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6ed50 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.778115:0:55653:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6ed49 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.778123:0:55653:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6ed49 lrc: 2/0,0 mode: CR/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.778130:0:55653:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6ed49 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.778136:0:55653:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000010dea6ba already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305895.778138:0:55653:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6ed49 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.778145:0:55653:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6ed49 lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.778153:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8a:0x0].0x0 (00000000aa411403) 00010000:00010000:2.0:1772305895.778156:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305895.778158:0:55653:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6ed49 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.778164:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6ed49 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.778174:0:55653:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6ed50 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.778181:0:55653:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6ed50 lrc: 2/0,0 mode: PR/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.778201:0:55653:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6ed50 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.778207:0:55653:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ad568b72 already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305895.778210:0:55653:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6ed50 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.778217:0:55653:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6ed50 lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.778225:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8a:0x0].0xd149d755 (00000000e64b4432) 00010000:00010000:2.0:1772305895.778228:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305895.778230:0:55653:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6ed50 lrc: 2/0,0 mode: --/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.778236:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6ed50 lrc: 0/0,0 mode: --/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.778256:0:55653:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000e8ea7e31/0xa5e9c8c58c6ed42 lrc: 1/0,0 mode: --/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec76 expref: 59 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.778265:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e8ea7e31/0xa5e9c8c58c6ed42 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec76 expref: 59 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.778272:0:55653:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e8ea7e31, rc 0) 00000100:00100000:2.0:1772305895.778305:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ed1d7a7d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+58:95422:x1858396225350656:12345-192.168.203.30@tcp:101:rm.0 Request processed in 310us (388us total) trans 0 rc 301/301 00000100:00100000:2.0:1772305895.778312:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 743 00000100:00100000:2.0:1772305895.785853:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225350720 00000100:00100000:2.0:1772305895.785895:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 744 00000100:00100000:2.0:1772305895.785903:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000470e7e85 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+58:95423:x1858396225350720:12345-192.168.203.30@tcp:101:cp.0 00010000:00010000:2.0:1772305895.785916:0:55653:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305895.785931:0:55653:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c6ed57 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ec7d expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.785975:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000fd78dae3/0xa5e9c8c58c6ed5e lrc: 3/1,0 mode: --/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.785987:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000fd78dae3/0xa5e9c8c58c6ed5e lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.785998:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000fd78dae3/0xa5e9c8c58c6ed5e lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.786011:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c6ed65 lrc: 3/1,0 mode: --/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.786019:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c6ed65 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.786026:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c6ed65 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.786074:0:55653:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000fd78dae3/0xa5e9c8c58c6ed5e lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.786082:0:55653:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000fd78dae3/0xa5e9c8c58c6ed5e lrc: 2/0,0 mode: CR/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.786104:0:55653:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000fd78dae3/0xa5e9c8c58c6ed5e lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.786111:0:55653:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000fd78dae3 already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305895.786114:0:55653:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000fd78dae3/0xa5e9c8c58c6ed5e lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.786121:0:55653:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000fd78dae3/0xa5e9c8c58c6ed5e lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.786132:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8a:0x0].0x0 (00000000aa411403) 00010000:00010000:2.0:1772305895.786135:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305895.786138:0:55653:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000fd78dae3/0xa5e9c8c58c6ed5e lrc: 2/0,0 mode: --/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.786144:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000fd78dae3/0xa5e9c8c58c6ed5e lrc: 0/0,0 mode: --/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.786155:0:55653:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c6ed65 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.786162:0:55653:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c6ed65 lrc: 2/0,0 mode: PR/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.786168:0:55653:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c6ed65 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.786174:0:55653:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000007319ba46 already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305895.786176:0:55653:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c6ed65 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.786189:0:55653:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c6ed65 lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.786198:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8a:0x0].0xd149d755 (00000000922630d0) 00010000:00010000:2.0:1772305895.786201:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305895.786203:0:55653:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c6ed65 lrc: 2/0,0 mode: --/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.786209:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c6ed65 lrc: 0/0,0 mode: --/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.786236:0:55653:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c6ed57 lrc: 1/0,0 mode: --/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec7d expref: 59 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.786245:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c6ed57 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec7d expref: 59 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.786254:0:55653:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000089dbe966, rc 0) 00000100:00100000:2.0:1772305895.786296:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000470e7e85 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+58:95423:x1858396225350720:12345-192.168.203.30@tcp:101:cp.0 Request processed in 393us (496us total) trans 0 rc 301/301 00000100:00100000:2.0:1772305895.786305:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 744 00000100:00100000:3.0:1772305895.787292:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305895.787343:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225350784 00000100:00100000:2.0:1772305895.787371:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 745 00000100:00100000:2.0:1772305895.787375:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e2a011a7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+58:95423:x1858396225350784:12345-192.168.203.30@tcp:101:cp.0 00010000:00010000:2.0:1772305895.787383:0:55653:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305895.787391:0:55653:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c937f2b9/0xa5e9c8c58c6ed6c lrc: 2/0,0 mode: --/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ec84 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.787428:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e44a0294/0xa5e9c8c58c6ed73 lrc: 3/1,0 mode: --/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.787442:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e44a0294/0xa5e9c8c58c6ed73 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.787447:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e44a0294/0xa5e9c8c58c6ed73 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.787455:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6ed7a lrc: 3/1,0 mode: --/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.787460:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6ed7a lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.787464:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6ed7a lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.787489:0:55653:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e44a0294/0xa5e9c8c58c6ed73 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.787493:0:55653:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e44a0294/0xa5e9c8c58c6ed73 lrc: 2/0,0 mode: CR/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.787496:0:55653:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000e44a0294/0xa5e9c8c58c6ed73 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.787500:0:55653:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e44a0294 already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305895.787502:0:55653:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e44a0294/0xa5e9c8c58c6ed73 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.787511:0:55653:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e44a0294/0xa5e9c8c58c6ed73 lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.787517:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8a:0x0].0x0 (00000000aa411403) 00010000:00010000:2.0:1772305895.787519:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305895.787521:0:55653:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000e44a0294/0xa5e9c8c58c6ed73 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.787524:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e44a0294/0xa5e9c8c58c6ed73 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.787531:0:55653:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6ed7a lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.787534:0:55653:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6ed7a lrc: 2/0,0 mode: PR/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.787538:0:55653:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6ed7a lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.787541:0:55653:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006c757b88 already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305895.787542:0:55653:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6ed7a lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.787546:0:55653:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6ed7a lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.787549:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8a:0x0].0xd149d755 (00000000fc961c4f) 00010000:00010000:2.0:1772305895.787551:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305895.787555:0:55653:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6ed7a lrc: 2/0,0 mode: --/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.787559:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6ed7a lrc: 0/0,0 mode: --/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.787576:0:55653:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000c937f2b9/0xa5e9c8c58c6ed6c lrc: 1/0,0 mode: --/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec84 expref: 59 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.787580:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c937f2b9/0xa5e9c8c58c6ed6c lrc: 0/0,0 mode: --/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec84 expref: 59 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.787601:0:55653:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c937f2b9, rc 0) 00000100:00100000:2.0:1772305895.787682:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e2a011a7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+58:95423:x1858396225350784:12345-192.168.203.30@tcp:101:cp.0 Request processed in 305us (395us total) trans 0 rc 301/301 00000100:00100000:2.0:1772305895.787688:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 745 00000100:00100000:2.0:1772305895.788823:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225350912 00000100:00100000:2.0:1772305895.788857:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 746 00000100:00100000:2.0:1772305895.788862:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000053f40a87 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+58:95423:x1858396225350912:12345-192.168.203.30@tcp:101:cp.0 00010000:00010000:2.0:1772305895.788872:0:55653:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305895.788883:0:55653:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e8ea7e31/0xa5e9c8c58c6ed81 lrc: 2/0,0 mode: --/CW res: [0x200000408:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ec8b expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.788944:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6ed88 lrc: 3/0,1 mode: --/CW res: [0x200000408:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.788953:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6ed88 lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.788962:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6ed88 lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.788983:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6ed8f lrc: 3/0,1 mode: --/PW res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.788989:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6ed8f lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.788994:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6ed8f lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1772305895.789386:0:55653:0:(osp_object.c:1645:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x100000000:0x1ac:0x0], index 0: 0 00010000:00010000:2.0:1772305895.789531:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c1692f64/0xa5e9c8c58c6ed96 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x324:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.789542:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c1692f64/0xa5e9c8c58c6ed96 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x324:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.789549:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c1692f64/0xa5e9c8c58c6ed96 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x324:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.789581:0:55653:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6ed88 lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.789606:0:55653:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6ed88 lrc: 2/0,0 mode: CW/CW res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.789613:0:55653:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6ed88 lrc: 3/0,0 mode: CW/CW res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.789619:0:55653:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ad568b72 already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305895.789657:0:55653:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6ed88 lrc: 3/0,0 mode: CW/CW res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.789665:0:55653:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6ed88 lrc: 4/0,0 mode: CW/CW res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.789675:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8a:0x0].0x0 (00000000aa411403) 00010000:00010000:2.0:1772305895.789678:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305895.789681:0:55653:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6ed88 lrc: 2/0,0 mode: --/CW res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.789687:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6ed88 lrc: 0/0,0 mode: --/CW res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1772305895.789697:0:55653:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000053f40a87 reply state 00000000bc50ebb5 transno 8589934828 ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6ed8f lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.789724:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e8ea7e31/0xa5e9c8c58c6ed81 lrc: 0/0,0 mode: --/CW res: [0x200000408:0x8a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec8b expref: 61 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.789736:0:55653:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000c1692f64/0xa5e9c8c58c6ed96 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x324:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec8b expref: 60 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.789756:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x324:0x0].0x0 (000000003080597a) 00010000:00010000:2.0:1772305895.789762:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1772305895.789765:0:55653:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c1692f64, rc 0) 00000100:00100000:2.0:1772305895.789813:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000053f40a87 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+61:95423:x1858396225350912:12345-192.168.203.30@tcp:101:cp.0 Request processed in 949us (1030us total) trans 8589934828 rc 0/0 00000100:00100000:2.0:1772305895.789820:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 746 00010000:00010000:2.0:1772305895.790464:0:2978:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6ed8f lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.790471:0:2978:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6ed8f lrc: 2/0,0 mode: PW/PW res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.790475:0:2978:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6ed8f lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.790478:0:2978:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000010dea6ba already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305895.790479:0:2978:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6ed8f lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.790483:0:2978:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6ed8f lrc: 4/0,0 mode: PW/PW res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.790489:0:2978:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8a:0x0].0xd149d755 (00000000e64b4432) 00010000:00010000:2.0:1772305895.790490:0:2978:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305895.790492:0:2978:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6ed8f lrc: 2/0,0 mode: --/PW res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.790495:0:2978:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6ed8f lrc: 0/0,0 mode: --/PW res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305895.791019:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225350976 00000100:00100000:2.0:1772305895.791058:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 747 00000100:00100000:2.0:1772305895.791066:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000035b59d41 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+60:95423:x1858396225350976:12345-192.168.203.30@tcp:101:cp.0 00010000:00010000:2.0:1772305895.791080:0:55653:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305895.791091:0:55653:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c6eda4 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ec92 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.791141:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000858b0755/0xa5e9c8c58c6edab lrc: 3/1,0 mode: --/PR res: [0x200000402:0x324:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.791151:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000858b0755/0xa5e9c8c58c6edab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x324:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.791159:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000858b0755/0xa5e9c8c58c6edab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x324:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1772305895.791180:0:55653:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1772305895.791192:0:55653:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000858b0755/0xa5e9c8c58c6edab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x324:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.791201:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000858b0755/0xa5e9c8c58c6edab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x324:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.791217:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c6eda4 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec92 expref: 62 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.791228:0:55653:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000858b0755/0xa5e9c8c58c6edab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x324:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec92 expref: 61 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.791235:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x324:0x0].0x0 (000000003080597a) 00010000:00010000:2.0:1772305895.791237:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1772305895.791240:0:55653:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000858b0755, rc 0) 00000100:00100000:2.0:1772305895.791273:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000035b59d41 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+61:95423:x1858396225350976:12345-192.168.203.30@tcp:101:cp.0 Request processed in 208us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305895.791281:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 747 00000100:00100000:2.0:1772305895.792457:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225351040 00000100:00100000:2.0:1772305895.792494:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5689 00000100:00100000:2.0:1772305895.792500:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006121cd31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+222:2215:x1858396225351040:12345-192.168.203.30@tcp:101:cp.0 00010000:00010000:2.0:1772305895.792508:0:6306:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305895.792520:0:6306:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063369192/0xa5e9c8c58c6edb2 lrc: 2/0,0 mode: --/PR res: [0x1ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ec99 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1772305895.792536:0:6306:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x1ac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1772305895.792546:0:6306:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1772305895.792548:0:6306:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1772305895.792553:0:6306:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063369192/0xa5e9c8c58c6edb2 lrc: 3/0,0 mode: PR/PR res: [0x1ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec99 expref: 223 pid: 6306 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1772305895.792561:0:6306:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000063369192/0xa5e9c8c58c6edb2 lrc: 3/0,0 mode: PR/PR res: [0x1ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec99 expref: 223 pid: 6306 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1772305895.792568:0:6306:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000063369192, rc 0) 00000100:00100000:2.0:1772305895.792608:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006121cd31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+223:2215:x1858396225351040:12345-192.168.203.30@tcp:101:cp.0 Request processed in 108us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305895.792613:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5689 00000100:00100000:3.0:1772305895.793544:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305895.793595:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225351104 00000100:00100000:2.0:1772305895.793664:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5690 00000100:00100000:2.0:1772305895.793672:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c221b79d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+223:95423:x1858396225351104:12345-192.168.203.30@tcp:101:cp.0 00010000:00010000:2.0:1772305895.793682:0:6306:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305895.793692:0:6306:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c6edb9 lrc: 2/0,0 mode: --/PW res: [0x1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196eca0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.793727:0:6306:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000063369192/0xa5e9c8c58c6edb2 lrc: 2/0,0 mode: PR/PR res: [0x1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec99 expref: 224 pid: 6306 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1772305895.793739:0:6306:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1772305895.793741:0:6306:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1772305895.793743:0:6306:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c6edb9 lrc: 4/0,0 mode: --/PW res: [0x1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eca0 expref: 224 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.793773:0:6306:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000063369192/0xa5e9c8c58c6edb2 lrc: 3/0,0 mode: PR/PR res: [0x1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec99 expref: 224 pid: 6306 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1772305895.793785:0:6306:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000063369192/0xa5e9c8c58c6edb2 lrc: 4/0,0 mode: PR/PR res: [0x1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec99 expref: 224 pid: 6306 timeout: 1307 lvb_type: 1 00000100:00100000:2.0:1772305895.793798:0:6306:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fd7b4ff5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6306:1858396216598784:192.168.203.30@tcp:104: 00000100:00100000:2.0:1772305895.793854:0:6306:0:(client.c:2500:ptlrpc_set_wait()) set 000000004fc0f9e2 going to sleep for 6 seconds 00000100:00100000:2.0:1772305895.794580:0:6306:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fd7b4ff5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6306:1858396216598784:192.168.203.30@tcp:104: 00010000:00010000:2.0:1772305895.794616:0:6306:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c6edb9 lrc: 3/0,0 mode: --/PW res: [0x1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eca0 expref: 224 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305895.794652:0:6306:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f20d88bd, rc 0) 00000100:00100000:2.0:1772305895.794689:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c221b79d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+224:95423:x1858396225351104:12345-192.168.203.30@tcp:101:cp.0 Request processed in 1016us (1144us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305895.794698:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5690 00000100:00100000:3.0:1772305895.794748:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305895.794811:0:6323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225351168 00010000:00010000:1.0:1772305895.794834:0:6323:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000063369192/0xa5e9c8c58c6edb2 lrc: 4/0,0 mode: PR/PR res: [0x1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec99 expref: 224 pid: 6306 timeout: 1307 lvb_type: 1 00000100:00100000:1.0:1772305895.794864:0:6323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3072 00000100:00100000:1.0:1772305895.794869:0:6323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000166181f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+224:2215:x1858396225351168:12345-192.168.203.30@tcp:103:ldlm_bl_07.0 00010000:00010000:1.0:1772305895.794878:0:6323:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1772305895.794889:0:6323:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000063369192/0xa5e9c8c58c6edb2 lrc: 4/0,0 mode: PR/PR res: [0x1ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec99 expref: 224 pid: 6306 timeout: 1307 lvb_type: 1 00010000:00010000:1.0:1772305895.794897:0:6323:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000063369192/0xa5e9c8c58c6edb2 lrc: 3/0,0 mode: PR/PR res: [0x1ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec99 expref: 224 pid: 6306 timeout: 1307 lvb_type: 1 00010000:00010000:1.0:1772305895.794910:0:6323:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063369192/0xa5e9c8c58c6edb2 lrc: 0/0,0 mode: --/PR res: [0x1ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ec99 expref: 224 pid: 6306 timeout: 1307 lvb_type: 1 00010000:00010000:1.0:1772305895.794918:0:6323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305895.794919:0:6323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305895.794923:0:6323:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c6edb9 lrc: 2/0,0 mode: PW/PW res: [0x1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eca0 expref: 223 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305895.794927:0:6323:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c6edb9 lrc: 3/0,0 mode: PW/PW res: [0x1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eca0 expref: 223 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305895.794944:0:6323:0:(ldlm_lockd.c:1069:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c6edb9 lrc: 3/0,0 mode: PW/PW res: [0x1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eca0 expref: 223 pid: 6306 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305895.794958:0:6323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000041a87633 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6323:1858396216598848:192.168.203.30@tcp:105: 00000100:00100000:1.0:1772305895.794991:0:6323:0:(client.c:2500:ptlrpc_set_wait()) set 00000000a00d77ac going to sleep for 6 seconds 00000100:00100000:1.0:1772305895.795763:0:6323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000041a87633 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6323:1858396216598848:192.168.203.30@tcp:105: 00010000:00010000:1.0:1772305895.795778:0:6323:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1772305895.795807:0:6323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000166181f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+223:2215:x1858396225351168:12345-192.168.203.30@tcp:103:ldlm_bl_07.0 Request processed in 936us (1061us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305895.795815:0:6323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3072 00000100:00100000:2.0:1772305895.796122:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225351296 00000100:00100000:2.0:1772305895.796171:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 94 00000100:00100000:2.0:1772305895.796178:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000ff69ea6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+61:95423:x1858396225351296:12345-192.168.203.30@tcp:35:cp.0 00000100:00100000:2.0:1772305895.796446:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000ff69ea6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+62:95423:x1858396225351296:12345-192.168.203.30@tcp:35:cp.0 Request processed in 268us (388us total) trans 8589934829 rc 0/0 00000100:00100000:2.0:1772305895.796456:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 94 00000100:00100000:1.0:1772305895.881756:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b250dcf6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216598912:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1772305895.881771:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a95f9a22 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216598976:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1772305895.881825:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305895.881862:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772305895.881922:0:7591:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 445 00000100:00100000:2.0:1772305895.881933:0:7591:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006c142a39 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216598976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1772305895.881972:0:7591:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 693436416 pending 0 free 3606052864 avail 3603955712 00000100:00100000:2.0:1772305895.882032:0:7591:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006c142a39 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216598976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305895.882042:0:7591:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 445 00000100:00100000:3.0:1772305895.882062:0:2991:0:(client.c:2868:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968342 gen 2 00000004:00080000:3.0:1772305895.882068:0:2991:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000e9e81c30, transno 4294968342 00000100:00100000:1.0:1772305895.882069:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b250dcf6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216598912:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1772305895.882087:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a95f9a22 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216598976:0@lo:13:osp-pre-1-0.0 00000040:00100000:2.0:1772305895.882097:0:54721:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 9 in log [0xd:0x1:0x0] 00010000:00010000:2.0:1772305896.137825:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1772305896.328761:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305896.328767:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305896.328803:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 33 count 9 00000040:00080000:1.0:1772305896.328809:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:3.0:1772305896.392790:0:2991:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1772305896.392792:0:2992:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1772305896.392820:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008806aae9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:70aae467-c860-409f-ba1b-742f4d042da6:2991:1858396216599040:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1772305896.392820:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f237ebcd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216599296:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1772305896.392820:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d23a5281 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:2993:1858396216599104:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1772305896.392905:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305896.392909:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305896.392910:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772305896.392943:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000ec0ed54 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216599232:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1772305896.392944:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000080e4cc77 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:2993:1858396216599360:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305896.392966:0:54689:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216599040 00000100:00100000:1.0:1772305896.392982:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772305896.392993:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305896.393011:0:2993:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1772305896.393020:0:54689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1772305896.393022:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000012371d1b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:2993:1858396216599168:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305896.393032:0:54689:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d998c0bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70aae467-c860-409f-ba1b-742f4d042da6+18:2991:x1858396216599040:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1772305896.393048:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216599296 00000100:00100000:1.0:1772305896.393054:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305896.393091:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216599104 00000100:00100000:2.0:1772305896.393093:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216599232 00000100:00100000:3.0:1772305896.393101:0:54689:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d998c0bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70aae467-c860-409f-ba1b-742f4d042da6+18:2991:x1858396216599040:12345-0@lo:400:kworker/u8:0.0 Request processed in 69us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305896.393111:0:54689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1772305896.393124:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216599360 00000100:00100000:2.0:1772305896.393130:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1161 00000100:00100000:2.0:1772305896.393138:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e9e81c30 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216599296:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305896.393174:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1772305896.393178:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216599168 00000100:00100000:3.0:1772305896.393182:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002fe0dc56 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:2993:x1858396216599104:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1772305896.393192:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e9e81c30 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216599296:12345-0@lo:400:kworker/u8:0.0 Request processed in 54us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305896.393204:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1161 00000100:00100000:1.0:1772305896.393205:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1772305896.393213:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005254ed4a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:2993:x1858396216599360:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1772305896.393231:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1162 00000100:00100000:3.0:1772305896.393241:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002fe0dc56 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:2993:x1858396216599104:12345-0@lo:400:kworker/u8:0.0 Request processed in 58us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305896.393248:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fd7b4ff5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216599232:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1772305896.393254:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005254ed4a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:2993:x1858396216599360:12345-0@lo:400:kworker/u8:0.0 Request processed in 39us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305896.393268:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1772305896.393276:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1772305896.393296:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1772305896.393303:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fd7b4ff5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216599232:12345-0@lo:400:kworker/u8:0.0 Request processed in 53us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305896.393308:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000676f9e41 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:2993:x1858396216599168:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1772305896.393316:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1162 00000100:00100000:3.0:1772305896.393350:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000676f9e41 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:2993:x1858396216599168:12345-0@lo:400:kworker/u8:0.0 Request processed in 46us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305896.393359:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1772305896.393378:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f237ebcd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216599296:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1772305896.393396:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000012371d1b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:2993:1858396216599168:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1772305896.393402:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000ec0ed54 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216599232:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305896.393406:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008806aae9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:70aae467-c860-409f-ba1b-742f4d042da6:2991:1858396216599040:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1772305896.393418:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d23a5281 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:2993:1858396216599104:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1772305896.393437:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000080e4cc77 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:2993:1858396216599360:0@lo:400:kworker/u8:0.0 00000020:00000080:2.0:1772305896.674211:0:67912:0:(class_obd.c:302:class_handle_ioctl()) cmd = c008667f 00000020:00000080:2.0:1772305896.674218:0:67912:0:(class_obd.c:126:class_resolve_dev_name()) device name lustre-MDT0000 00000020:00000080:2.0:1772305896.674222:0:67912:0:(class_obd.c:133:class_resolve_dev_name()) device name lustre-MDT0000, dev 5 00000020:00000080:2.0:1772305896.674239:0:67912:0:(class_obd.c:302:class_handle_ioctl()) cmd = 424066b1 00000004:00000080:2.0:1772305896.674244:0:67912:0:(mdt_handler.c:7411:mdt_iocontrol()) handling ioctl cmd 0x424066b1 00000040:00080000:2.0:1772305896.674407:0:67912:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x11:0x0].10, 80 off8992 00000004:00000080:2.0:1772305896.674422:0:67912:0:(mdd_device.c:1821:mdd_changelog_user_register()) lustre-MDD0000: registered changelog user 'cl10', mask 0x0 00000004:02000000:2.0:1772305896.674424:0:67912:0:(mdd_device.c:460:mdd_changelog_on()) lustre-MDD0000: changelog on 00000100:00100000:3.0:1772305896.698435:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305896.698498:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225351360 00000100:00100000:1.0:1772305896.698558:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 748 00000100:00100000:1.0:1772305896.698568:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a95f9a22 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+46:95460:x1858396225351360:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1772305896.698600:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305896.698623:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000008260c3b/0xa5e9c8c58c6edc0 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196eca7 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305896.698746:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6edc7 lrc: 3/1,0 mode: --/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305896.698761:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6edc7 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305896.698773:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6edc7 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305896.698790:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e326753f/0xa5e9c8c58c6edce lrc: 3/1,0 mode: --/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305896.698811:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e326753f/0xa5e9c8c58c6edce lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305896.698820:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e326753f/0xa5e9c8c58c6edce lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305896.698931:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000367b2753/0xa5e9c8c58c6edd5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x324:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305896.698942:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000367b2753/0xa5e9c8c58c6edd5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x324:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305896.698949:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000367b2753/0xa5e9c8c58c6edd5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x324:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1772305896.698982:0:54697:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x324:0x0]: returning size 1516 00000004:00200000:1.0:1772305896.698986:0:54697:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1772305896.699004:0:54697:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000367b2753/0xa5e9c8c58c6edd5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x324:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305896.699016:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000367b2753/0xa5e9c8c58c6edd5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x324:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305896.699025:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6edc7 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305896.699032:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6edc7 lrc: 2/0,0 mode: CR/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305896.699039:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6edc7 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305896.699054:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000089168eb already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305896.699058:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6edc7 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305896.699066:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6edc7 lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305896.699079:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8a:0x0].0x0 (00000000aa411403) 00010000:00010000:1.0:1772305896.699082:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305896.699087:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6edc7 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305896.699107:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6edc7 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305896.699122:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e326753f/0xa5e9c8c58c6edce lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305896.699129:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e326753f/0xa5e9c8c58c6edce lrc: 2/0,0 mode: PR/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305896.699136:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000e326753f/0xa5e9c8c58c6edce lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305896.699142:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e326753f already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305896.699145:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e326753f/0xa5e9c8c58c6edce lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305896.699151:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e326753f/0xa5e9c8c58c6edce lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305896.699167:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8a:0x0].0xd149d755 (00000000663af6c8) 00010000:00010000:1.0:1772305896.699170:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305896.699173:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000e326753f/0xa5e9c8c58c6edce lrc: 2/0,0 mode: --/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305896.699179:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e326753f/0xa5e9c8c58c6edce lrc: 0/0,0 mode: --/PR res: [0x200000408:0x8a:0x0].0xd149d755 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305896.699212:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000008260c3b/0xa5e9c8c58c6edc0 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eca7 expref: 48 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305896.699226:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000367b2753/0xa5e9c8c58c6edd5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x324:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eca7 expref: 47 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305896.699233:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x324:0x0].0x0 (000000003080597a) 00010000:00010000:1.0:1772305896.699236:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1772305896.699239:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000367b2753, rc 0) 00000100:00100000:1.0:1772305896.699299:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a95f9a22 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+47:95460:x1858396225351360:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 732us (867us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305896.699308:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 748 00000100:00100000:2.0:1772305896.700479:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305896.700525:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225351424 00000100:00100000:1.0:1772305896.700568:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5691 00000100:00100000:1.0:1772305896.700574:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004ebc4db7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+160:2218:x1858396225351424:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1772305896.700597:0:6307:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305896.700611:0:6307:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee5a0681/0xa5e9c8c58c6eddc lrc: 2/0,0 mode: --/PR res: [0x1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ecae expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305896.700700:0:6307:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000080e4cc77 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6307:1858396216599424:192.168.203.30@tcp:106: 00000100:00100000:1.0:1772305896.700756:0:6307:0:(client.c:2500:ptlrpc_set_wait()) set 000000006324b5a0 going to sleep for 6 seconds 00002000:00010000:1.0:1772305896.701556:0:6307:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x1ac:0x0:0x0] updating lvb size: 0 -> 1516 00002000:00010000:1.0:1772305896.701559:0:6307:0:(ofd_lvb.c:284:ofd_lvbo_update()) res: [0x1ac:0x0:0x0] updating lvb mtime: 0 -> 1772305895 00002000:00010000:1.0:1772305896.701561:0:6307:0:(ofd_lvb.c:290:ofd_lvbo_update()) res: [0x1ac:0x0:0x0] updating lvb atime: 0 -> 1772305895 00002000:00010000:1.0:1772305896.701562:0:6307:0:(ofd_lvb.c:296:ofd_lvbo_update()) res: [0x1ac:0x0:0x0] updating lvb ctime: 0 -> 1772305895 00000100:00100000:1.0:1772305896.701575:0:6307:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000080e4cc77 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6307:1858396216599424:192.168.203.30@tcp:106: 00010000:00010000:1.0:1772305896.701611:0:6307:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ee5a0681/0xa5e9c8c58c6eddc lrc: 1/0,0 mode: --/PR res: [0x1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ecae expref: 161 pid: 6307 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1772305896.701620:0:6307:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee5a0681/0xa5e9c8c58c6eddc lrc: 0/0,0 mode: --/PR res: [0x1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ecae expref: 161 pid: 6307 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1772305896.701650:0:6307:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ee5a0681, rc 0) 00000100:00100000:1.0:1772305896.701682:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004ebc4db7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+160:2218:x1858396225351424:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 1107us (1204us total) trans 0 rc 301/301 00000100:00100000:1.0:1772305896.701689:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5691 00000100:00100000:3.0:1772305896.702960:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305896.703007:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225351488 00000100:00100000:1.0:1772305896.703045:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 749 00000100:00100000:1.0:1772305896.703052:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002254491d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+47:95460:x1858396225351488:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1772305896.703064:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305896.703075:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007c4072b2/0xa5e9c8c58c6ede3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ecb5 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305896.703121:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000016b42150/0xa5e9c8c58c6edea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305896.703142:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000016b42150/0xa5e9c8c58c6edea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305896.703153:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000016b42150/0xa5e9c8c58c6edea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1772305896.703200:0:54697:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:1.0:1772305896.703203:0:54697:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 105 stripe count 1 MDT count 1 00000004:00010000:1.0:1772305896.703219:0:54697:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 0000000016b42150/0xa5e9c8c58c6edea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305896.703235:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007c4072b2/0xa5e9c8c58c6ede3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ecb5 expref: 49 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305896.703244:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000016b42150/0xa5e9c8c58c6edea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ecb5 expref: 48 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305896.703249:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:1.0:1772305896.703250:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1772305896.703252:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000016b42150, rc 0) 00000100:00100000:1.0:1772305896.703281:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002254491d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+48:95460:x1858396225351488:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 230us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305896.703286:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 749 00000100:00100000:3.0:1772305896.704151:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305896.704195:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225351552 00000100:00100000:1.0:1772305896.704233:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 750 00000100:00100000:1.0:1772305896.704240:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000000ce11a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+48:95460:x1858396225351552:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1772305896.704250:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305896.704268:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000008260c3b/0xa5e9c8c58c6edf1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ecbc expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305896.704300:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e326753f/0xa5e9c8c58c6edf8 lrc: 3/1,0 mode: --/PR res: [0x200000408:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305896.704311:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e326753f/0xa5e9c8c58c6edf8 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305896.704320:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e326753f/0xa5e9c8c58c6edf8 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1772305896.704355:0:54697:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000408:0x8a:0x0]: returning size 512 00000004:00200000:1.0:1772305896.704359:0:54697:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1772305896.704375:0:54697:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000e326753f/0xa5e9c8c58c6edf8 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305896.704406:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000008260c3b/0xa5e9c8c58c6edf1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ecbc expref: 50 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305896.704421:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000e326753f/0xa5e9c8c58c6edf8 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ecbc expref: 49 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305896.704429:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8a:0x0].0x0 (00000000aa411403) 00010000:00010000:1.0:1772305896.704432:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1772305896.704434:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e326753f, rc 0) 00000100:00100000:1.0:1772305896.704472:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000000ce11a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+49:95460:x1858396225351552:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 231us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305896.704481:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 750 00000100:00100000:2.0:1772305896.705515:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305896.705557:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225351616 00000100:00100000:1.0:1772305896.705613:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5692 00000100:00100000:1.0:1772305896.705619:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001770c2e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+160:2216:x1858396225351616:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1772305896.705650:0:6307:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305896.705664:0:6307:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6edff lrc: 2/0,0 mode: --/PR res: [0x1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ecc3 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305896.705710:0:6307:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000080e4cc77 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6307:1858396216599488:192.168.203.30@tcp:106: 00000100:00100000:1.0:1772305896.705755:0:6307:0:(client.c:2500:ptlrpc_set_wait()) set 000000006324b5a0 going to sleep for 6 seconds 00000100:00100000:1.0:1772305896.706509:0:6307:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000080e4cc77 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6307:1858396216599488:192.168.203.30@tcp:106: 00010000:00010000:1.0:1772305896.706526:0:6307:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6edff lrc: 1/0,0 mode: --/PR res: [0x1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ecc3 expref: 161 pid: 6307 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1772305896.706536:0:6307:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6edff lrc: 0/0,0 mode: --/PR res: [0x1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ecc3 expref: 161 pid: 6307 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1772305896.706544:0:6307:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000089168eb, rc 0) 00000100:00100000:1.0:1772305896.706574:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001770c2e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+160:2216:x1858396225351616:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 954us (1059us total) trans 0 rc 301/301 00000100:00100000:1.0:1772305896.706592:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5692 00000100:00100000:2.0:1772305896.708308:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305896.708348:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225351744 00000100:00100000:1.0:1772305896.708393:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 751 00000100:00100000:1.0:1772305896.708402:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cd147362 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+49:95460:x1858396225351744:12345-192.168.203.30@tcp:58:lfs.0 00000040:00080000:1.0:1772305896.708660:0:54697:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xf:0x0].33, 136 off12680 00000100:00100000:1.0:1772305896.708749:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cd147362 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+49:95460:x1858396225351744:12345-192.168.203.30@tcp:58:lfs.0 Request processed in 348us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305896.708756:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 751 00000040:00080000:3.0:1772305896.997040:0:67961:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305896.997044:0:67961:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305896.997093:0:67961:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 34 count 10 00000040:00080000:3.0:1772305896.997097:0:67961:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772305897.160784:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1772305897.352787:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305897.352794:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305897.352837:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 34 count 10 00000040:00080000:1.0:1772305897.352846:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:1.0:1772305897.353071:0:54732:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x13:0x0].47, 136 off15912 00000100:00100000:1.0:1772305897.353177:0:54732:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000080e4cc77 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:54732:1858396216599552:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1772305897.353250:0:54732:0:(client.c:2500:ptlrpc_set_wait()) set 00000000f00b50d2 going to sleep for 6 seconds 00000100:00100000:1.0:1772305897.354765:0:54732:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000080e4cc77 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:54732:1858396216599552:192.168.203.30@tcp:107:hsm_cdtr.0 00000040:00080000:1.0:1772305897.354847:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305897.354850:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305897.354909:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 34 count 10 00000040:00080000:1.0:1772305897.354914:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:2.0:1772305897.355223:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305897.355290:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225351808 00000100:00100000:1.0:1772305897.355359:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 752 00000100:00100000:1.0:1772305897.355368:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a26b6941 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+62:95471:x1858396225351808:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1772305897.355403:0:54697:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x324:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1772305897.355495:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a26b6941 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+62:95471:x1858396225351808:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 127us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305897.355504:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 752 00000100:00100000:2.0:1772305897.356710:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305897.356786:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225351936 00000100:00100000:1.0:1772305897.356832:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 753 00000100:00100000:1.0:1772305897.356838:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000049ea3c34 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+62:95471:x1858396225351936:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1772305897.356858:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305897.356882:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6ee06 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ecca expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305897.356962:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000008260c3b/0xa5e9c8c58c6ee0d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305897.356995:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000008260c3b/0xa5e9c8c58c6ee0d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305897.357006:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000008260c3b/0xa5e9c8c58c6ee0d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305897.357019:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000007c4072b2/0xa5e9c8c58c6ee14 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xd8f7e46e bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305897.357024:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007c4072b2/0xa5e9c8c58c6ee14 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xd8f7e46e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305897.357029:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007c4072b2/0xa5e9c8c58c6ee14 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xd8f7e46e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305897.357092:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000ee5a0681/0xa5e9c8c58c6ee1b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x324:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305897.357102:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ee5a0681/0xa5e9c8c58c6ee1b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x324:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305897.357109:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ee5a0681/0xa5e9c8c58c6ee1b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x324:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1772305897.357120:0:54697:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x324:0x0]: returning size 1516 00010000:00010000:1.0:1772305897.357237:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000008260c3b/0xa5e9c8c58c6ee0d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305897.357245:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000008260c3b/0xa5e9c8c58c6ee0d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305897.357267:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000008260c3b/0xa5e9c8c58c6ee0d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305897.357281:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000008260c3b already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305897.357285:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000008260c3b/0xa5e9c8c58c6ee0d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305897.357294:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000008260c3b/0xa5e9c8c58c6ee0d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305897.357309:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (00000000c78481f6) 00010000:00010000:1.0:1772305897.357312:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305897.357317:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000008260c3b/0xa5e9c8c58c6ee0d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305897.357324:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000008260c3b/0xa5e9c8c58c6ee0d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305897.357336:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000007c4072b2/0xa5e9c8c58c6ee14 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xd8f7e46e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305897.357341:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000007c4072b2/0xa5e9c8c58c6ee14 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xd8f7e46e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305897.357345:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000007c4072b2/0xa5e9c8c58c6ee14 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xd8f7e46e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305897.357348:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000007c4072b2 already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305897.357349:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007c4072b2/0xa5e9c8c58c6ee14 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xd8f7e46e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305897.357359:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007c4072b2/0xa5e9c8c58c6ee14 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xd8f7e46e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305897.357365:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xd8f7e46e (00000000663af6c8) 00010000:00010000:1.0:1772305897.357366:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305897.357368:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000007c4072b2/0xa5e9c8c58c6ee14 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xd8f7e46e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305897.357372:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007c4072b2/0xa5e9c8c58c6ee14 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xd8f7e46e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305897.357403:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6ee06 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ecca expref: 65 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305897.357416:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000ee5a0681/0xa5e9c8c58c6ee1b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x324:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ecca expref: 64 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305897.357424:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x324:0x0].0x0 (000000003080597a) 00010000:00010000:1.0:1772305897.357426:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1772305897.357429:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ee5a0681, rc 0) 00000100:00100000:1.0:1772305897.357480:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000049ea3c34 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+64:95471:x1858396225351936:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 641us (778us total) trans 8589934830 rc 0/0 00000100:00100000:1.0:1772305897.357489:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 753 00000100:00100000:2.0:1772305897.358878:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305897.358909:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305897.358958:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225352064 00000100:00100000:1.0:1772305897.359010:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5693 00000100:00100000:1.0:1772305897.359018:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000edb23783 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+223:2215:x1858396225352064:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1772305897.359054:0:6307:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6ee29 lrc: 3/1,0 mode: --/PR res: [0x1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305897.359091:0:6307:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c6edb9 lrc: 2/0,0 mode: PW/PW res: [0x1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eca0 expref: 223 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305897.359102:0:6307:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1772305897.359105:0:6307:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1772305897.359107:0:6307:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6ee29 lrc: 4/1,0 mode: --/PR res: [0x1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305897.359150:0:6307:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c6edb9 lrc: 3/0,0 mode: PW/PW res: [0x1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eca0 expref: 223 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305897.359167:0:6307:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c6edb9 lrc: 4/0,0 mode: PW/PW res: [0x1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eca0 expref: 223 pid: 6306 timeout: 1309 lvb_type: 0 00000100:00100000:1.0:1772305897.359185:0:6307:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000080e4cc77 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6307:1858396216599616:192.168.203.30@tcp:104: 00000100:00100000:1.0:1772305897.359233:0:6307:0:(client.c:2500:ptlrpc_set_wait()) set 00000000d2c34cb5 going to sleep for 6 seconds 00000100:00100000:1.0:1772305897.360074:0:6307:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000080e4cc77 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6307:1858396216599616:192.168.203.30@tcp:104: 00010000:00010000:1.0:1772305897.360098:0:6307:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6ee29 lrc: 3/1,0 mode: --/PR res: [0x1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305897.360373:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305897.360450:0:21399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225352128 00002000:00100000:3.0:1772305897.360477:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ac:0x0] (0->1515) req@0000000023b4ec49 x1858396225352128/t0(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:28/0 lens 2008/0 e 0 to 0 dl 1772305903 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cp.0' 00002000:00100000:3.0:1772305897.360487:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 0000000023b4ec49 with x1858396225352128 ext(0->1515) 00010000:00010000:3.0:1772305897.360494:0:21399:0:(ldlm_lockd.c:601:ldlm_refresh_waiting_lock()) ### refreshed to 56s ns: filter-lustre-OST0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c6edb9 lrc: 4/0,0 mode: PW/PW res: [0x1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eca0 expref: 224 pid: 6306 timeout: 1309 lvb_type: 0 00002000:00010000:3.0:1772305897.360501:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req 0000000023b4ec49 00000100:00100000:3.0:1772305897.360520:0:21399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 64 00000100:00100000:3.0:1772305897.360525:0:21399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000023b4ec49 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+224:2215:x1858396225352128:12345-192.168.203.30@tcp:4:cp.0 00000100:00100000:3.0:1772305897.361081:0:21399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000023b4ec49 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+226:2215:x1858396225352128:12345-192.168.203.30@tcp:4:cp.0 Request processed in 555us (711us total) trans 4294968304 rc 0/0 00000100:00100000:3.0:1772305897.361088:0:21399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 64 00002000:00100000:3.0:1772305897.361094:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ac:0x0] (0->1515) req@0000000023b4ec49 x1858396225352128/t4294968304(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:28/0 lens 2008/448 e 0 to 0 dl 1772305903 ref 1 fl Complete:H/0/0 rc 0/0 job:'cp.0' 00002000:00100000:3.0:1772305897.361100:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 0000000023b4ec49 with x1858396225352128 ext(0->1515) 00010000:00010000:3.0:1772305897.361107:0:21399:0:(ldlm_lockd.c:601:ldlm_refresh_waiting_lock()) ### refreshed to 56s ns: filter-lustre-OST0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c6edb9 lrc: 4/0,0 mode: PW/PW res: [0x1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eca0 expref: 226 pid: 6306 timeout: 1309 lvb_type: 0 00002000:00010000:3.0:1772305897.361114:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req 0000000023b4ec49 00000100:00100000:2.0:1772305897.362084:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00010000:1.0:1772305897.362404:0:6307:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6ee29 lrc: 3/1,0 mode: PR/PR res: [0x1ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305897.362435:0:6307:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6ee29 lrc: 3/1,0 mode: PR/PR res: [0x1ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305897.362495:0:6307:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6ee29 lrc: 3/1,0 mode: PR/PR res: [0x1ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305897.362504:0:6307:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6ee29 lrc: 2/0,0 mode: PR/PR res: [0x1ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305897.362529:0:6307:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1772305897.362592:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000edb23783 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+224:2215:x1858396225352064:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 Request processed in 3572us (3680us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305897.362604:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5693 00010000:00010000:3.0:1772305897.362621:0:5496:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1772305897.362656:0:5496:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6ee29 lrc: 2/0,0 mode: PR/PR res: [0x1ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305897.362665:0:5496:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000004a9f3864 already unused, calling callback (00000000b5e4f3c0) 00010000:00010000:3.0:1772305897.362670:0:5496:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6ee29 lrc: 2/0,0 mode: PR/PR res: [0x1ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305897.362677:0:5496:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6ee29 lrc: 3/0,0 mode: PR/PR res: [0x1ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305897.362734:0:5496:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6ee29 lrc: 1/0,0 mode: --/PR res: [0x1ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305897.362741:0:5496:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6ee29 lrc: 0/0,0 mode: --/PR res: [0x1ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305897.362765:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1772305897.362767:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1772305897.362768:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1772305897.363403:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305897.363461:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225352320 00000100:00100000:1.0:1772305897.363507:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 754 00000100:00100000:1.0:1772305897.363517:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008e341f60 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+63:95471:x1858396225352320:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1772305897.363622:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008e341f60 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+63:95471:x1858396225352320:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 107us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305897.363692:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 754 00000100:00100000:2.0:1772305897.364983:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305897.365049:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225352384 00000100:00100000:1.0:1772305897.365085:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5694 00000100:00100000:1.0:1772305897.365092:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006f4c803f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+224:2216:x1858396225352384:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1772305897.365105:0:6307:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305897.365127:0:6307:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6ee30 lrc: 2/0,0 mode: --/PR res: [0x1ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ecd1 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1772305897.365150:0:6307:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x1ac:0x0] initial LVB size: 1516, mtime: 0x69a33de7, atime: 0x0, ctime: 0x69a33de7, blocks: 0x1 00010000:00010000:1.0:1772305897.365180:0:6307:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305897.365182:0:6307:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305897.365191:0:6307:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6ee30 lrc: 3/0,0 mode: PR/PR res: [0x1ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ecd1 expref: 225 pid: 6307 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1772305897.365210:0:6307:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000089168eb/0xa5e9c8c58c6ee30 lrc: 3/0,0 mode: PR/PR res: [0x1ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ecd1 expref: 225 pid: 6307 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1772305897.365227:0:6307:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000089168eb, rc 0) 00000100:00100000:1.0:1772305897.365255:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006f4c803f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+225:2216:x1858396225352384:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 164us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305897.365260:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5694 00000100:00100000:2.0:1772305897.366065:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305897.366108:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225352512 00000100:00100000:1.0:1772305897.366134:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 755 00000100:00100000:1.0:1772305897.366139:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009adfd4b0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+63:95471:x1858396225352512:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1772305897.366190:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009adfd4b0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+63:95471:x1858396225352512:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 50us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305897.366195:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 755 00000100:00100000:2.0:1772305897.367220:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305897.367265:0:21399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225352640 00002000:00100000:3.0:1772305897.367303:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ac:0x0] (0->4095) req@0000000096c63f8a x1858396225352640/t0(0) o3->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:28/0 lens 488/0 e 0 to 0 dl 1772305903 ref 1 fl New:/0/ffffffff rc 0/-1 job:'lhsmtool_posix.0' 00002000:00100000:3.0:1772305897.367315:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 0000000096c63f8a with x1858396225352640 ext(0->4095) 00002000:00010000:3.0:1772305897.367319:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000096c63f8a 00000100:00100000:3.0:1772305897.367341:0:21399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2039 00000100:00100000:3.0:1772305897.367345:0:21399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000096c63f8a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+225:2215:x1858396225352640:12345-192.168.203.30@tcp:3:lhsmtool_posix.0 00000100:00100000:3.0:1772305897.367494:0:21399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000096c63f8a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+225:2215:x1858396225352640:12345-192.168.203.30@tcp:3:lhsmtool_posix.0 Request processed in 148us (278us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1772305897.367501:0:21399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2039 00002000:00100000:3.0:1772305897.367507:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ac:0x0] (0->4095) req@0000000096c63f8a x1858396225352640/t0(0) o3->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:28/0 lens 488/4536 e 0 to 0 dl 1772305903 ref 1 fl Complete:/0/0 rc 4096/4096 job:'lhsmtool_posix.0' 00002000:00100000:3.0:1772305897.367513:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 0000000096c63f8a with x1858396225352640 ext(0->4095) 00002000:00010000:3.0:1772305897.367516:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000096c63f8a 00000100:00100000:2.0:1772305897.368805:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305897.368894:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225352704 00000100:00100000:1.0:1772305897.368938:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 756 00000100:00100000:1.0:1772305897.368948:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009e643511 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+63:95471:x1858396225352704:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1772305897.368963:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305897.368984:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007c4072b2/0xa5e9c8c58c6ee37 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x324:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ecd8 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305897.369024:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000008260c3b/0xa5e9c8c58c6ee3e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x324:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305897.369053:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000008260c3b/0xa5e9c8c58c6ee3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x324:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305897.369067:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000008260c3b/0xa5e9c8c58c6ee3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x324:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305897.369166:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007c4072b2/0xa5e9c8c58c6ee37 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x324:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ecd8 expref: 65 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305897.369186:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000008260c3b/0xa5e9c8c58c6ee3e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x324:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ecd8 expref: 64 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305897.369194:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x324:0x0].0x0 (000000003080597a) 00010000:00010000:1.0:1772305897.369198:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1772305897.369201:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000008260c3b, rc 0) 00000100:00100000:1.0:1772305897.369247:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009e643511 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+64:95471:x1858396225352704:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 301us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305897.369256:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 756 00000100:00100000:2.0:1772305897.370661:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305897.370709:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225352768 00000100:00100000:1.0:1772305897.370762:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 757 00000100:00100000:1.0:1772305897.370771:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000065549302 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+64:95471:x1858396225352768:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1772305897.370794:0:54697:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x324:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1772305897.370876:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000065549302 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+64:95471:x1858396225352768:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 107us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305897.370886:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 757 00000100:00100000:2.0:1772305897.371874:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305897.371912:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225352832 00000100:00100000:1.0:1772305897.371948:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5695 00000100:00100000:1.0:1772305897.371952:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ba314d1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+225:2216:x1858396225352832:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1772305897.371979:0:6307:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6ee45 lrc: 3/1,0 mode: --/PR res: [0x1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305897.371990:0:6307:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305897.371992:0:6307:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305897.371997:0:6307:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6ee45 lrc: 3/1,0 mode: PR/PR res: [0x1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305897.372006:0:6307:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6ee45 lrc: 3/1,0 mode: PR/PR res: [0x1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305897.372026:0:6307:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6ee45 lrc: 3/1,0 mode: PR/PR res: [0x1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305897.372032:0:6307:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6ee45 lrc: 2/0,0 mode: PR/PR res: [0x1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305897.372048:0:6307:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1772305897.372058:0:38581:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1772305897.372064:0:38581:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6ee45 lrc: 2/0,0 mode: PR/PR res: [0x1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305897.372075:0:38581:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000043f9fbca already unused, calling callback (00000000b5e4f3c0) 00010000:00010000:3.0:1772305897.372078:0:38581:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6ee45 lrc: 2/0,0 mode: PR/PR res: [0x1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305897.372086:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ba314d1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+225:2216:x1858396225352832:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 Request processed in 130us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305897.372097:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5695 00010000:00010000:3.0:1772305897.372113:0:38581:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6ee45 lrc: 3/0,0 mode: PR/PR res: [0x1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305897.372129:0:38581:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6ee45 lrc: 1/0,0 mode: --/PR res: [0x1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305897.372133:0:38581:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6ee45 lrc: 0/0,0 mode: --/PR res: [0x1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305897.372143:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1772305897.372145:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1772305897.372146:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1772305897.372878:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305897.372917:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225352960 00000100:00100000:1.0:1772305897.372943:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 758 00000100:00100000:1.0:1772305897.372948:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000081fffd7c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+64:95471:x1858396225352960:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000040:00080000:1.0:1772305897.373230:0:54697:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x13:0x0].48, 168 off16080 00000040:00080000:1.0:1772305897.373332:0:54697:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x13:0x0].49, 168 off16248 00000001:00080000:1.0:1772305897.373343:0:54697:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934831 00000040:00080000:1.0:1772305897.373413:0:54697:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305897.373418:0:54697:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305897.373479:0:54697:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 34 count 10 00000040:00080000:1.0:1772305897.373487:0:54697:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:1.0:1772305897.373541:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000081fffd7c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+65:95471:x1858396225352960:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 591us (665us total) trans 8589934831 rc 0/0 00000100:00100000:1.0:1772305897.373548:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 758 00000040:00080000:3.0:1772305897.373612:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305897.373615:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305897.374163:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 10 00000040:00080000:3.0:1772305897.374172:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:2.0:1772305897.374411:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305897.374449:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225353088 00000100:00100000:3.0:1772305897.374492:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 95 00000100:00100000:3.0:1772305897.374499:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e5233900 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+65:95471:x1858396225353088:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1772305897.374731:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e5233900 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+66:95471:x1858396225353088:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 232us (323us total) trans 8589934832 rc 0/0 00000100:00100000:3.0:1772305897.374738:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 95 00010000:00010000:2.0:1772305898.184704:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1772305898.296537:0:68013:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305898.296542:0:68013:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305898.296605:0:68013:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 34 count 10 00000040:00080000:1.0:1772305898.296609:0:68013:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:2.0:1772305898.313164:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305898.313210:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225353152 00000100:00100000:1.0:1772305898.313257:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5696 00000100:00100000:1.0:1772305898.313264:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000035fd0397 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+160:2218:x1858396225353152:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1772305898.313280:0:6307:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305898.313298:0:6307:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c4072b2/0xa5e9c8c58c6ee4c lrc: 2/0,0 mode: --/PR res: [0x1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ecdf expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305898.313317:0:6307:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305898.313319:0:6307:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305898.313327:0:6307:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c4072b2/0xa5e9c8c58c6ee4c lrc: 3/0,0 mode: PR/PR res: [0x1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ecdf expref: 161 pid: 6307 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1772305898.313339:0:6307:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007c4072b2/0xa5e9c8c58c6ee4c lrc: 3/0,0 mode: PR/PR res: [0x1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ecdf expref: 161 pid: 6307 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1772305898.313350:0:6307:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007c4072b2, rc 0) 00000100:00100000:1.0:1772305898.313401:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000035fd0397 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+161:2218:x1858396225353152:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 138us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305898.313414:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5696 00000100:00100000:2.0:1772305898.315711:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305898.315753:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225353280 00000100:00100000:3.0:1772305898.315792:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 759 00000100:00100000:3.0:1772305898.315796:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fc01b397 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+49:95479:x1858396225353280:12345-192.168.203.30@tcp:58:lfs.0 00000040:00080000:3.0:1772305898.315977:0:54697:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xf:0x0].34, 136 off12816 00000100:00100000:3.0:1772305898.316035:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fc01b397 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+49:95479:x1858396225353280:12345-192.168.203.30@tcp:58:lfs.0 Request processed in 238us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305898.316042:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 759 00000040:00080000:2.0:1772305898.377784:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305898.377791:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305898.377837:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 35 count 11 00000040:00080000:2.0:1772305898.377845:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:2.0:1772305898.377925:0:54732:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000465b750e pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:54732:1858396216599680:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1772305898.377999:0:54732:0:(client.c:2500:ptlrpc_set_wait()) set 00000000070e5679 going to sleep for 6 seconds 00000100:00100000:3.0:1772305898.379387:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305898.379439:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225353344 00000100:00100000:1.0:1772305898.379487:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 760 00000100:00100000:1.0:1772305898.379495:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000537dbec0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+66:95489:x1858396225353344:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1772305898.379527:0:54697:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x324:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1772305898.379610:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000537dbec0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+66:95489:x1858396225353344:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 114us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305898.379620:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 760 00000100:00100000:3.0:1772305898.380668:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305898.380726:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225353472 00000100:00100000:1.0:1772305898.380764:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 761 00000100:00100000:1.0:1772305898.380771:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cc3c0696 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+66:95489:x1858396225353472:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1772305898.380783:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305898.380803:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000008cc4789a/0xa5e9c8c58c6ee53 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ece6 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305898.380876:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6ee5a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x324:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305898.380891:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6ee5a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x324:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305898.380903:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6ee5a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x324:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1772305898.380915:0:54697:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x324:0x0]: returning size 1516 00010000:00010000:1.0:1772305898.381014:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000008cc4789a/0xa5e9c8c58c6ee53 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ece6 expref: 69 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305898.381046:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6ee5a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x324:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ece6 expref: 68 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305898.381056:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x324:0x0].0x0 (000000003080597a) 00010000:00010000:1.0:1772305898.381059:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1772305898.381062:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043f9fbca, rc 0) 00000100:00100000:1.0:1772305898.381100:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cc3c0696 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+68:95489:x1858396225353472:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 328us (434us total) trans 8589934833 rc 0/0 00000100:00100000:1.0:1772305898.381108:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 761 00000100:00100000:2.0:1772305898.382032:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305898.382450:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000040:00080000:2.0:1772305898.383127:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305898.383131:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305898.383530:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 11 00000040:00080000:2.0:1772305898.383536:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:3.0:1772305898.383851:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305898.383888:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225353792 00000100:00100000:2.0:1772305898.383917:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 96 00000100:00100000:2.0:1772305898.383922:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000032bc5322 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+68:95489:x1858396225353792:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1772305898.384022:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000032bc5322 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:95489:x1858396225353792:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 100us (174us total) trans 8589934835 rc 0/0 00000100:00100000:2.0:1772305898.384028:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 96 00000100:00100000:2.0:1772305898.563922:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305898.563958:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305898.563980:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305898.564006:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225353920 00000100:00100000:2.0:1772305898.564024:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305898.564046:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225354048 00000100:00100000:2.0:1772305898.564069:0:6308:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225353984 00000100:00100000:1.0:1772305898.564073:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1163 00000100:00100000:1.0:1772305898.564078:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ab80ba74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+225:2218:x1858396225353920:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1772305898.564115:0:6308:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1164 00000100:00100000:1.0:1772305898.564118:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ab80ba74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+225:2218:x1858396225353920:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 33us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305898.564129:0:6308:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000010235c68 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+140:2218:x1858396225354048:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1772305898.564141:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1163 00000100:00100000:2.0:1772305898.564175:0:6308:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000010235c68 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+140:2218:x1858396225354048:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 46us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305898.564176:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1165 00000100:00100000:1.0:1772305898.564186:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000093f32b77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2217:x1858396225353984:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1772305898.564190:0:6308:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1164 00000100:00100000:1.0:1772305898.564221:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000093f32b77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2217:x1858396225353984:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 36us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305898.564228:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1165 00000040:00080000:3.0:1772305898.597458:0:68064:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305898.597464:0:68064:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305898.597521:0:68064:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 35 count 11 00000040:00080000:3.0:1772305898.597526:0:68064:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:3.0:1772305898.624293:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305898.625339:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225354176 00000100:00100000:1.0:1772305898.625381:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 764 00000100:00100000:1.0:1772305898.625387:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000008d2aeef pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:95495:x1858396225354176:12345-192.168.203.30@tcp:503:chlg_load_threa.0 00000100:00100000:1.0:1772305898.625550:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000008d2aeef pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:95495:x1858396225354176:12345-192.168.203.30@tcp:503:chlg_load_threa.0 Request processed in 163us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305898.625556:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 764 00000100:00100000:2.0:1772305898.626233:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305898.626304:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225354240 00000100:00100000:1.0:1772305898.626343:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 765 00000100:00100000:1.0:1772305898.626349:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f345825e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:95495:x1858396225354240:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1772305898.626497:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f345825e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:95495:x1858396225354240:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 147us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305898.626507:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 765 00000100:00100000:2.0:1772305898.627185:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305898.627230:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225354304 00000100:00100000:1.0:1772305898.627265:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 766 00000100:00100000:1.0:1772305898.627271:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b26b7107 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:95495:x1858396225354304:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1772305898.627382:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b26b7107 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:95495:x1858396225354304:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 110us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305898.627388:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 766 00000100:00100000:1.0:1772305898.628082:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225354368 00000100:00100000:1.0:1772305898.628113:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 767 00000100:00100000:1.0:1772305898.628118:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000028a3b7a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:95495:x1858396225354368:12345-192.168.203.30@tcp:501:chlg_load_threa.0 00000100:00100000:1.0:1772305898.628161:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000028a3b7a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:95495:x1858396225354368:12345-192.168.203.30@tcp:501:chlg_load_threa.0 Request processed in 42us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305898.628168:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 767 00000100:00100000:2.0:1772305898.628760:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305898.629677:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305898.630480:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305898.631336:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00010000:3.0:1772305899.208754:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1772305900.453294:0:68260:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1772305900.453298:0:68260:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x11:0x1:0x0]:0 at index 1 of catalog [0x6:0xa:0x0] 00000040:00080000:2.0:1772305900.453322:0:68260:0:(llog.c:789:llog_process_thread()) stop processing plain 0x11:1:0 index 11 count 2 00000040:00080000:2.0:1772305900.453326:0:68260:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x6:10:0 index 2 count 2 00000100:00100000:2.0:1772305900.470355:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305900.470412:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225354688 00000100:00100000:1.0:1772305900.470462:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 772 00000100:00100000:1.0:1772305900.470469:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000068a71b8a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:95928:x1858396225354688:12345-192.168.203.30@tcp:46:lfs.0 00000004:00000080:1.0:1772305900.470512:0:54697:0:(mdt_handler.c:7411:mdt_iocontrol()) handling ioctl cmd 0x424066b3 00000004:00000080:1.0:1772305900.470547:0:54697:0:(mdd_device.c:2125:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=10, endrec=0 00000040:00080000:1.0:1772305900.470672:0:54697:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1772305900.470676:0:54697:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x11:0x1:0x0]:0 at index 1 of catalog [0x6:0xa:0x0] 00000004:00000080:1.0:1772305900.470723:0:54697:0:(mdd_device.c:2095:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl10 endrec = 51 00000040:00080000:1.0:1772305900.470779:0:54697:0:(llog.c:789:llog_process_thread()) stop processing plain 0x11:1:0 index 11 count 2 00000040:00080000:1.0:1772305900.470785:0:54697:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x6:10:0 index 2 count 2 00000004:00000080:1.0:1772305900.470791:0:54697:0:(mdd_device.c:2173:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl10 entries up to 18446744073709551615 00000040:00080000:1.0:1772305900.470835:0:54697:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1772305900.470838:0:54697:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x13:0x1:0x0]:0 at index 1 of catalog [0x5:0xa:0x0] 00000040:00100000:1.0:1772305900.470879:0:54697:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 47 in log [0x13:0x1:0x0] 00000040:00100000:1.0:1772305900.470946:0:54697:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 48 in log [0x13:0x1:0x0] 00000040:00100000:1.0:1772305900.470977:0:54697:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 49 in log [0x13:0x1:0x0] 00000040:00100000:1.0:1772305900.471015:0:54697:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 51 in log [0x13:0x1:0x0] 00000040:00100000:1.0:1772305900.471077:0:54697:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 52 in log [0x13:0x1:0x0] 00000040:00080000:1.0:1772305900.471139:0:54697:0:(llog.c:789:llog_process_thread()) stop processing plain 0x13:1:0 index 52 count 1 00000040:00080000:1.0:1772305900.471146:0:54697:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x5:10:0 index 2 count 2 00000100:00100000:1.0:1772305900.471226:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000068a71b8a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:95928:x1858396225354688:12345-192.168.203.30@tcp:46:lfs.0 Request processed in 755us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305900.471234:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 772 00000001:00080000:3.0:1772305900.504597:0:6332:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-OST0000: transno 4294968304 is committed 00000001:00080000:2.0:1772305900.507708:0:54724:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934834 is committed 00000001:00080000:2.0:1772305900.507740:0:54724:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934835 is committed 00000001:00080000:2.0:1772305900.507756:0:54724:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934827 is committed 00000020:00000080:2.0:1772305900.751899:0:68311:0:(class_obd.c:302:class_handle_ioctl()) cmd = c008667f 00000020:00000080:2.0:1772305900.751906:0:68311:0:(class_obd.c:126:class_resolve_dev_name()) device name lustre-MDT0000 00000020:00000080:2.0:1772305900.751910:0:68311:0:(class_obd.c:133:class_resolve_dev_name()) device name lustre-MDT0000, dev 5 00000020:00000080:2.0:1772305900.751934:0:68311:0:(class_obd.c:302:class_handle_ioctl()) cmd = 424066b2 00000004:00000080:2.0:1772305900.751939:0:68311:0:(mdt_handler.c:7411:mdt_iocontrol()) handling ioctl cmd 0x424066b2 00000004:00000080:2.0:1772305900.751972:0:68311:0:(mdd_device.c:2125:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=10, endrec=0 00000040:00080000:2.0:1772305900.752032:0:68311:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1772305900.752035:0:68311:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x11:0x1:0x0]:0 at index 1 of catalog [0x6:0xa:0x0] 00000004:00000080:2.0:1772305900.752057:0:68311:0:(mdd_device.c:2095:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl10 endrec = 51 00000040:00080000:2.0:1772305900.752125:0:68311:0:(llog.c:789:llog_process_thread()) stop processing plain 0x11:1:0 index 11 count 2 00000040:00080000:2.0:1772305900.752136:0:68311:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x6:10:0 index 2 count 2 00000004:00000080:2.0:1772305900.752139:0:68311:0:(mdd_device.c:2173:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl10 entries up to 18446744073709551615 00000040:00080000:2.0:1772305900.752162:0:68311:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1772305900.752164:0:68311:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x13:0x1:0x0]:0 at index 1 of catalog [0x5:0xa:0x0] 00000040:00080000:2.0:1772305900.752519:0:68311:0:(llog.c:789:llog_process_thread()) stop processing plain 0x13:1:0 index 64768 count 1 00000040:00080000:2.0:1772305900.752521:0:68311:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x5:10:0 index 2 count 2 00000004:00000080:2.0:1772305900.752525:0:68311:0:(mdd_device.c:1983:mdd_changelog_user_purge()) lustre-MDD0000: Purge request: id=10 00000040:00080000:2.0:1772305900.752537:0:68311:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1772305900.752539:0:68311:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x11:0x1:0x0]:0 at index 1 of catalog [0x6:0xa:0x0] 00000040:00100000:2.0:1772305900.752566:0:68311:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 10 in log [0x11:0x1:0x0] 00000040:00080000:2.0:1772305900.752621:0:68311:0:(llog.c:789:llog_process_thread()) stop processing plain 0x11:1:0 index 10 count 1 00000040:00080000:2.0:1772305900.752624:0:68311:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x6:10:0 index 2 count 2 00000004:00000080:2.0:1772305900.752649:0:68311:0:(mdd_device.c:2005:mdd_changelog_user_purge()) turning off changelogs 00000004:02000000:2.0:1772305900.752651:0:68311:0:(mdd_device.c:483:mdd_changelog_off()) lustre-MDD0000: changelog off 00000004:00000080:2.0:1772305900.752655:0:68311:0:(mdd_device.c:2015:mdd_changelog_user_purge()) lustre-MDD0000: Purge changelog entries for user cl10 record=18446744073709551615 00000040:00080000:2.0:1772305900.752686:0:68311:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1772305900.752688:0:68311:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x13:0x1:0x0]:0 at index 1 of catalog [0x5:0xa:0x0] 00000040:00080000:2.0:1772305900.753042:0:68311:0:(llog.c:789:llog_process_thread()) stop processing plain 0x13:1:0 index 64768 count 1 00000040:00080000:2.0:1772305900.753045:0:68311:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x5:10:0 index 2 count 2 00000040:00080000:2.0:1772305900.753060:0:68311:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1772305900.753061:0:68311:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x11:0x1:0x0]:0 at index 1 of catalog [0x6:0xa:0x0] 00000040:00080000:2.0:1772305900.753444:0:68311:0:(llog.c:789:llog_process_thread()) stop processing plain 0x11:1:0 index 64768 count 1 00000040:00080000:2.0:1772305900.753449:0:68311:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x6:10:0 index 2 count 2 00000100:00100000:3.0:1772305901.000746:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ccddc55d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216599808:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1772305901.000759:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000059055e9c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216599744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1772305901.000810:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305901.000855:0:7591:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216599808 00000100:00100000:3.0:1772305901.000873:0:6310:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216599744 00000100:00100000:1.0:1772305901.000908:0:7591:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 447 00000100:00100000:3.0:1772305901.000916:0:6310:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 448 00000100:00100000:1.0:1772305901.000921:0:7591:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000903941fe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216599808:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1772305901.000926:0:6310:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006396c411 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216599744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1772305901.000960:0:6310:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 693436416 pending 0 free 3606052864 avail 3603955712 00002000:00000024:1.0:1772305901.000961:0:7591:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 740884480 pending 0 free 3829399552 avail 3827302400 00000100:00100000:3.0:1772305901.001005:0:6310:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006396c411 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216599744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305901.001010:0:6310:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 448 00000100:00100000:1.0:1772305901.001031:0:7591:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000903941fe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216599808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305901.001055:0:7591:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 447 00000100:00100000:3.0:1772305901.001062:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ccddc55d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216599808:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1772305901.042677:0:68359:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1772305901.042681:0:68359:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x11:0x1:0x0]:0 at index 1 of catalog [0x6:0xa:0x0] 00000040:00080000:2.0:1772305901.043041:0:68359:0:(llog.c:789:llog_process_thread()) stop processing plain 0x11:1:0 index 64768 count 1 00000040:00080000:2.0:1772305901.043046:0:68359:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x6:10:0 index 2 count 2 00000100:00100000:3.0:1772305901.079100:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305901.079161:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225354752 00000100:00100000:1.0:1772305901.079219:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 773 00000100:00100000:1.0:1772305901.079229:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004f1a5774 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+59:95419:x1858396225354752:12345-192.168.203.30@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1772305901.079318:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004f1a5774 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+59:95419:x1858396225354752:12345-192.168.203.30@tcp:60:lhsmtool_posix.0 Request processed in 91us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305901.079325:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 773 00010000:00010000:3.0:1772305901.256788:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772305901.512944:0:54689:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216599872 00000100:00100000:1.0:1772305901.512989:0:54689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1772305901.512995:0:54689:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002745ebe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70aae467-c860-409f-ba1b-742f4d042da6+18:2992:x1858396216599872:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772305901.513023:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c8bbbd9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:2994:1858396216600000:0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772305901.513040:0:54689:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002745ebe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70aae467-c860-409f-ba1b-742f4d042da6+18:2992:x1858396216599872:12345-0@lo:400:kworker/u8:4.0 Request processed in 43us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305901.513046:0:54689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1772305901.513075:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305901.513107:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216600000 00000100:00100000:2.0:1772305901.513109:0:2994:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1772305901.513132:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000166181f2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:2994:1858396216599936:0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772305901.513150:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1772305901.513158:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a648c204 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:2994:x1858396216600000:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772305901.513168:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305901.513212:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a648c204 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:2994:x1858396216600000:12345-0@lo:400:kworker/u8:4.0 Request processed in 53us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305901.513216:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c8bbbd9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:2994:1858396216600000:0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772305901.513222:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1772305901.513244:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216599936 00000100:00100000:1.0:1772305901.513275:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1772305901.513280:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000299df28c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:2994:x1858396216599936:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772305901.513323:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000299df28c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:2994:x1858396216599936:12345-0@lo:400:kworker/u8:4.0 Request processed in 43us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305901.513336:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1772305901.513363:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000166181f2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:2994:1858396216599936:0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772305901.513371:0:2991:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1772305901.513381:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007eaa6db7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216600128:0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772305901.513383:0:2994:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1772305901.513392:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004668f3b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:2994:1858396216600192:0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772305901.513407:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772305901.513428:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305901.513458:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216600128 00000100:00100000:3.0:1772305901.513494:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1167 00000100:00100000:3.0:1772305901.513499:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000080e4cc77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216600128:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772305901.513558:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000080e4cc77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216600128:12345-0@lo:400:kworker/u8:4.0 Request processed in 57us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305901.513566:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1167 00000100:00100000:1.0:1772305901.513579:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007eaa6db7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216600128:0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772305901.513622:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004668f3b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:2994:1858396216600192:0@lo:400:kworker/u8:4.0 00000400:00000080:2.0:1772305901.594277:0:68407:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:2.0:1772305901.594281:0:68407:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 224a: Changelog for failed remove ===== 14:11:41 (1772305901) 00000100:00100000:3.0:1772305901.704444:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305901.707676:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305901.709068:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305901.709123:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225355072 00000100:00100000:2.0:1772305901.709158:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 97 00000100:00100000:2.0:1772305901.709165:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000084abacb2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+61:96131:x1858396225355072:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1772305901.709311:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000084abacb2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+62:96131:x1858396225355072:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 146us (243us total) trans 8589934837 rc 0/0 00000100:00100000:2.0:1772305901.709319:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 97 00000100:00100000:3.0:1772305901.710248:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305901.717942:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305901.719879:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305901.721136:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00010000:1.0:1772305901.721346:0:54697:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 00000000c12bdb6b/0xa5e9c8c58c6eea7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.721356:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c12bdb6b/0xa5e9c8c58c6eea7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.721372:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000008cc4789a/0xa5e9c8c58c6eeae lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.721379:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000008cc4789a/0xa5e9c8c58c6eeae lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.721385:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000008cc4789a/0xa5e9c8c58c6eeae lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1772305901.721896:0:54697:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000408:0x8b:0x0]: returning size 512 00010000:00010000:1.0:1772305901.721901:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c12bdb6b/0xa5e9c8c58c6eea7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.721907:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c12bdb6b/0xa5e9c8c58c6eea7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.721911:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c12bdb6b/0xa5e9c8c58c6eea7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.721923:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c12bdb6b already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305901.721926:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c12bdb6b/0xa5e9c8c58c6eea7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.721930:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c12bdb6b/0xa5e9c8c58c6eea7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.721936:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:1.0:1772305901.721937:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305901.721939:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c12bdb6b/0xa5e9c8c58c6eea7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.721943:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c12bdb6b/0xa5e9c8c58c6eea7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1772305901.721949:0:54697:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000019df2d37 reply state 000000007588ed6d transno 8589934838 ns: mdt-lustre-MDT0000_UUID lock: 000000008cc4789a/0xa5e9c8c58c6eeae lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305901.721993:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000019df2d37 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+49:96132:x1858396225355328:12345-192.168.203.30@tcp:36:lfs.0 Request processed in 2043us (2115us total) trans 8589934838 rc 0/0 00000100:00100000:1.0:1772305901.721999:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 778 00010000:00010000:2.0:1772305901.722476:0:2977:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000008cc4789a/0xa5e9c8c58c6eeae lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305901.722487:0:2977:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000008cc4789a/0xa5e9c8c58c6eeae lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305901.722495:0:2977:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000008cc4789a/0xa5e9c8c58c6eeae lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305901.722513:0:2977:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000008cc4789a already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305901.722516:0:2977:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000008cc4789a/0xa5e9c8c58c6eeae lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305901.722523:0:2977:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000008cc4789a/0xa5e9c8c58c6eeae lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305901.722533:0:2977:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc5c1a1d9 (00000000c10a8182) 00010000:00010000:2.0:1772305901.722536:0:2977:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305901.722538:0:2977:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000008cc4789a/0xa5e9c8c58c6eeae lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305901.722559:0:2977:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000008cc4789a/0xa5e9c8c58c6eeae lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305901.725376:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305901.725417:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225355456 00000100:00100000:1.0:1772305901.725450:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 779 00000100:00100000:1.0:1772305901.725454:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004668f3b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+48:96133:x1858396225355456:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:1.0:1772305901.725469:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305901.725479:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6eeb5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ed02 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.725523:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000ee5a0681/0xa5e9c8c58c6eebc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.725531:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ee5a0681/0xa5e9c8c58c6eebc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.725536:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ee5a0681/0xa5e9c8c58c6eebc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.725558:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6eec3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.725565:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6eec3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.725570:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6eec3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.725665:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000081644fa4/0xa5e9c8c58c6eeca lrc: 3/1,0 mode: --/PR res: [0x200000408:0x8b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.725672:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000081644fa4/0xa5e9c8c58c6eeca lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.725677:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000081644fa4/0xa5e9c8c58c6eeca lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1772305901.725694:0:54697:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000408:0x8b:0x0]: returning size 512 00000004:00200000:1.0:1772305901.725697:0:54697:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1772305901.725709:0:54697:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 0000000081644fa4/0xa5e9c8c58c6eeca lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.725722:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000ee5a0681/0xa5e9c8c58c6eebc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.725726:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ee5a0681/0xa5e9c8c58c6eebc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.725730:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000ee5a0681/0xa5e9c8c58c6eebc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.725733:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ee5a0681 already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305901.725735:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ee5a0681/0xa5e9c8c58c6eebc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.725739:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ee5a0681/0xa5e9c8c58c6eebc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.725744:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:1.0:1772305901.725746:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305901.725748:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000ee5a0681/0xa5e9c8c58c6eebc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.725751:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ee5a0681/0xa5e9c8c58c6eebc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.725758:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6eec3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.725762:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6eec3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.725773:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6eec3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.725776:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d142a9ac already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305901.725778:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6eec3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.725781:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6eec3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.725787:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc5c1a1d9 (000000004dada68c) 00010000:00010000:1.0:1772305901.725789:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305901.725791:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6eec3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.725796:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6eec3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.725819:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6eeb5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed02 expref: 50 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.725831:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000081644fa4/0xa5e9c8c58c6eeca lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed02 expref: 49 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.725838:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8b:0x0].0x0 (0000000094db6ce7) 00010000:00010000:1.0:1772305901.725840:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1772305901.725842:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000081644fa4, rc 0) 00000100:00100000:1.0:1772305901.725878:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004668f3b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+49:96133:x1858396225355456:12345-192.168.203.30@tcp:101:bash.0 Request processed in 422us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305901.725888:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 779 00000100:00100000:3.0:1772305901.726596:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305901.726655:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225355520 00000100:00100000:1.0:1772305901.726682:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 780 00000100:00100000:1.0:1772305901.726685:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007eaa6db7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+49:96133:x1858396225355520:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:1.0:1772305901.726693:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305901.726700:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c6eed1 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ed09 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.726722:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6eed8 lrc: 3/1,0 mode: --/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.726729:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6eed8 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.726734:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6eed8 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.726761:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6eedf lrc: 3/1,0 mode: --/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.726766:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6eedf lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.726770:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6eedf lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.726796:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6eed8 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.726809:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6eed8 lrc: 2/0,0 mode: CR/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.726813:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6eed8 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.726817:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c609f04e already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305901.726818:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6eed8 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.726822:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6eed8 lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.726828:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8b:0x0].0x0 (0000000094db6ce7) 00010000:00010000:1.0:1772305901.726830:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305901.726831:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6eed8 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.726835:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6eed8 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.726841:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6eedf lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.726845:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6eedf lrc: 2/0,0 mode: PR/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.726849:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6eedf lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.726859:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000025cc37fd already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305901.726860:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6eedf lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.726864:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6eedf lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.726868:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8b:0x0].0x402924b4 (0000000060b58ddc) 00010000:00010000:1.0:1772305901.726870:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305901.726871:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6eedf lrc: 2/0,0 mode: --/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.726874:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6eedf lrc: 0/0,0 mode: --/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.726890:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c6eed1 lrc: 1/0,0 mode: --/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed09 expref: 50 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.726897:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c6eed1 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed09 expref: 50 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.726905:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000776565ed, rc 0) 00000100:00100000:1.0:1772305901.726937:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007eaa6db7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+49:96133:x1858396225355520:12345-192.168.203.30@tcp:101:bash.0 Request processed in 250us (341us total) trans 0 rc 301/301 00000100:00100000:1.0:1772305901.726944:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 780 00000100:00100000:3.0:1772305901.731158:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305901.731198:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225355584 00000100:00100000:1.0:1772305901.731230:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 781 00000100:00100000:1.0:1772305901.731236:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c0b7c50f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+61:96134:x1858396225355584:12345-192.168.203.30@tcp:101:rm.0 00010000:00010000:1.0:1772305901.731258:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305901.731268:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6eee6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ed10 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.731295:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000017162762/0xa5e9c8c58c6eeed lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.731303:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000017162762/0xa5e9c8c58c6eeed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.731308:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000017162762/0xa5e9c8c58c6eeed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.731316:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6eef4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.731320:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6eef4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.731324:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6eef4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.731384:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000949f0123/0xa5e9c8c58c6eefb lrc: 3/1,0 mode: --/PR res: [0x200000408:0x8b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.731390:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000949f0123/0xa5e9c8c58c6eefb lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.731394:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000949f0123/0xa5e9c8c58c6eefb lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1772305901.731421:0:54697:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000408:0x8b:0x0]: returning size 512 00000004:00200000:1.0:1772305901.731423:0:54697:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1772305901.731434:0:54697:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000949f0123/0xa5e9c8c58c6eefb lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.731440:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000017162762/0xa5e9c8c58c6eeed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.731444:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000017162762/0xa5e9c8c58c6eeed lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.731448:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000017162762/0xa5e9c8c58c6eeed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.731452:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000017162762 already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305901.731453:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000017162762/0xa5e9c8c58c6eeed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.731457:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000017162762/0xa5e9c8c58c6eeed lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.731463:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:1.0:1772305901.731465:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305901.731467:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000017162762/0xa5e9c8c58c6eeed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.731470:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000017162762/0xa5e9c8c58c6eeed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.731476:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6eef4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.731485:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6eef4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.731489:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6eef4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.731492:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000748ac5ea already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305901.731493:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6eef4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.731497:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6eef4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.731501:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc5c1a1d9 (00000000a61c25fb) 00010000:00010000:1.0:1772305901.731502:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305901.731504:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6eef4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.731507:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6eef4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc5c1a1d9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.731522:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6eee6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed10 expref: 63 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.731529:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000949f0123/0xa5e9c8c58c6eefb lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed10 expref: 62 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.731533:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8b:0x0].0x0 (0000000094db6ce7) 00010000:00010000:1.0:1772305901.731538:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1772305901.731539:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000949f0123, rc 0) 00000100:00100000:1.0:1772305901.731582:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c0b7c50f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+62:96134:x1858396225355584:12345-192.168.203.30@tcp:101:rm.0 Request processed in 346us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305901.731587:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 781 00000100:00100000:3.0:1772305901.732455:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305901.732487:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225355648 00000100:00100000:1.0:1772305901.732514:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 782 00000100:00100000:1.0:1772305901.732519:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009c8bbbd9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+62:96134:x1858396225355648:12345-192.168.203.30@tcp:101:rm.0 00010000:00010000:1.0:1772305901.732529:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305901.732537:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6ef02 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ed17 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.732572:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6ef09 lrc: 3/1,0 mode: --/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.732578:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6ef09 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.732583:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6ef09 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.732591:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6ef10 lrc: 3/1,0 mode: --/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.732595:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6ef10 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.732599:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6ef10 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.732652:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6ef09 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.732660:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6ef09 lrc: 2/0,0 mode: CR/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.732667:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6ef09 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.732673:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000001cde7dd0 already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305901.732675:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6ef09 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.732681:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6ef09 lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.732691:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8b:0x0].0x0 (0000000094db6ce7) 00010000:00010000:1.0:1772305901.732693:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305901.732695:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6ef09 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.732702:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6ef09 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.732710:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6ef10 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.732714:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6ef10 lrc: 2/0,0 mode: PR/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.732726:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6ef10 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.732730:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006a4f0137 already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305901.732731:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6ef10 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.732735:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6ef10 lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.732740:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8b:0x0].0x402924b4 (00000000c10a8182) 00010000:00010000:1.0:1772305901.732742:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305901.732743:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6ef10 lrc: 2/0,0 mode: --/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.732746:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6ef10 lrc: 0/0,0 mode: --/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.732762:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6ef02 lrc: 1/0,0 mode: --/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed17 expref: 63 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.732766:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6ef02 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed17 expref: 63 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.732771:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000048d87789, rc 0) 00000100:00100000:1.0:1772305901.732801:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009c8bbbd9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+62:96134:x1858396225355648:12345-192.168.203.30@tcp:101:rm.0 Request processed in 282us (347us total) trans 0 rc 301/301 00000100:00100000:1.0:1772305901.732806:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 782 00000100:00100000:3.0:1772305901.733592:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305901.733644:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225355712 00000100:00100000:1.0:1772305901.733682:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 783 00000100:00100000:1.0:1772305901.733688:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000731263eb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+62:96134:x1858396225355712:12345-192.168.203.30@tcp:101:rm.0 00010000:00010000:1.0:1772305901.733697:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305901.733704:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6ef17 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ed1e expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.733728:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6ef1e lrc: 3/1,0 mode: --/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.733734:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6ef1e lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.733739:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6ef1e lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.733747:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000016b42150/0xa5e9c8c58c6ef25 lrc: 3/1,0 mode: --/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.733751:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000016b42150/0xa5e9c8c58c6ef25 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.733755:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000016b42150/0xa5e9c8c58c6ef25 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.733772:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6ef1e lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.733776:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6ef1e lrc: 2/0,0 mode: CR/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.733788:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6ef1e lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.733792:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000295bd7c already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305901.733793:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6ef1e lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.733797:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6ef1e lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.733802:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8b:0x0].0x0 (0000000094db6ce7) 00010000:00010000:1.0:1772305901.733804:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305901.733805:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6ef1e lrc: 2/0,0 mode: --/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.733809:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6ef1e lrc: 0/0,0 mode: --/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.733815:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000016b42150/0xa5e9c8c58c6ef25 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.733818:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000016b42150/0xa5e9c8c58c6ef25 lrc: 2/0,0 mode: PR/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.733821:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000016b42150/0xa5e9c8c58c6ef25 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.733825:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000016b42150 already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305901.733826:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000016b42150/0xa5e9c8c58c6ef25 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.733833:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000016b42150/0xa5e9c8c58c6ef25 lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.733838:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8b:0x0].0x402924b4 (0000000067720f33) 00010000:00010000:1.0:1772305901.733839:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305901.733841:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000016b42150/0xa5e9c8c58c6ef25 lrc: 2/0,0 mode: --/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.733844:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000016b42150/0xa5e9c8c58c6ef25 lrc: 0/0,0 mode: --/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.733858:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6ef17 lrc: 1/0,0 mode: --/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed1e expref: 63 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.733862:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6ef17 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed1e expref: 63 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.733867:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a178fe80, rc 0) 00000100:00100000:1.0:1772305901.733891:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000731263eb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+62:96134:x1858396225355712:12345-192.168.203.30@tcp:101:rm.0 Request processed in 204us (301us total) trans 0 rc 301/301 00000100:00100000:1.0:1772305901.733896:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 783 00000100:00100000:3.0:1772305901.739332:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305901.739385:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225355776 00000100:00100000:1.0:1772305901.739419:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 784 00000100:00100000:1.0:1772305901.739425:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d22b18dd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+62:96135:x1858396225355776:12345-192.168.203.30@tcp:101:cp.0 00010000:00010000:1.0:1772305901.739440:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305901.739455:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c6ef2c lrc: 2/0,0 mode: --/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ed25 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.739501:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6ef33 lrc: 3/1,0 mode: --/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.739508:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6ef33 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.739515:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6ef33 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.739523:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6ef3a lrc: 3/1,0 mode: --/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.739527:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6ef3a lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.739531:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6ef3a lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.739616:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6ef33 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.739621:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6ef33 lrc: 2/0,0 mode: CR/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.739642:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6ef33 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.739646:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000025cc37fd already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305901.739648:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6ef33 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.739658:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6ef33 lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.739665:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8b:0x0].0x0 (0000000094db6ce7) 00010000:00010000:1.0:1772305901.739667:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305901.739669:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6ef33 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.739673:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6ef33 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.739680:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6ef3a lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.739683:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6ef3a lrc: 2/0,0 mode: PR/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.739686:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6ef3a lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.739690:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c609f04e already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305901.739691:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6ef3a lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.739694:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6ef3a lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.739698:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8b:0x0].0x402924b4 (0000000045f3282f) 00010000:00010000:1.0:1772305901.739699:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305901.739705:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6ef3a lrc: 2/0,0 mode: --/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.739709:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6ef3a lrc: 0/0,0 mode: --/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.739727:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c6ef2c lrc: 1/0,0 mode: --/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed25 expref: 63 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.739732:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c6ef2c lrc: 0/0,0 mode: --/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed25 expref: 63 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.739737:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000776565ed, rc 0) 00000100:00100000:1.0:1772305901.739767:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d22b18dd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+62:96135:x1858396225355776:12345-192.168.203.30@tcp:101:cp.0 Request processed in 343us (438us total) trans 0 rc 301/301 00000100:00100000:1.0:1772305901.739772:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 784 00000100:00100000:3.0:1772305901.740532:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305901.740575:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225355840 00000100:00100000:1.0:1772305901.740602:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 785 00000100:00100000:1.0:1772305901.740608:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e72c7c57 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+62:96135:x1858396225355840:12345-192.168.203.30@tcp:101:cp.0 00010000:00010000:1.0:1772305901.740616:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305901.740640:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6ef41 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ed2c expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.740669:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6ef48 lrc: 3/1,0 mode: --/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.740679:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6ef48 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.740685:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6ef48 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.740699:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000ee5a0681/0xa5e9c8c58c6ef4f lrc: 3/1,0 mode: --/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.740704:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ee5a0681/0xa5e9c8c58c6ef4f lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.740709:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ee5a0681/0xa5e9c8c58c6ef4f lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.740727:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6ef48 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.740731:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6ef48 lrc: 2/0,0 mode: CR/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.740735:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6ef48 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.740738:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d142a9ac already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305901.740739:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6ef48 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.740743:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6ef48 lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.740748:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8b:0x0].0x0 (0000000094db6ce7) 00010000:00010000:1.0:1772305901.740749:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305901.740750:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6ef48 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.740762:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6ef48 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.740768:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000ee5a0681/0xa5e9c8c58c6ef4f lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.740771:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ee5a0681/0xa5e9c8c58c6ef4f lrc: 2/0,0 mode: PR/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.740775:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000ee5a0681/0xa5e9c8c58c6ef4f lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.740778:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ee5a0681 already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305901.740780:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ee5a0681/0xa5e9c8c58c6ef4f lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.740783:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ee5a0681/0xa5e9c8c58c6ef4f lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.740787:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8b:0x0].0x402924b4 (0000000027e5c018) 00010000:00010000:1.0:1772305901.740788:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305901.740789:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000ee5a0681/0xa5e9c8c58c6ef4f lrc: 2/0,0 mode: --/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.740792:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ee5a0681/0xa5e9c8c58c6ef4f lrc: 0/0,0 mode: --/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.740805:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6ef41 lrc: 1/0,0 mode: --/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed2c expref: 63 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.740817:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6ef41 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed2c expref: 63 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.740822:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004a9f3864, rc 0) 00000100:00100000:1.0:1772305901.740846:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e72c7c57 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+62:96135:x1858396225355840:12345-192.168.203.30@tcp:101:cp.0 Request processed in 239us (317us total) trans 0 rc 301/301 00000100:00100000:1.0:1772305901.740851:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 785 00000100:00100000:3.0:1772305901.741657:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305901.741683:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225355968 00000100:00100000:1.0:1772305901.741709:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 786 00000100:00100000:1.0:1772305901.741712:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000085acb02d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+62:96135:x1858396225355968:12345-192.168.203.30@tcp:101:cp.0 00010000:00010000:1.0:1772305901.741720:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305901.741727:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000008cc4789a/0xa5e9c8c58c6ef56 lrc: 2/0,0 mode: --/CW res: [0x200000408:0x8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ed33 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.741793:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6ef5d lrc: 3/0,1 mode: --/CW res: [0x200000408:0x8b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.741804:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6ef5d lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.741812:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6ef5d lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.741826:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000ecdb8dda/0xa5e9c8c58c6ef64 lrc: 3/0,1 mode: --/PW res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.741834:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ecdb8dda/0xa5e9c8c58c6ef64 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.741850:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ecdb8dda/0xa5e9c8c58c6ef64 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1772305901.742288:0:54697:0:(osp_object.c:1645:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x100010000:0x1ad:0x0], index 1: 0 00010000:00010000:1.0:1772305901.742432:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000023e766ad/0xa5e9c8c58c6ef6b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x325:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.742439:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000023e766ad/0xa5e9c8c58c6ef6b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x325:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.742444:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000023e766ad/0xa5e9c8c58c6ef6b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x325:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.742467:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6ef5d lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.742472:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6ef5d lrc: 2/0,0 mode: CW/CW res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.742476:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6ef5d lrc: 3/0,0 mode: CW/CW res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.742479:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000043f9fbca already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305901.742481:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6ef5d lrc: 3/0,0 mode: CW/CW res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.742484:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6ef5d lrc: 4/0,0 mode: CW/CW res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.742498:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8b:0x0].0x0 (0000000094db6ce7) 00010000:00010000:1.0:1772305901.742500:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305901.742501:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6ef5d lrc: 2/0,0 mode: --/CW res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.742505:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6ef5d lrc: 0/0,0 mode: --/CW res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1772305901.742511:0:54697:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000085acb02d reply state 0000000029a3957c transno 8589934839 ns: mdt-lustre-MDT0000_UUID lock: 00000000ecdb8dda/0xa5e9c8c58c6ef64 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.742527:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000008cc4789a/0xa5e9c8c58c6ef56 lrc: 0/0,0 mode: --/CW res: [0x200000408:0x8b:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed33 expref: 65 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.742535:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000023e766ad/0xa5e9c8c58c6ef6b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x325:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed33 expref: 64 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.742539:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x325:0x0].0x0 (000000009628d28f) 00010000:00010000:1.0:1772305901.742540:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1772305901.742542:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000023e766ad, rc 0) 00000100:00100000:1.0:1772305901.742583:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000085acb02d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+65:96135:x1858396225355968:12345-192.168.203.30@tcp:101:cp.0 Request processed in 869us (927us total) trans 8589934839 rc 0/0 00000100:00100000:1.0:1772305901.742587:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 786 00010000:00010000:2.0:1772305901.743078:0:2978:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000ecdb8dda/0xa5e9c8c58c6ef64 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305901.743087:0:2978:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ecdb8dda/0xa5e9c8c58c6ef64 lrc: 2/0,0 mode: PW/PW res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305901.743091:0:2978:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000ecdb8dda/0xa5e9c8c58c6ef64 lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305901.743095:0:2978:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ecdb8dda already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305901.743096:0:2978:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ecdb8dda/0xa5e9c8c58c6ef64 lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305901.743102:0:2978:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ecdb8dda/0xa5e9c8c58c6ef64 lrc: 4/0,0 mode: PW/PW res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305901.743120:0:2978:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8b:0x0].0x402924b4 (00000000c75acf1a) 00010000:00010000:2.0:1772305901.743123:0:2978:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305901.743125:0:2978:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000ecdb8dda/0xa5e9c8c58c6ef64 lrc: 2/0,0 mode: --/PW res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305901.743140:0:2978:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ecdb8dda/0xa5e9c8c58c6ef64 lrc: 0/0,0 mode: --/PW res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305901.743855:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305901.743883:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225356032 00000100:00100000:1.0:1772305901.743907:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 787 00000100:00100000:1.0:1772305901.743911:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000854ab26d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+64:96135:x1858396225356032:12345-192.168.203.30@tcp:101:cp.0 00010000:00010000:1.0:1772305901.743921:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305901.743933:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004f0eacd6/0xa5e9c8c58c6ef79 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ed3a expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.743955:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000480c2697/0xa5e9c8c58c6ef80 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x325:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.743964:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000480c2697/0xa5e9c8c58c6ef80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x325:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.743972:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000480c2697/0xa5e9c8c58c6ef80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x325:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1772305901.743992:0:54697:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1772305901.744002:0:54697:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000480c2697/0xa5e9c8c58c6ef80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x325:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.744012:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000480c2697/0xa5e9c8c58c6ef80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x325:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.744029:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004f0eacd6/0xa5e9c8c58c6ef79 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed3a expref: 66 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.744042:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000480c2697/0xa5e9c8c58c6ef80 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x325:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed3a expref: 65 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305901.744049:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x325:0x0].0x0 (000000009628d28f) 00010000:00010000:1.0:1772305901.744051:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1772305901.744053:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000480c2697, rc 0) 00000100:00100000:1.0:1772305901.744088:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000854ab26d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+65:96135:x1858396225356032:12345-192.168.203.30@tcp:101:cp.0 Request processed in 176us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305901.744093:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 787 00000100:00100000:3.0:1772305901.744854:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305901.746098:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305901.747290:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305901.748534:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305901.748587:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225356352 00000100:00100000:2.0:1772305901.748613:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 98 00000100:00100000:2.0:1772305901.748617:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fb0c289e pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+65:96135:x1858396225356352:12345-192.168.203.30@tcp:35:cp.0 00000100:00100000:2.0:1772305901.748810:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fb0c289e pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+66:96135:x1858396225356352:12345-192.168.203.30@tcp:35:cp.0 Request processed in 191us (276us total) trans 8589934840 rc 0/0 00000100:00100000:2.0:1772305901.748816:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 98 00010000:00010000:2.0:1772305902.280740:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1772305902.472820:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305902.472826:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305902.473212:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 11 00000040:00080000:3.0:1772305902.473220:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:3.0:1772305902.663933:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305902.663983:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225356416 00000100:00100000:1.0:1772305902.664034:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 788 00000100:00100000:1.0:1772305902.664042:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000090401002 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+49:96172:x1858396225356416:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1772305902.664064:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305902.664084:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004f0eacd6/0xa5e9c8c58c6ef95 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ed4f expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305902.664146:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000043c851d7/0xa5e9c8c58c6ef9c lrc: 3/1,0 mode: --/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305902.664158:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000043c851d7/0xa5e9c8c58c6ef9c lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305902.664166:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000043c851d7/0xa5e9c8c58c6ef9c lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305902.664177:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000ce9f4b5a/0xa5e9c8c58c6efa3 lrc: 3/1,0 mode: --/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305902.664181:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ce9f4b5a/0xa5e9c8c58c6efa3 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305902.664185:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ce9f4b5a/0xa5e9c8c58c6efa3 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305902.664287:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000ecdb8dda/0xa5e9c8c58c6efaa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x325:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305902.664295:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ecdb8dda/0xa5e9c8c58c6efaa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x325:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305902.664311:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ecdb8dda/0xa5e9c8c58c6efaa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x325:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1772305902.664340:0:54697:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x325:0x0]: returning size 1516 00000004:00200000:1.0:1772305902.664343:0:54697:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1772305902.664357:0:54697:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000ecdb8dda/0xa5e9c8c58c6efaa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x325:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305902.664366:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ecdb8dda/0xa5e9c8c58c6efaa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x325:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305902.664371:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000043c851d7/0xa5e9c8c58c6ef9c lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305902.664376:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000043c851d7/0xa5e9c8c58c6ef9c lrc: 2/0,0 mode: CR/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305902.664380:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000043c851d7/0xa5e9c8c58c6ef9c lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305902.664384:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000043c851d7 already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305902.664387:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000043c851d7/0xa5e9c8c58c6ef9c lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305902.664392:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000043c851d7/0xa5e9c8c58c6ef9c lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305902.664400:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8b:0x0].0x0 (0000000094db6ce7) 00010000:00010000:1.0:1772305902.664402:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305902.664411:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000043c851d7/0xa5e9c8c58c6ef9c lrc: 2/0,0 mode: --/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305902.664415:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000043c851d7/0xa5e9c8c58c6ef9c lrc: 0/0,0 mode: --/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305902.664423:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000ce9f4b5a/0xa5e9c8c58c6efa3 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305902.664427:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ce9f4b5a/0xa5e9c8c58c6efa3 lrc: 2/0,0 mode: PR/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305902.664431:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000ce9f4b5a/0xa5e9c8c58c6efa3 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305902.664434:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ce9f4b5a already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305902.664435:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ce9f4b5a/0xa5e9c8c58c6efa3 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305902.664439:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ce9f4b5a/0xa5e9c8c58c6efa3 lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305902.664444:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8b:0x0].0x402924b4 (0000000045f3282f) 00010000:00010000:1.0:1772305902.664445:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305902.664446:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000ce9f4b5a/0xa5e9c8c58c6efa3 lrc: 2/0,0 mode: --/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305902.664449:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ce9f4b5a/0xa5e9c8c58c6efa3 lrc: 0/0,0 mode: --/PR res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305902.664471:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004f0eacd6/0xa5e9c8c58c6ef95 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed4f expref: 51 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305902.664486:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000ecdb8dda/0xa5e9c8c58c6efaa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x325:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed4f expref: 50 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305902.664491:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x325:0x0].0x0 (000000009628d28f) 00010000:00010000:1.0:1772305902.664493:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1772305902.664494:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ecdb8dda, rc 0) 00000100:00100000:1.0:1772305902.664557:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000090401002 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+50:96172:x1858396225356416:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 515us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305902.664563:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 788 00000100:00100000:2.0:1772305902.665774:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305902.665820:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225356480 00000100:00100000:3.0:1772305902.665864:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5699 00000100:00100000:3.0:1772305902.665870:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bcaf406f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+140:2216:x1858396225356480:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1772305902.665879:0:6307:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305902.665890:0:6307:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009fea887/0xa5e9c8c58c6efb1 lrc: 2/0,0 mode: --/PR res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ed56 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305902.665930:0:6307:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d90d4880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6307:1858396216600448:192.168.203.30@tcp:106: 00000100:00100000:3.0:1772305902.665979:0:6307:0:(client.c:2500:ptlrpc_set_wait()) set 00000000513ab74f going to sleep for 6 seconds 00002000:00010000:1.0:1772305902.667000:0:6307:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x1ad:0x0:0x0] updating lvb size: 0 -> 1516 00002000:00010000:1.0:1772305902.667005:0:6307:0:(ofd_lvb.c:284:ofd_lvbo_update()) res: [0x1ad:0x0:0x0] updating lvb mtime: 0 -> 1772305901 00002000:00010000:1.0:1772305902.667007:0:6307:0:(ofd_lvb.c:290:ofd_lvbo_update()) res: [0x1ad:0x0:0x0] updating lvb atime: 0 -> 1772305901 00002000:00010000:1.0:1772305902.667009:0:6307:0:(ofd_lvb.c:296:ofd_lvbo_update()) res: [0x1ad:0x0:0x0] updating lvb ctime: 0 -> 1772305901 00000100:00100000:1.0:1772305902.667024:0:6307:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d90d4880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6307:1858396216600448:192.168.203.30@tcp:106: 00010000:00010000:1.0:1772305902.667042:0:6307:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000009fea887/0xa5e9c8c58c6efb1 lrc: 1/0,0 mode: --/PR res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed56 expref: 141 pid: 6307 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1772305902.667052:0:6307:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009fea887/0xa5e9c8c58c6efb1 lrc: 0/0,0 mode: --/PR res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed56 expref: 141 pid: 6307 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1772305902.667060:0:6307:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000009fea887, rc 0) 00000100:00100000:1.0:1772305902.667095:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bcaf406f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+140:2216:x1858396225356480:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 1224us (1320us total) trans 0 rc 301/301 00000100:00100000:1.0:1772305902.667102:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5699 00000100:00100000:1.0:1772305902.668336:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225356544 00000100:00100000:1.0:1772305902.668378:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 789 00000100:00100000:1.0:1772305902.668384:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000023b046ef pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+50:96172:x1858396225356544:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1772305902.668395:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305902.668406:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000008cc4789a/0xa5e9c8c58c6efb8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ed5d expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305902.668439:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6efbf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305902.668450:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6efbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305902.668459:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6efbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1772305902.668494:0:54697:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:1.0:1772305902.668497:0:54697:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 106 stripe count 1 MDT count 1 00000004:00010000:1.0:1772305902.668516:0:54697:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6efbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305902.668535:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000008cc4789a/0xa5e9c8c58c6efb8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed5d expref: 52 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305902.668567:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6efbf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed5d expref: 51 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305902.668574:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:1.0:1772305902.668577:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1772305902.668579:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043f9fbca, rc 0) 00000100:00100000:1.0:1772305902.668612:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000023b046ef pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+51:96172:x1858396225356544:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 228us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305902.668672:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 789 00000100:00100000:3.0:1772305902.669691:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305902.669725:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225356608 00000100:00100000:1.0:1772305902.669761:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 790 00000100:00100000:1.0:1772305902.669766:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f635dbf9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+51:96172:x1858396225356608:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1772305902.669773:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305902.669784:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6efc6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ed64 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305902.669807:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000ee5a0681/0xa5e9c8c58c6efcd lrc: 3/1,0 mode: --/PR res: [0x200000408:0x8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305902.669814:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ee5a0681/0xa5e9c8c58c6efcd lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305902.669819:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ee5a0681/0xa5e9c8c58c6efcd lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1772305902.669840:0:54697:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000408:0x8b:0x0]: returning size 512 00000004:00200000:1.0:1772305902.669842:0:54697:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1772305902.669852:0:54697:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000ee5a0681/0xa5e9c8c58c6efcd lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305902.669865:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6efc6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed64 expref: 53 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305902.669874:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000ee5a0681/0xa5e9c8c58c6efcd lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed64 expref: 52 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305902.669878:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8b:0x0].0x0 (0000000094db6ce7) 00010000:00010000:1.0:1772305902.669887:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1772305902.669889:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ee5a0681, rc 0) 00000100:00100000:1.0:1772305902.669917:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f635dbf9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+52:96172:x1858396225356608:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 152us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305902.669923:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 790 00000100:00100000:1.0:1772305902.670868:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225356672 00000100:00100000:1.0:1772305902.670893:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5700 00000100:00100000:1.0:1772305902.670897:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000018743e89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+140:2215:x1858396225356672:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1772305902.670904:0:6307:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305902.670912:0:6307:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6efd4 lrc: 2/0,0 mode: --/PR res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ed6b expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305902.670938:0:6307:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d23a5281 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6307:1858396216600512:192.168.203.30@tcp:106: 00000100:00100000:1.0:1772305902.670971:0:6307:0:(client.c:2500:ptlrpc_set_wait()) set 000000007d42fd39 going to sleep for 6 seconds 00000100:00100000:1.0:1772305902.671947:0:6307:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d23a5281 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6307:1858396216600512:192.168.203.30@tcp:106: 00010000:00010000:1.0:1772305902.671965:0:6307:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6efd4 lrc: 1/0,0 mode: --/PR res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed6b expref: 141 pid: 6307 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1772305902.671973:0:6307:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6efd4 lrc: 0/0,0 mode: --/PR res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed6b expref: 141 pid: 6307 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1772305902.671981:0:6307:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d142a9ac, rc 0) 00000100:00100000:1.0:1772305902.672006:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000018743e89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+140:2215:x1858396225356672:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 1108us (1171us total) trans 0 rc 301/301 00000100:00100000:1.0:1772305902.672012:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5700 00000100:00100000:1.0:1772305902.673792:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225356800 00000100:00100000:1.0:1772305902.673833:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 791 00000100:00100000:1.0:1772305902.673840:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009c527bff pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+52:96172:x1858396225356800:12345-192.168.203.30@tcp:58:lfs.0 00000040:00080000:1.0:1772305902.674057:0:54697:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xf:0x0].35, 136 off12952 00000100:00100000:1.0:1772305902.674137:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009c527bff pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+52:96172:x1858396225356800:12345-192.168.203.30@tcp:58:lfs.0 Request processed in 296us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305902.674147:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 791 00000040:00080000:1.0:1772305902.955004:0:68600:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305902.955010:0:68600:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305902.955096:0:68600:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 36 count 12 00000040:00080000:1.0:1772305902.955103:0:68600:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772305903.304791:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1772305903.496850:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305903.496859:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305903.496907:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 36 count 12 00000040:00080000:3.0:1772305903.496915:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:3.0:1772305903.497149:0:54732:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x13:0x0].53, 136 off16856 00000100:00100000:3.0:1772305903.497258:0:54732:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000093b46947 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:54732:1858396216600576:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1772305903.497333:0:54732:0:(client.c:2500:ptlrpc_set_wait()) set 0000000078f30ab1 going to sleep for 6 seconds 00000100:00100000:3.0:1772305903.498685:0:54732:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000093b46947 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:54732:1858396216600576:192.168.203.30@tcp:107:hsm_cdtr.0 00000040:00080000:3.0:1772305903.498747:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305903.498751:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305903.498814:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 36 count 12 00000040:00080000:3.0:1772305903.498832:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:1.0:1772305903.499345:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225356864 00000100:00100000:1.0:1772305903.499390:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 792 00000100:00100000:1.0:1772305903.499396:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ccddc55d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+66:96183:x1858396225356864:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1772305903.499422:0:54697:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x325:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1772305903.499475:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ccddc55d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+66:96183:x1858396225356864:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 79us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305903.499481:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 792 00000100:00100000:1.0:1772305903.500566:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225356992 00000100:00100000:1.0:1772305903.500591:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 793 00000100:00100000:1.0:1772305903.500595:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b250dcf6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+66:96183:x1858396225356992:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1772305903.500604:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305903.500621:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6efdb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ed72 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305903.500700:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6efe2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305903.500721:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6efe2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305903.500730:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6efe2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305903.500740:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000008cc4789a/0xa5e9c8c58c6efe9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x2a4b060c bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305903.500754:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000008cc4789a/0xa5e9c8c58c6efe9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2a4b060c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305903.500761:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000008cc4789a/0xa5e9c8c58c6efe9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2a4b060c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305903.500794:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c6eff0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x325:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305903.500800:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c6eff0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x325:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305903.500805:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c6eff0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x325:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1772305903.500811:0:54697:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x325:0x0]: returning size 1516 00010000:00010000:1.0:1772305903.500878:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6efe2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305903.500886:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6efe2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305903.500903:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6efe2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305903.500909:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000004a9f3864 already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305903.500912:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6efe2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305903.500918:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6efe2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305903.500929:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (00000000c78481f6) 00010000:00010000:1.0:1772305903.500932:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305903.500936:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6efe2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305903.500943:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6efe2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305903.500954:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000008cc4789a/0xa5e9c8c58c6efe9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2a4b060c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305903.500960:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000008cc4789a/0xa5e9c8c58c6efe9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2a4b060c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305903.500965:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000008cc4789a/0xa5e9c8c58c6efe9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2a4b060c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305903.500970:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000008cc4789a already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305903.500972:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000008cc4789a/0xa5e9c8c58c6efe9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2a4b060c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305903.500983:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000008cc4789a/0xa5e9c8c58c6efe9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2a4b060c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305903.500991:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x2a4b060c (0000000045f3282f) 00010000:00010000:1.0:1772305903.500993:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305903.500995:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000008cc4789a/0xa5e9c8c58c6efe9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x2a4b060c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305903.501000:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000008cc4789a/0xa5e9c8c58c6efe9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x2a4b060c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305903.501028:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6efdb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed72 expref: 69 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305903.501039:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c6eff0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x325:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed72 expref: 68 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305903.501045:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x325:0x0].0x0 (000000009628d28f) 00010000:00010000:1.0:1772305903.501047:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1772305903.501049:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000776565ed, rc 0) 00000100:00100000:1.0:1772305903.501081:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b250dcf6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+68:96183:x1858396225356992:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 484us (561us total) trans 8589934841 rc 0/0 00000100:00100000:1.0:1772305903.501089:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 793 00000100:00100000:1.0:1772305903.502089:0:6323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225357056 00000100:00100000:1.0:1772305903.502141:0:6323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1045 00000100:00100000:1.0:1772305903.502146:0:6323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000ad6883e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+68:2217:x1858396225357056:12345-192.168.203.30@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1772305903.502156:0:6323:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1772305903.502173:0:6323:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c6eff0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x325:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed72 expref: 68 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305903.502182:0:6323:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x325:0x0].0x0 (000000009628d28f) 00010000:00010000:1.0:1772305903.502186:0:6323:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1772305903.502217:0:6323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000ad6883e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+67:2217:x1858396225357056:12345-192.168.203.30@tcp:103:ldlm_bl_02.0 Request processed in 71us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305903.502224:0:6323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1045 00000100:00100000:3.0:1772305903.502258:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225357120 00000100:00100000:3.0:1772305903.502294:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5701 00000100:00100000:3.0:1772305903.502299:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000166181f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+228:2215:x1858396225357120:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1772305903.502372:0:6307:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6effe lrc: 3/1,0 mode: --/PR res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305903.502383:0:6307:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007fcf3076/0xa5e9c8c58c6ef8e lrc: 2/0,0 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed48 expref: 228 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305903.502389:0:6307:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1772305903.502391:0:6307:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1772305903.502392:0:6307:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6effe lrc: 4/1,0 mode: --/PR res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305903.502409:0:6307:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007fcf3076/0xa5e9c8c58c6ef8e lrc: 3/0,0 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed48 expref: 228 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305903.502418:0:6307:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007fcf3076/0xa5e9c8c58c6ef8e lrc: 4/0,0 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed48 expref: 228 pid: 6307 timeout: 1315 lvb_type: 0 00000100:00100000:3.0:1772305903.502426:0:6307:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000093b46947 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6307:1858396216600640:192.168.203.30@tcp:104: 00000100:00100000:3.0:1772305903.502455:0:6307:0:(client.c:2500:ptlrpc_set_wait()) set 0000000078f30ab1 going to sleep for 6 seconds 00000100:00100000:3.0:1772305903.503081:0:6307:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000093b46947 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6307:1858396216600640:192.168.203.30@tcp:104: 00010000:00010000:3.0:1772305903.503094:0:6307:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6effe lrc: 3/1,0 mode: --/PR res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305903.503434:0:21399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225357184 00002000:00100000:3.0:1772305903.503458:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x100010000:0x1ad:0x0] (0->1515) req@0000000059055e9c x1858396225357184/t0(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:34/0 lens 2008/0 e 0 to 0 dl 1772305909 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cp.0' 00002000:00100000:3.0:1772305903.503465:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 0000000059055e9c with x1858396225357184 ext(0->1515) 00010000:00010000:3.0:1772305903.503471:0:21399:0:(ldlm_lockd.c:601:ldlm_refresh_waiting_lock()) ### refreshed to 56s ns: filter-lustre-OST0001_UUID lock: 000000007fcf3076/0xa5e9c8c58c6ef8e lrc: 4/0,0 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed48 expref: 229 pid: 6307 timeout: 1315 lvb_type: 0 00002000:00010000:3.0:1772305903.503477:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req 0000000059055e9c 00000100:00100000:3.0:1772305903.503492:0:21399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 65 00000100:00100000:3.0:1772305903.503495:0:21399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000059055e9c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+229:2215:x1858396225357184:12345-192.168.203.30@tcp:4:cp.0 00000100:00100000:3.0:1772305903.503841:0:21399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000059055e9c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+231:2215:x1858396225357184:12345-192.168.203.30@tcp:4:cp.0 Request processed in 344us (471us total) trans 4294968343 rc 0/0 00000100:00100000:3.0:1772305903.503847:0:21399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 65 00002000:00100000:3.0:1772305903.503852:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x100010000:0x1ad:0x0] (0->1515) req@0000000059055e9c x1858396225357184/t4294968343(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:34/0 lens 2008/448 e 0 to 0 dl 1772305909 ref 1 fl Complete:H/0/0 rc 0/0 job:'cp.0' 00002000:00100000:3.0:1772305903.503858:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 0000000059055e9c with x1858396225357184 ext(0->1515) 00010000:00010000:3.0:1772305903.503864:0:21399:0:(ldlm_lockd.c:601:ldlm_refresh_waiting_lock()) ### refreshed to 56s ns: filter-lustre-OST0001_UUID lock: 000000007fcf3076/0xa5e9c8c58c6ef8e lrc: 4/0,0 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed48 expref: 231 pid: 6307 timeout: 1315 lvb_type: 0 00002000:00010000:3.0:1772305903.503869:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req 0000000059055e9c 00000100:00100000:1.0:1772305903.504663:0:6323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225357248 00010000:00010000:1.0:1772305903.504676:0:6323:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007fcf3076/0xa5e9c8c58c6ef8e lrc: 4/0,0 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed48 expref: 231 pid: 6307 timeout: 1315 lvb_type: 0 00000100:00100000:1.0:1772305903.504698:0:6323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3076 00000100:00100000:1.0:1772305903.504701:0:6323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000339dc28b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+231:2216:x1858396225357248:12345-192.168.203.30@tcp:103:ldlm_bl_05.0 00010000:00010000:1.0:1772305903.504707:0:6323:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1772305903.504717:0:6323:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007fcf3076/0xa5e9c8c58c6ef8e lrc: 4/0,0 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed48 expref: 231 pid: 6307 timeout: 1315 lvb_type: 0 00010000:00010000:1.0:1772305903.504725:0:6323:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007fcf3076/0xa5e9c8c58c6ef8e lrc: 3/0,0 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed48 expref: 231 pid: 6307 timeout: 1315 lvb_type: 0 00010000:00010000:1.0:1772305903.504740:0:6323:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007fcf3076/0xa5e9c8c58c6ef8e lrc: 0/0,0 mode: --/PW res: [0x1ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed48 expref: 231 pid: 6307 timeout: 1315 lvb_type: 0 00010000:00010000:1.0:1772305903.504757:0:6323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305903.504759:0:6323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305903.504765:0:6323:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6effe lrc: 3/1,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305903.504787:0:6323:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6effe lrc: 4/1,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305903.504810:0:6323:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1772305903.504834:0:6323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000339dc28b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2216:x1858396225357248:12345-192.168.203.30@tcp:103:ldlm_bl_05.0 Request processed in 130us (219us total) trans 0 rc 0/0 00010000:00010000:3.0:1772305903.504835:0:6307:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6effe lrc: 3/1,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305903.504844:0:6323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3076 00010000:00010000:3.0:1772305903.504850:0:6307:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6effe lrc: 3/1,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305903.504864:0:6307:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6effe lrc: 3/1,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305903.504874:0:6307:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6effe lrc: 2/0,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305903.504892:0:6307:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1772305903.504916:0:5496:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1772305903.504921:0:5496:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6effe lrc: 2/0,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305903.504922:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000166181f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+229:2215:x1858396225357120:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 Request processed in 2621us (2740us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305903.504935:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5701 00010000:00010000:1.0:1772305903.504941:0:5496:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000099c1b7e6 already unused, calling callback (00000000b5e4f3c0) 00010000:00010000:1.0:1772305903.504945:0:5496:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6effe lrc: 2/0,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305903.504950:0:5496:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6effe lrc: 3/0,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305903.504960:0:5496:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6effe lrc: 1/0,0 mode: --/PR res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305903.504965:0:5496:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6effe lrc: 0/0,0 mode: --/PR res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305903.504975:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1772305903.504977:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1772305903.504978:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772305903.505553:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225357376 00000100:00100000:1.0:1772305903.505578:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 794 00000100:00100000:1.0:1772305903.505581:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000df58eb45 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+67:96183:x1858396225357376:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1772305903.505647:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000df58eb45 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+67:96183:x1858396225357376:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 44us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305903.505654:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 794 00000100:00100000:3.0:1772305903.506689:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225357440 00000100:00100000:3.0:1772305903.506712:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5702 00000100:00100000:3.0:1772305903.506716:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b7808eb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+229:2216:x1858396225357440:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1772305903.506722:0:6307:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305903.506736:0:6307:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6f005 lrc: 2/0,0 mode: --/PR res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ed79 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1772305903.506747:0:6307:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x1ad:0x0] initial LVB size: 1516, mtime: 0x69a33ded, atime: 0x0, ctime: 0x69a33ded, blocks: 0x1 00010000:00010000:3.0:1772305903.506755:0:6307:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1772305903.506756:0:6307:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1772305903.506759:0:6307:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6f005 lrc: 3/0,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed79 expref: 230 pid: 6307 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1772305903.506767:0:6307:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6f005 lrc: 3/0,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed79 expref: 230 pid: 6307 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1772305903.506774:0:6307:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d90d1abd, rc 0) 00000100:00100000:3.0:1772305903.506796:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b7808eb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2216:x1858396225357440:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 80us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305903.506806:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5702 00000100:00100000:1.0:1772305903.507551:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225357568 00000100:00100000:1.0:1772305903.507576:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 795 00000100:00100000:1.0:1772305903.507580:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d410c5a7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+67:96183:x1858396225357568:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1772305903.507616:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d410c5a7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+67:96183:x1858396225357568:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 35us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305903.507621:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 795 00000100:00100000:2.0:1772305903.508655:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305903.508696:0:21399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225357696 00002000:00100000:3.0:1772305903.508713:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x100010000:0x1ad:0x0] (0->4095) req@000000008f85e4e1 x1858396225357696/t0(0) o3->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:34/0 lens 488/0 e 0 to 0 dl 1772305909 ref 1 fl New:/0/ffffffff rc 0/-1 job:'lhsmtool_posix.0' 00002000:00100000:3.0:1772305903.508720:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 000000008f85e4e1 with x1858396225357696 ext(0->4095) 00002000:00010000:3.0:1772305903.508724:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000008f85e4e1 00000100:00100000:3.0:1772305903.508740:0:21399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2040 00000100:00100000:3.0:1772305903.508744:0:21399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008f85e4e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2216:x1858396225357696:12345-192.168.203.30@tcp:3:lhsmtool_posix.0 00000100:00100000:3.0:1772305903.508827:0:21399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008f85e4e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2216:x1858396225357696:12345-192.168.203.30@tcp:3:lhsmtool_posix.0 Request processed in 82us (174us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1772305903.508832:0:21399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2040 00002000:00100000:3.0:1772305903.508837:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x100010000:0x1ad:0x0] (0->4095) req@000000008f85e4e1 x1858396225357696/t0(0) o3->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:34/0 lens 488/4536 e 0 to 0 dl 1772305909 ref 1 fl Complete:/0/0 rc 4096/4096 job:'lhsmtool_posix.0' 00002000:00100000:3.0:1772305903.508843:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 000000008f85e4e1 with x1858396225357696 ext(0->4095) 00002000:00010000:3.0:1772305903.508845:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000008f85e4e1 00000100:00100000:1.0:1772305903.510112:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225357760 00000100:00100000:1.0:1772305903.510147:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 796 00000100:00100000:1.0:1772305903.510151:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005df41499 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+67:96183:x1858396225357760:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1772305903.510158:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305903.510168:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6f00c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x325:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ed80 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305903.510183:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000008cc4789a/0xa5e9c8c58c6f013 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x325:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305903.510190:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000008cc4789a/0xa5e9c8c58c6f013 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x325:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305903.510196:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000008cc4789a/0xa5e9c8c58c6f013 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x325:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305903.510267:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6f00c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x325:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed80 expref: 69 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305903.510277:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000008cc4789a/0xa5e9c8c58c6f013 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x325:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed80 expref: 68 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305903.510282:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x325:0x0].0x0 (000000009628d28f) 00010000:00010000:1.0:1772305903.510283:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1772305903.510285:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008cc4789a, rc 0) 00000100:00100000:1.0:1772305903.510309:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005df41499 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+68:96183:x1858396225357760:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 157us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305903.510313:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 796 00000100:00100000:1.0:1772305903.511425:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225357824 00000100:00100000:1.0:1772305903.511450:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 797 00000100:00100000:1.0:1772305903.511455:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fa281c23 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+68:96183:x1858396225357824:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1772305903.511469:0:54697:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x325:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1772305903.511527:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fa281c23 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+68:96183:x1858396225357824:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 71us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305903.511547:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 797 00000100:00100000:2.0:1772305903.512394:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305903.512457:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225357888 00000100:00100000:3.0:1772305903.512483:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5703 00000100:00100000:3.0:1772305903.512489:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000465b750e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2215:x1858396225357888:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1772305903.512510:0:6307:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002f753c58/0xa5e9c8c58c6f01a lrc: 3/1,0 mode: --/PR res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305903.512522:0:6307:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1772305903.512524:0:6307:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1772305903.512529:0:6307:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f753c58/0xa5e9c8c58c6f01a lrc: 3/1,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305903.512557:0:6307:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f753c58/0xa5e9c8c58c6f01a lrc: 3/1,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305903.512569:0:6307:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002f753c58/0xa5e9c8c58c6f01a lrc: 3/1,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305903.512574:0:6307:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f753c58/0xa5e9c8c58c6f01a lrc: 2/0,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305903.512588:0:6307:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1772305903.512615:0:38581:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1772305903.512619:0:38581:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f753c58/0xa5e9c8c58c6f01a lrc: 2/0,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305903.512647:0:38581:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002f753c58 already unused, calling callback (00000000b5e4f3c0) 00010000:00010000:1.0:1772305903.512649:0:38581:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f753c58/0xa5e9c8c58c6f01a lrc: 2/0,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305903.512661:0:38581:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f753c58/0xa5e9c8c58c6f01a lrc: 3/0,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305903.512663:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000465b750e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2215:x1858396225357888:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 Request processed in 134us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305903.512679:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5703 00010000:00010000:1.0:1772305903.512679:0:38581:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f753c58/0xa5e9c8c58c6f01a lrc: 1/0,0 mode: --/PR res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305903.512687:0:38581:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f753c58/0xa5e9c8c58c6f01a lrc: 0/0,0 mode: --/PR res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305903.512699:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1772305903.512700:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1772305903.512702:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772305903.513298:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225358016 00000100:00100000:1.0:1772305903.513323:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 798 00000100:00100000:1.0:1772305903.513327:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000095455a54 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+68:96183:x1858396225358016:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000040:00080000:1.0:1772305903.513482:0:54697:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x13:0x0].54, 168 off17024 00000040:00080000:1.0:1772305903.513580:0:54697:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x13:0x0].55, 168 off17192 00000001:00080000:1.0:1772305903.513584:0:54697:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934842 00000040:00080000:1.0:1772305903.513624:0:54697:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305903.513642:0:54697:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305903.513682:0:54697:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 36 count 12 00000040:00080000:1.0:1772305903.513688:0:54697:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:1.0:1772305903.513729:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000095455a54 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:96183:x1858396225358016:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 400us (469us total) trans 8589934842 rc 0/0 00000100:00100000:1.0:1772305903.513735:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 798 00000040:00080000:3.0:1772305903.513770:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305903.513773:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305903.514190:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 12 00000040:00080000:3.0:1772305903.514195:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:2.0:1772305903.514357:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225358144 00000100:00100000:2.0:1772305903.514386:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 99 00000100:00100000:2.0:1772305903.514391:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000597692b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:96183:x1858396225358144:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1772305903.514493:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000597692b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+70:96183:x1858396225358144:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 101us (174us total) trans 8589934843 rc 0/0 00000100:00100000:2.0:1772305903.514499:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 99 00000100:00100000:2.0:1772305903.683808:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305903.683860:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305903.683881:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225358272 00000100:00100000:2.0:1772305903.683886:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305903.683910:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305903.683948:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305903.683950:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225358336 00000100:00100000:3.0:1772305903.683952:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225358400 00000100:00100000:2.0:1772305903.683977:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225358464 00000100:00100000:3.0:1772305903.683989:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1168 00000100:00100000:3.0:1772305903.683997:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000088035587 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+223:2216:x1858396225358272:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:1.0:1772305903.684004:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 137 00000100:00100000:2.0:1772305903.684012:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1169 00000100:00100000:1.0:1772305903.684016:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c9564863 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+52:2215:x1858396225358336:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1772305903.684023:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e2ba2fc8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+161:2216:x1858396225358400:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1772305903.684046:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000088035587 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+223:2216:x1858396225358272:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 43us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305903.684063:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1168 00000100:00100000:2.0:1772305903.684065:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e2ba2fc8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+161:2216:x1858396225358400:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 40us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305903.684073:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c9564863 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+52:2215:x1858396225358336:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 56us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305903.684081:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1169 00000100:00100000:1.0:1772305903.684089:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 137 00000100:00100000:3.0:1772305903.684094:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1170 00000100:00100000:3.0:1772305903.684103:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005114ebc1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+140:2215:x1858396225358464:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1772305903.684143:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005114ebc1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+140:2215:x1858396225358464:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 41us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305903.684152:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1170 00000040:00080000:2.0:1772305904.239150:0:68651:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305904.239154:0:68651:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305904.239205:0:68651:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 36 count 12 00000040:00080000:2.0:1772305904.239210:0:68651:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:2.0:1772305904.328728:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1772305904.362716:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225358528 00000100:00100000:3.0:1772305904.362761:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5704 00000100:00100000:3.0:1772305904.362767:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000004563a97 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+140:2217:x1858396225358528:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1772305904.362782:0:6307:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305904.362804:0:6307:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6f021 lrc: 2/0,0 mode: --/PR res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ed87 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305904.362828:0:6307:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1772305904.362831:0:6307:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1772305904.362841:0:6307:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6f021 lrc: 3/0,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed87 expref: 141 pid: 6307 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1772305904.362858:0:6307:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6f021 lrc: 3/0,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed87 expref: 141 pid: 6307 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1772305904.362868:0:6307:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ca5be8d6, rc 0) 00000100:00100000:3.0:1772305904.362913:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000004563a97 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+141:2217:x1858396225358528:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 146us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305904.362919:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5704 00000100:00100000:1.0:1772305904.364938:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000040:00080000:2.0:1772305904.521731:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305904.521736:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305904.521780:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 37 count 13 00000040:00080000:2.0:1772305904.521787:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:2.0:1772305904.521862:0:54732:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d9dabf5 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:54732:1858396216600704:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1772305904.521930:0:54732:0:(client.c:2500:ptlrpc_set_wait()) set 000000007feb9551 going to sleep for 6 seconds 00000100:00100000:1.0:1772305904.523087:0:54732:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d9dabf5 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:54732:1858396216600704:192.168.203.30@tcp:107:hsm_cdtr.0 00000040:00080000:1.0:1772305904.523151:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305904.523154:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305904.523254:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 37 count 13 00000040:00080000:1.0:1772305904.523262:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:2.0:1772305904.653399:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225358784 00000100:00100000:2.0:1772305904.653444:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 800 00000100:00100000:2.0:1772305904.653450:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f95d20e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+52:96228:x1858396225358784:12345-192.168.203.30@tcp:36:rm.0 00010000:00010000:2.0:1772305904.653493:0:55653:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1772305904.653515:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ecdb8dda/0xa5e9c8c58c6efaa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x325:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed4f expref: 52 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305904.653547:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x325:0x0].0x0 (000000009628d28f) 00010000:00010000:2.0:1772305904.653555:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ee5a0681/0xa5e9c8c58c6efcd lrc: 0/0,0 mode: --/PR res: [0x200000408:0x8b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed64 expref: 51 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305904.653561:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8b:0x0].0x0 (0000000094db6ce7) 00010000:00010000:2.0:1772305904.653563:0:55653:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1772305904.653586:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c6f028 lrc: 3/0,1 mode: --/CW res: [0x200000408:0x8b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305904.653596:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c6f028 lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305904.653604:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c6f028 lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305904.653613:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6f02f lrc: 3/0,1 mode: --/PW res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305904.653617:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6f02f lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305904.653621:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6f02f lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305904.653722:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000e8ea7e31/0xa5e9c8c58c6f036 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x325:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305904.653732:0:55653:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 0000000023e766ad/0xa5e9c8c58c6ef6b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x325:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed33 expref: 69 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305904.653744:0:55653:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000480c2697/0xa5e9c8c58c6ef80 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x325:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed3a expref: 69 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305904.653752:0:55653:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e8ea7e31/0xa5e9c8c58c6f036 lrc: 5/0,1 mode: --/EX res: [0x200000402:0x325:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305904.653786:0:55653:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000480c2697/0xa5e9c8c58c6ef80 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x325:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed3a expref: 69 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305904.653801:0:55653:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000480c2697/0xa5e9c8c58c6ef80 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x325:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed3a expref: 69 pid: 54697 timeout: 1316 lvb_type: 0 00000100:00100000:2.0:1772305904.653816:0:55653:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005e7bbe3c pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:55653:1858396216600768:192.168.203.30@tcp:104: 00010000:00010000:2.0:1772305904.653883:0:55653:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 0000000023e766ad/0xa5e9c8c58c6ef6b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x325:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed33 expref: 69 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305904.653890:0:55653:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 0000000023e766ad/0xa5e9c8c58c6ef6b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x325:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed33 expref: 69 pid: 54697 timeout: 1316 lvb_type: 0 00000100:00100000:2.0:1772305904.653897:0:55653:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000db187a53 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:55653:1858396216600832:192.168.203.30@tcp:104: 00000100:00100000:2.0:1772305904.653917:0:55653:0:(client.c:2500:ptlrpc_set_wait()) set 00000000a51451eb going to sleep for 6 seconds 00000100:00100000:2.0:1772305904.654668:0:55653:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005e7bbe3c pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:55653:1858396216600768:192.168.203.30@tcp:104: 00000100:00100000:2.0:1772305904.654684:0:55653:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000db187a53 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:55653:1858396216600832:192.168.203.30@tcp:104: 00010000:00010000:2.0:1772305904.654706:0:55653:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 00000000e8ea7e31/0xa5e9c8c58c6f036 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x325:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305904.655125:0:6323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225358848 00010000:00010000:1.0:1772305904.655146:0:6323:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 0000000023e766ad/0xa5e9c8c58c6ef6b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x325:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed33 expref: 70 pid: 54697 timeout: 1316 lvb_type: 0 00000100:00100000:1.0:1772305904.655185:0:6323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225358912 00000100:00100000:2.0:1772305904.655194:0:5494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3077 00010000:00010000:1.0:1772305904.655198:0:6323:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000480c2697/0xa5e9c8c58c6ef80 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x325:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed3a expref: 71 pid: 54697 timeout: 1316 lvb_type: 0 00000100:00100000:2.0:1772305904.655204:0:5494:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fe03945a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+71:2216:x1858396225358848:12345-192.168.203.30@tcp:103:ldlm_bl_04.0 00010000:00010000:2.0:1772305904.655220:0:5494:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1772305904.655228:0:5494:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 0000000023e766ad/0xa5e9c8c58c6ef6b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x325:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed33 expref: 71 pid: 54697 timeout: 1316 lvb_type: 0 00000100:00100000:1.0:1772305904.655237:0:6323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3078 00010000:00010000:2.0:1772305904.655241:0:5494:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 0000000023e766ad/0xa5e9c8c58c6ef6b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x325:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed33 expref: 71 pid: 54697 timeout: 1316 lvb_type: 0 00000100:00100000:1.0:1772305904.655247:0:6323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000036f569f0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+71:2215:x1858396225358912:12345-192.168.203.30@tcp:103:ldlm_bl_08.0 00010000:00010000:1.0:1772305904.655264:0:6323:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1772305904.655266:0:5494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000023e766ad/0xa5e9c8c58c6ef6b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x325:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed33 expref: 71 pid: 54697 timeout: 1316 lvb_type: 0 00010000:00010000:1.0:1772305904.655272:0:6323:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000480c2697/0xa5e9c8c58c6ef80 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x325:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed3a expref: 71 pid: 54697 timeout: 1316 lvb_type: 0 00010000:00010000:1.0:1772305904.655288:0:6323:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000480c2697/0xa5e9c8c58c6ef80 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x325:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed3a expref: 70 pid: 54697 timeout: 1316 lvb_type: 0 00010000:00010000:2.0:1772305904.655307:0:5494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x325:0x0].0x0 (000000009628d28f) 00010000:00010000:2.0:1772305904.655312:0:5494:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: 00000000e8ea7e31/0xa5e9c8c58c6f036 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x325:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305904.655318:0:5494:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: 00000000e8ea7e31/0xa5e9c8c58c6f036 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x325:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305904.655324:0:5494:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1772305904.655334:0:6323:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000480c2697/0xa5e9c8c58c6ef80 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x325:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed3a expref: 70 pid: 54697 timeout: 1316 lvb_type: 0 00010000:00010000:1.0:1772305904.655348:0:6323:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x325:0x0].0x0 (000000009628d28f) 00010000:00010000:1.0:1772305904.655351:0:6323:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: 00000000e8ea7e31/0xa5e9c8c58c6f036 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x325:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305904.655358:0:5494:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fe03945a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:2216:x1858396225358848:12345-192.168.203.30@tcp:103:ldlm_bl_04.0 Request processed in 156us (276us total) trans 0 rc 0/0 00010000:00010000:1.0:1772305904.655359:0:6323:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000e8ea7e31/0xa5e9c8c58c6f036 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x325:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305904.655372:0:5494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3077 00010000:00010000:1.0:1772305904.655373:0:6323:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e8ea7e31/0xa5e9c8c58c6f036 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x325:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305904.655400:0:6323:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1772305904.655405:0:55653:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 00000000e8ea7e31/0xa5e9c8c58c6f036 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x325:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305904.655414:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e8ea7e31/0xa5e9c8c58c6f036 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x325:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305904.655437:0:6323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000036f569f0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+68:2215:x1858396225358912:12345-192.168.203.30@tcp:103:ldlm_bl_08.0 Request processed in 191us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305904.655447:0:6323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3078 00000040:00080000:2.0:1772305904.655873:0:55653:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xd:0x0].10, 64 off8880 00000004:00080000:2.0:1772305904.655880:0:55653:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1216550252217ns, next at 1217550249682ns, rc = 0 00000040:00080000:2.0:1772305904.655905:0:55653:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x13:0x0].56, 184 off17376 00010000:00010000:2.0:1772305904.655969:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6f03d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x325:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305904.655977:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6f03d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x325:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 18446631284783354304 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305904.655983:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6f03d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x325:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 18446631284783354304 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305904.655988:0:55653:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6f03d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x325:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 18446631284783354304 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305904.655992:0:55653:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6f03d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x325:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 18446631284783354304 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305904.655996:0:55653:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6f03d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x325:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 18446631284783354304 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305904.656013:0:55653:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1772305904.656027:0:55653:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000f95d20e7 reply state 000000004e9eacba transno 8589934844 ns: mdt-lustre-MDT0000_UUID lock: 00000000e8ea7e31/0xa5e9c8c58c6f036 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x325:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305904.656066:0:55653:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c6f028 lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305904.656075:0:55653:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c6f028 lrc: 2/0,0 mode: CW/CW res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305904.656080:0:55653:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c6f028 lrc: 3/0,0 mode: CW/CW res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305904.656087:0:55653:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000004e3177f5 already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305904.656091:0:55653:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c6f028 lrc: 3/0,0 mode: CW/CW res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305904.656109:0:55653:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c6f028 lrc: 4/0,0 mode: CW/CW res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305904.656120:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8b:0x0].0x0 (0000000094db6ce7) 00010000:00010000:2.0:1772305904.656123:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305904.656125:0:55653:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c6f028 lrc: 2/0,0 mode: --/CW res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305904.656131:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c6f028 lrc: 0/0,0 mode: --/CW res: [0x200000408:0x8b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1772305904.656141:0:55653:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000f95d20e7 reply state 000000004e9eacba transno 8589934844 ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6f02f lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305904.656182:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f95d20e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+52:96228:x1858396225358784:12345-192.168.203.30@tcp:36:rm.0 Request processed in 2731us (2832us total) trans 8589934844 rc 0/0 00000100:00100000:2.0:1772305904.656188:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 800 00010000:00010000:2.0:1772305904.656734:0:2977:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6f02f lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305904.656741:0:2977:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6f02f lrc: 2/0,0 mode: PW/PW res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305904.656746:0:2977:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6f02f lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305904.656751:0:2977:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000010dea6ba already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305904.656753:0:2977:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6f02f lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305904.656757:0:2977:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6f02f lrc: 4/0,0 mode: PW/PW res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305904.656764:0:2977:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8b:0x0].0x402924b4 (00000000922630d0) 00010000:00010000:2.0:1772305904.656766:0:2977:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305904.656767:0:2977:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6f02f lrc: 2/0,0 mode: --/PW res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305904.656771:0:2977:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6f02f lrc: 0/0,0 mode: --/PW res: [0x200000408:0x8b:0x0].0x402924b4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305904.656782:0:2977:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000e8ea7e31/0xa5e9c8c58c6f036 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x325:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305904.656785:0:2977:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e8ea7e31/0xa5e9c8c58c6f036 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x325:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305904.656789:0:2977:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000e8ea7e31/0xa5e9c8c58c6f036 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x325:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305904.656793:0:2977:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e8ea7e31 already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305904.656794:0:2977:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e8ea7e31/0xa5e9c8c58c6f036 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x325:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305904.656799:0:2977:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e8ea7e31/0xa5e9c8c58c6f036 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x325:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305904.656804:0:2977:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x325:0x0].0x0 (000000009628d28f) 00010000:00010000:2.0:1772305904.656805:0:2977:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1772305904.656806:0:2977:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000e8ea7e31/0xa5e9c8c58c6f036 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x325:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305904.656810:0:2977:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e8ea7e31/0xa5e9c8c58c6f036 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x325:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305904.688037:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225358976 00000100:00100000:3.0:1772305904.688099:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 801 00000100:00100000:3.0:1772305904.688108:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000085b92210 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+68:96235:x1858396225358976:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1772305904.688140:0:55653:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x325:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1772305904.688226:0:55653:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000402:0x325:0x0]: rc = -2 00000100:00100000:3.0:1772305904.688280:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000085b92210 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+68:96235:x1858396225358976:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 172us (308us total) trans 0 rc -2/-2 00000100:00100000:3.0:1772305904.688288:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 801 00000100:00100000:3.0:1772305904.691370:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225359232 00000100:00100000:3.0:1772305904.691395:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 803 00000100:00100000:3.0:1772305904.691398:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000029164250 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+68:96235:x1858396225359232:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000040:00080000:3.0:1772305904.691574:0:55653:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x13:0x0].57, 168 off17544 00000040:00080000:3.0:1772305904.692149:0:55653:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305904.692154:0:55653:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305904.692216:0:55653:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 37 count 13 00000040:00080000:3.0:1772305904.692222:0:55653:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:3.0:1772305904.692272:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000029164250 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:96235:x1858396225359232:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 870us (935us total) trans 8589934845 rc 0/0 00000100:00100000:3.0:1772305904.692278:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 803 00000040:00080000:2.0:1772305904.692347:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305904.692357:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305904.692860:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 13 00000040:00080000:2.0:1772305904.692868:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:3.0:1772305904.969986:0:68754:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305904.969992:0:68754:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305904.970069:0:68754:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 37 count 13 00000040:00080000:3.0:1772305904.970074:0:68754:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:3.0:1772305904.996168:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225359296 00000100:00100000:3.0:1772305904.996220:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 804 00000100:00100000:3.0:1772305904.996227:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006392f955 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:96250:x1858396225359296:12345-192.168.203.30@tcp:501:chlg_load_threa.0 00000100:00100000:3.0:1772305904.996375:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006392f955 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:96250:x1858396225359296:12345-192.168.203.30@tcp:501:chlg_load_threa.0 Request processed in 148us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305904.996382:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 804 00000100:00100000:3.0:1772305904.997198:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225359360 00000100:00100000:3.0:1772305904.997228:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 805 00000100:00100000:3.0:1772305904.997239:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007d3428b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:96250:x1858396225359360:12345-192.168.203.30@tcp:503:chlg_load_threa.0 00000100:00100000:3.0:1772305904.997405:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007d3428b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:96250:x1858396225359360:12345-192.168.203.30@tcp:503:chlg_load_threa.0 Request processed in 166us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305904.997412:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 805 00000100:00100000:3.0:1772305904.998118:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305904.998163:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225359424 00000100:00100000:1.0:1772305904.998195:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 806 00000100:00100000:1.0:1772305904.998200:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000093b46947 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:96250:x1858396225359424:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1772305904.998346:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000093b46947 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:96250:x1858396225359424:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 145us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305904.998352:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 806 00000100:00100000:1.0:1772305904.998982:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305904.999011:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225359488 00000100:00100000:3.0:1772305904.999044:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 807 00000100:00100000:3.0:1772305904.999050:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000012371d1b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:96250:x1858396225359488:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1772305904.999177:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000012371d1b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:96250:x1858396225359488:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 126us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305904.999183:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 807 00000100:00100000:2.0:1772305904.999862:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305904.999888:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225359552 00000100:00100000:3.0:1772305904.999983:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 808 00000100:00100000:3.0:1772305904.999989:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000db187a53 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:96250:x1858396225359552:12345-192.168.203.30@tcp:501:chlg_load_threa.0 00000100:00100000:3.0:1772305905.000040:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000db187a53 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:96250:x1858396225359552:12345-192.168.203.30@tcp:501:chlg_load_threa.0 Request processed in 51us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305905.000049:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 808 00000100:00100000:1.0:1772305905.000615:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305905.001437:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305905.002430:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000001:00080000:2.0:1772305905.623703:0:54724:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934836 is committed 00000001:00080000:2.0:1772305905.623728:0:54724:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934842 is committed 00000001:00080000:2.0:1772305905.623742:0:54724:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934838 is committed 00000001:00080000:2.0:1772305905.623750:0:54724:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934844 is committed 00000004:00080000:2.0:1772305905.623754:0:54724:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 10 committed 00000001:00080000:2.0:1772305905.623770:0:54724:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934843 is committed 00000001:00080000:2.0:1772305905.623790:0:54724:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934845 is committed 00000100:00100000:2.0:1772305905.623892:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b896dfee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216600896:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1772305905.623944:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305905.623979:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216600896 00000100:00100000:3.0:1772305905.624027:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5705 00000100:00100000:3.0:1772305905.624035:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005e7bbe3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216600896:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1772305905.624060:0:6307:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:429 count 1 00010000:00010000:3.0:1772305905.624084:0:6307:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cace9935/0xa5e9c8c58c6f059 lrc: 3/0,1 mode: --/PW res: [0x1ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305905.624105:0:6307:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6f005 lrc: 2/0,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed79 expref: 227 pid: 6307 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1772305905.624123:0:6307:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6f021 lrc: 2/0,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed87 expref: 140 pid: 6307 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1772305905.624131:0:6307:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1772305905.624134:0:6307:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1772305905.624137:0:6307:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cace9935/0xa5e9c8c58c6f059 lrc: 5/0,1 mode: --/PW res: [0x1ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305905.624162:0:6307:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6f021 lrc: 3/0,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed87 expref: 140 pid: 6307 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1772305905.624175:0:6307:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6f021 lrc: 4/0,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed87 expref: 140 pid: 6307 timeout: 1317 lvb_type: 1 00000100:00100000:3.0:1772305905.624187:0:6307:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d90d4880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6307:1858396216600960:192.168.203.30@tcp:104: 00010000:00010000:3.0:1772305905.624249:0:6307:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6f005 lrc: 3/0,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed79 expref: 227 pid: 6307 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1772305905.624259:0:6307:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6f005 lrc: 4/0,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed79 expref: 227 pid: 6307 timeout: 1317 lvb_type: 1 00000100:00100000:3.0:1772305905.624270:0:6307:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a965e4a2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6307:1858396216601024:192.168.203.30@tcp:104: 00000100:00100000:3.0:1772305905.624294:0:6307:0:(client.c:2500:ptlrpc_set_wait()) set 0000000051c8b29c going to sleep for 6 seconds 00000100:00100000:3.0:1772305905.625478:0:6307:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d90d4880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6307:1858396216600960:192.168.203.30@tcp:104: 00000100:00100000:3.0:1772305905.625490:0:6307:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a965e4a2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6307:1858396216601024:192.168.203.30@tcp:104: 00010000:00010000:3.0:1772305905.625515:0:6307:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cace9935/0xa5e9c8c58c6f059 lrc: 3/0,1 mode: --/PW res: [0x1ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305905.625886:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305905.625910:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305905.625976:0:16126:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225359872 00010000:00010000:3.0:1772305905.625998:0:16126:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6f005 lrc: 4/0,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed79 expref: 228 pid: 6307 timeout: 1317 lvb_type: 1 00000100:00100000:3.0:1772305905.626062:0:16126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3080 00000100:00100000:3.0:1772305905.626070:0:16126:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f237ebcd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+228:2217:x1858396225359872:12345-192.168.203.30@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1772305905.626084:0:16126:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1772305905.626092:0:16126:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6f005 lrc: 4/0,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed79 expref: 228 pid: 6307 timeout: 1317 lvb_type: 1 00010000:00010000:3.0:1772305905.626123:0:16126:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6f005 lrc: 3/0,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed79 expref: 228 pid: 6307 timeout: 1317 lvb_type: 1 00010000:00010000:3.0:1772305905.626158:0:16126:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6f005 lrc: 0/0,0 mode: --/PR res: [0x1ad:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed79 expref: 228 pid: 6307 timeout: 1317 lvb_type: 1 00010000:00010000:3.0:1772305905.626211:0:16126:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1772305905.626244:0:6307:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cace9935/0xa5e9c8c58c6f059 lrc: 3/0,1 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305905.626252:0:16126:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f237ebcd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2217:x1858396225359872:12345-192.168.203.30@tcp:103:ldlm_bl_01.0 Request processed in 179us (337us total) trans 0 rc 0/0 00010000:00010000:1.0:1772305905.626260:0:6307:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cace9935/0xa5e9c8c58c6f059 lrc: 3/0,1 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305905.626275:0:16126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3080 00010000:00010000:1.0:1772305905.626283:0:6307:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cace9935/0xa5e9c8c58c6f059 lrc: 3/0,1 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305905.626295:0:6307:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cace9935/0xa5e9c8c58c6f059 lrc: 2/0,0 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305905.626314:0:6307:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1772305905.626327:0:38581:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1772305905.626333:0:38581:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cace9935/0xa5e9c8c58c6f059 lrc: 2/0,0 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305905.626399:0:38581:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cace9935 already unused, calling callback (00000000b5e4f3c0) 00010000:00010000:3.0:1772305905.626403:0:38581:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cace9935/0xa5e9c8c58c6f059 lrc: 2/0,0 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305905.626412:0:38581:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cace9935/0xa5e9c8c58c6f059 lrc: 3/0,0 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305905.626427:0:38581:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cace9935/0xa5e9c8c58c6f059 lrc: 1/0,0 mode: --/PW res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305905.626434:0:38581:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cace9935/0xa5e9c8c58c6f059 lrc: 0/0,0 mode: --/PW res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305905.626451:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1772305905.626454:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1772305905.626457:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772305905.626737:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005e7bbe3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:2994:x1858396216600896:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2702us (2791us total) trans 4294968344 rc 0/0 00000100:00100000:1.0:1772305905.626746:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5705 00000004:00080000:2.0:1772305905.626778:0:2994:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000b896dfee/2, rc 0, transno 1048 00000100:00100000:2.0:1772305905.626785:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b896dfee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216600896:0@lo:6:osp-syn-1-0.0 00000040:00080000:2.0:1772305905.736847:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305905.736856:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00100000:2.0:1772305905.736893:0:54732:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 25 in log [0xf:0x1:0x0] 00000040:00080000:2.0:1772305905.737040:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 37 count 12 00000040:00080000:2.0:1772305905.737048:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:3.0:1772305906.120747:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000042fe330 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216601088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1772305906.120851:0:7591:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216601152 00000100:00100000:1.0:1772305906.120867:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305906.120893:0:7591:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216601088 00000100:00100000:3.0:1772305906.120926:0:7591:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 450 00000100:00100000:3.0:1772305906.120932:0:7591:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000454a81c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:2991:x1858396216601088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1772305906.120956:0:7591:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 693829632 pending 0 free 3606052864 avail 3603955712 00000100:00100000:3.0:1772305906.121015:0:7591:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000454a81c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:2991:x1858396216601088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305906.121033:0:7591:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 450 00000100:00100000:1.0:1772305906.121043:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f8a1bcf1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216601152:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1772305906.377724:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1772305906.632785:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bbac71e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:2991:1858396216601344:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1772305906.632797:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000774a31b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:2994:1858396216601280:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1772305906.632857:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000090b11f09 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:2992:1858396216601408:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305906.632859:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772305906.632896:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305906.632925:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216601344 00000100:00100000:3.0:1772305906.632951:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216601408 00000100:00100000:1.0:1772305906.632967:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1772305906.632974:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a965e4a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:2991:x1858396216601344:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1772305906.632980:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1772305906.632990:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003132ee1a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:2992:x1858396216601408:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305906.633008:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305906.633025:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a965e4a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:2991:x1858396216601344:12345-0@lo:400:kworker/u8:0.0 Request processed in 51us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305906.633033:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1772305906.633060:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216601280 00000100:00100000:2.0:1772305906.633063:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003132ee1a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:2992:x1858396216601408:12345-0@lo:400:kworker/u8:0.0 Request processed in 64us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305906.633073:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1772305906.633096:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1772305906.633102:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001b48db0d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:2994:x1858396216601280:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305906.633135:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bbac71e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:2991:1858396216601344:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1772305906.633141:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001b48db0d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:2994:x1858396216601280:12345-0@lo:400:kworker/u8:0.0 Request processed in 38us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305906.633147:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1772305906.633184:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000090b11f09 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:2992:1858396216601408:0@lo:400:kworker/u8:0.0 00000040:00080000:3.0:1772305906.993337:0:68958:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1772305906.993343:0:68958:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x11:0x1:0x0]:0 at index 1 of catalog [0x6:0xa:0x0] 00000040:00080000:3.0:1772305906.993371:0:68958:0:(llog.c:789:llog_process_thread()) stop processing plain 0x11:1:0 index 12 count 2 00000040:00080000:3.0:1772305906.993375:0:68958:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x6:10:0 index 2 count 2 00000100:00100000:2.0:1772305907.010386:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305907.010442:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225359936 00000100:00100000:3.0:1772305907.010495:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 812 00000100:00100000:3.0:1772305907.010502:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000090b11f09 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+61:96687:x1858396225359936:12345-192.168.203.30@tcp:46:lfs.0 00000004:00000080:3.0:1772305907.010548:0:54698:0:(mdt_handler.c:7411:mdt_iocontrol()) handling ioctl cmd 0x424066b3 00000004:00000080:3.0:1772305907.010581:0:54698:0:(mdd_device.c:2125:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=11, endrec=0 00000040:00080000:3.0:1772305907.010720:0:54698:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1772305907.010724:0:54698:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x11:0x1:0x0]:0 at index 1 of catalog [0x6:0xa:0x0] 00000004:00000080:3.0:1772305907.010769:0:54698:0:(mdd_device.c:2095:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl11 endrec = 56 00000040:00080000:3.0:1772305907.010863:0:54698:0:(llog.c:789:llog_process_thread()) stop processing plain 0x11:1:0 index 12 count 2 00000040:00080000:3.0:1772305907.010868:0:54698:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x6:10:0 index 2 count 2 00000004:00000080:3.0:1772305907.010872:0:54698:0:(mdd_device.c:2173:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl11 entries up to 18446744073709551615 00000040:00080000:3.0:1772305907.010906:0:54698:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1772305907.010908:0:54698:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x13:0x1:0x0]:0 at index 1 of catalog [0x5:0xa:0x0] 00000040:00100000:3.0:1772305907.010937:0:54698:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 53 in log [0x13:0x1:0x0] 00000040:00100000:3.0:1772305907.010999:0:54698:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 54 in log [0x13:0x1:0x0] 00000040:00100000:3.0:1772305907.011044:0:54698:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 55 in log [0x13:0x1:0x0] 00000040:00100000:3.0:1772305907.011098:0:54698:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 56 in log [0x13:0x1:0x0] 00000040:00100000:3.0:1772305907.011160:0:54698:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 57 in log [0x13:0x1:0x0] 00000040:00080000:3.0:1772305907.011218:0:54698:0:(llog.c:789:llog_process_thread()) stop processing plain 0x13:1:0 index 57 count 1 00000040:00080000:3.0:1772305907.011234:0:54698:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x5:10:0 index 2 count 2 00000100:00100000:3.0:1772305907.011340:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000090b11f09 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+61:96687:x1858396225359936:12345-192.168.203.30@tcp:46:lfs.0 Request processed in 835us (957us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305907.011350:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 812 00000020:00000080:2.0:1772305907.292156:0:69006:0:(class_obd.c:302:class_handle_ioctl()) cmd = c008667f 00000020:00000080:2.0:1772305907.292163:0:69006:0:(class_obd.c:126:class_resolve_dev_name()) device name lustre-MDT0000 00000020:00000080:2.0:1772305907.292168:0:69006:0:(class_obd.c:133:class_resolve_dev_name()) device name lustre-MDT0000, dev 5 00000020:00000080:2.0:1772305907.292199:0:69006:0:(class_obd.c:302:class_handle_ioctl()) cmd = 424066b2 00000004:00000080:2.0:1772305907.292204:0:69006:0:(mdt_handler.c:7411:mdt_iocontrol()) handling ioctl cmd 0x424066b2 00000004:00000080:2.0:1772305907.292240:0:69006:0:(mdd_device.c:2125:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=11, endrec=0 00000040:00080000:2.0:1772305907.292299:0:69006:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1772305907.292302:0:69006:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x11:0x1:0x0]:0 at index 1 of catalog [0x6:0xa:0x0] 00000004:00000080:2.0:1772305907.292331:0:69006:0:(mdd_device.c:2095:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl11 endrec = 56 00000040:00080000:2.0:1772305907.292387:0:69006:0:(llog.c:789:llog_process_thread()) stop processing plain 0x11:1:0 index 12 count 2 00000040:00080000:2.0:1772305907.292395:0:69006:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x6:10:0 index 2 count 2 00000004:00000080:2.0:1772305907.292398:0:69006:0:(mdd_device.c:2173:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl11 entries up to 18446744073709551615 00000040:00080000:2.0:1772305907.292423:0:69006:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1772305907.292425:0:69006:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x13:0x1:0x0]:0 at index 1 of catalog [0x5:0xa:0x0] 00000040:00080000:2.0:1772305907.292864:0:69006:0:(llog.c:789:llog_process_thread()) stop processing plain 0x13:1:0 index 64768 count 1 00000040:00080000:2.0:1772305907.292870:0:69006:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x5:10:0 index 2 count 2 00000004:00000080:2.0:1772305907.292875:0:69006:0:(mdd_device.c:1983:mdd_changelog_user_purge()) lustre-MDD0000: Purge request: id=11 00000040:00080000:2.0:1772305907.292897:0:69006:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1772305907.292899:0:69006:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x11:0x1:0x0]:0 at index 1 of catalog [0x6:0xa:0x0] 00000040:00100000:2.0:1772305907.292913:0:69006:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 11 in log [0x11:0x1:0x0] 00000040:00080000:2.0:1772305907.292971:0:69006:0:(llog.c:789:llog_process_thread()) stop processing plain 0x11:1:0 index 11 count 1 00000040:00080000:2.0:1772305907.292975:0:69006:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x6:10:0 index 2 count 2 00000004:00000080:2.0:1772305907.292977:0:69006:0:(mdd_device.c:2005:mdd_changelog_user_purge()) turning off changelogs 00000004:02000000:2.0:1772305907.292978:0:69006:0:(mdd_device.c:483:mdd_changelog_off()) lustre-MDD0000: changelog off 00000004:00000080:2.0:1772305907.292980:0:69006:0:(mdd_device.c:2015:mdd_changelog_user_purge()) lustre-MDD0000: Purge changelog entries for user cl11 record=18446744073709551615 00000040:00080000:2.0:1772305907.292996:0:69006:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1772305907.292997:0:69006:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x13:0x1:0x0]:0 at index 1 of catalog [0x5:0xa:0x0] 00000040:00080000:2.0:1772305907.293370:0:69006:0:(llog.c:789:llog_process_thread()) stop processing plain 0x13:1:0 index 64768 count 1 00000040:00080000:2.0:1772305907.293375:0:69006:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x5:10:0 index 2 count 2 00000040:00080000:2.0:1772305907.293401:0:69006:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1772305907.293403:0:69006:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x11:0x1:0x0]:0 at index 1 of catalog [0x6:0xa:0x0] 00000040:00080000:2.0:1772305907.293822:0:69006:0:(llog.c:789:llog_process_thread()) stop processing plain 0x11:1:0 index 64768 count 1 00000040:00080000:2.0:1772305907.293827:0:69006:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x6:10:0 index 2 count 2 00000100:00100000:1.0:1772305907.618885:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305907.618937:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225360000 00000100:00100000:3.0:1772305907.618990:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 813 00000100:00100000:3.0:1772305907.618997:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ee429faf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+61:96131:x1858396225360000:12345-192.168.203.30@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1772305907.619094:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ee429faf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+61:96131:x1858396225360000:12345-192.168.203.30@tcp:60:lhsmtool_posix.0 Request processed in 96us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305907.619103:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 813 00000400:00000080:3.0:1772305908.165880:0:69102:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:3.0:1772305908.165883:0:69102:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 225: Changelog for remove canceled ==== 14:11:47 (1772305907) 00000100:00100000:2.0:1772305908.803978:0:54689:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225360064 00000100:00100000:2.0:1772305908.804036:0:54689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 140 00000100:00100000:1.0:1772305908.804041:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225360192 00000100:00100000:2.0:1772305908.804046:0:54689:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000690faca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2218:x1858396225360064:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1772305908.804051:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225360320 00000100:00100000:1.0:1772305908.804085:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225360448 00000100:00100000:3.0:1772305908.804099:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225360128 00000100:00100000:1.0:1772305908.804121:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225360256 00000100:00100000:2.0:1772305908.804126:0:54689:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000690faca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2218:x1858396225360064:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 81us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305908.804138:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 141 00000100:00100000:2.0:1772305908.804142:0:54689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 140 00000100:00100000:3.0:1772305908.804150:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d4ebb128 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+49:2218:x1858396225360320:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:1.0:1772305908.804157:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225360384 00000100:00100000:3.0:1772305908.804197:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d4ebb128 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+49:2218:x1858396225360320:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 44us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305908.804198:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1171 00000100:00100000:1.0:1772305908.804213:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000451e9247 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+223:2218:x1858396225360192:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1772305908.804214:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 141 00000100:00100000:2.0:1772305908.804214:0:18149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1172 00000100:00100000:2.0:1772305908.804228:0:18149:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d831f9af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f935b4d0-e17f-49c8-8011-4be99ba75430+140:2218:x1858396225360448:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1772305908.804238:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 142 00000100:00100000:3.0:1772305908.804243:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000039c4cb43 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+61:2218:x1858396225360128:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:1.0:1772305908.804264:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000451e9247 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+223:2218:x1858396225360192:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 58us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305908.804272:0:18149:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d831f9af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f935b4d0-e17f-49c8-8011-4be99ba75430+140:2218:x1858396225360448:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 43us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305908.804279:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1171 00000100:00100000:3.0:1772305908.804283:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000039c4cb43 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+61:2218:x1858396225360128:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 38us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305908.804287:0:18149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1172 00000100:00100000:3.0:1772305908.804297:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 142 00000100:00100000:1.0:1772305908.804305:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1173 00000100:00100000:1.0:1772305908.804310:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e3d2d7c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2218:x1858396225360256:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1772305908.804318:0:18149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1174 00000100:00100000:2.0:1772305908.804325:0:18149:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000db51b4fe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f935b4d0-e17f-49c8-8011-4be99ba75430+161:2218:x1858396225360384:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:1.0:1772305908.804335:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e3d2d7c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2218:x1858396225360256:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 23us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305908.804341:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1173 00000100:00100000:2.0:1772305908.804375:0:18149:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000db51b4fe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f935b4d0-e17f-49c8-8011-4be99ba75430+161:2218:x1858396225360384:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 49us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305908.804382:0:18149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1174 00010000:00010000:3.0:1772305909.448811:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:1.0:1772305910.350582:0:69296:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1772305910.350587:0:69296:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 226: changelog for last rm/mv with exiting archive ========================================================== 14:11:49 (1772305909) 00000100:00100000:1.0:1772305910.452234:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305910.452300:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225360512 00000100:00100000:3.0:1772305910.452346:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 814 00000100:00100000:3.0:1772305910.452352:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fcb0beee pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+61:97452:x1858396225360512:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1772305910.452370:0:55653:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305910.452387:0:55653:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6f060 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ed95 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.452434:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6f067 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.452445:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6f067 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.452454:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6f067 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1772305910.452531:0:55653:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:3.0:1772305910.452535:0:55653:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 106 stripe count 1 MDT count 1 00000004:00010000:3.0:1772305910.452555:0:55653:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6f067 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.452574:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6f060 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed95 expref: 63 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.452587:0:55653:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6f067 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed95 expref: 62 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.452592:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:3.0:1772305910.452594:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1772305910.452596:0:55653:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d90d1abd, rc 0) 00000100:00100000:3.0:1772305910.452690:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fcb0beee pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+62:97452:x1858396225360512:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 336us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305910.452697:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 814 00000100:00100000:1.0:1772305910.455823:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305910.455875:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225360640 00000100:00100000:3.0:1772305910.455912:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 815 00000100:00100000:3.0:1772305910.455920:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fb724402 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+62:97453:x1858396225360640:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1772305910.455934:0:55653:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305910.455948:0:55653:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d02430e8/0xa5e9c8c58c6f06e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ed9c expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.455999:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000d6b71f01/0xa5e9c8c58c6f075 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.456010:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d6b71f01/0xa5e9c8c58c6f075 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.456020:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d6b71f01/0xa5e9c8c58c6f075 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.456035:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6f07c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.456041:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6f07c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.456048:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6f07c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1772305910.456145:0:55653:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 10752 00010000:00010000:3.0:1772305910.456275:0:55653:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000d6b71f01/0xa5e9c8c58c6f075 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.456282:0:55653:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d6b71f01/0xa5e9c8c58c6f075 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.456289:0:55653:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d6b71f01/0xa5e9c8c58c6f075 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.456295:0:55653:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d6b71f01 already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305910.456298:0:55653:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d6b71f01/0xa5e9c8c58c6f075 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.456305:0:55653:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d6b71f01/0xa5e9c8c58c6f075 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.456315:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (000000006b52a2ed) 00010000:00010000:3.0:1772305910.456318:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305910.456321:0:55653:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d6b71f01/0xa5e9c8c58c6f075 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.456327:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d6b71f01/0xa5e9c8c58c6f075 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.456337:0:55653:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6f07c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.456343:0:55653:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6f07c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.456348:0:55653:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6f07c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.456359:0:55653:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ca5be8d6 already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305910.456361:0:55653:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6f07c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.456366:0:55653:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6f07c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.456373:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (00000000fbf2c1ae) 00010000:00010000:3.0:1772305910.456376:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305910.456378:0:55653:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6f07c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.456383:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6f07c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.456410:0:55653:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000d02430e8/0xa5e9c8c58c6f06e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed9c expref: 64 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.456417:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d02430e8/0xa5e9c8c58c6f06e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed9c expref: 64 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.456425:0:55653:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d02430e8, rc 0) 00000100:00100000:3.0:1772305910.456467:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fb724402 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+63:97453:x1858396225360640:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 548us (649us total) trans 8589934846 rc 301/301 00000100:00100000:3.0:1772305910.456475:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 815 00000100:00100000:1.0:1772305910.457481:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305910.457551:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225360768 00000100:00100000:2.0:1772305910.457578:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 100 00000100:00100000:2.0:1772305910.457582:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000406aedbc pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+63:97453:x1858396225360768:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1772305910.457736:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000406aedbc pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+64:97453:x1858396225360768:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 152us (256us total) trans 8589934847 rc 0/0 00000100:00100000:2.0:1772305910.457745:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 100 00000100:00100000:1.0:1772305910.458756:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305910.458789:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225360832 00000100:00100000:3.0:1772305910.458814:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 816 00000100:00100000:3.0:1772305910.458818:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b74b7ed1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+64:97453:x1858396225360832:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1772305910.458873:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b74b7ed1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+64:97453:x1858396225360832:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 Request processed in 53us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305910.458882:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 816 00000100:00100000:1.0:1772305910.466174:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305910.466219:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225360896 00000100:00100000:3.0:1772305910.466261:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 817 00000100:00100000:3.0:1772305910.466266:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000015856d86 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+49:97454:x1858396225360896:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1772305910.466285:0:55653:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305910.466301:0:55653:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6f08a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196eda3 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.466347:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f091 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.466358:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f091 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.466366:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f091 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.466376:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f098 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.466380:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f098 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.466384:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f098 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.466440:0:55653:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f091 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.466456:0:55653:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f091 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.466461:0:55653:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f091 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.466464:0:55653:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002f753c58 already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305910.466467:0:55653:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f091 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.466472:0:55653:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f091 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.466480:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:3.0:1772305910.466482:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305910.466500:0:55653:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f091 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.466505:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f091 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.466513:0:55653:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f098 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.466517:0:55653:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f098 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.466521:0:55653:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f098 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.466534:0:55653:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000099c1b7e6 already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305910.466536:0:55653:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f098 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.466542:0:55653:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f098 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.466551:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb470a5f1 (00000000ff843bf1) 00010000:00010000:3.0:1772305910.466553:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305910.466555:0:55653:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f098 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.466561:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f098 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.466592:0:55653:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6f08a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eda3 expref: 50 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.466600:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6f08a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eda3 expref: 50 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.466606:0:55653:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000cace9935, rc 0) 00000100:00100000:3.0:1772305910.466665:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000015856d86 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+49:97454:x1858396225360896:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 397us (496us total) trans 0 rc 301/301 00000100:00100000:3.0:1772305910.466672:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 817 00000100:00100000:1.0:1772305910.468818:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305910.468851:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225361024 00000100:00100000:3.0:1772305910.468882:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 818 00000100:00100000:3.0:1772305910.468886:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006b94893a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+49:97454:x1858396225361024:12345-192.168.203.30@tcp:36:lfs.0 00010000:00010000:3.0:1772305910.468917:0:55653:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1772305910.468930:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6efbf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed5d expref: 49 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.468943:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:3.0:1772305910.468946:0:55653:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1772305910.468978:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d02430e8/0xa5e9c8c58c6f09f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.468987:0:55653:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6f067 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed95 expref: 63 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.468992:0:55653:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d02430e8/0xa5e9c8c58c6f09f lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.469016:0:55653:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6f067 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed95 expref: 63 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.469029:0:55653:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6f067 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ed95 expref: 63 pid: 55653 timeout: 1322 lvb_type: 0 00000100:00100000:3.0:1772305910.469041:0:55653:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000af22ffe1 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:55653:1858396216601472:192.168.203.30@tcp:104: 00000100:00100000:3.0:1772305910.469091:0:55653:0:(client.c:2500:ptlrpc_set_wait()) set 00000000f9504cb0 going to sleep for 6 seconds 00000100:00100000:3.0:1772305910.470016:0:55653:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000af22ffe1 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:55653:1858396216601472:192.168.203.30@tcp:104: 00010000:00010000:3.0:1772305910.470037:0:55653:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 00000000d02430e8/0xa5e9c8c58c6f09f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305910.470065:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00010000:3.0:1772305910.470274:0:55653:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 00000000d02430e8/0xa5e9c8c58c6f09f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.470295:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d02430e8/0xa5e9c8c58c6f09f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.470315:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6f0a6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.470322:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6f0a6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.470329:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6f0a6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1772305910.470852:0:55653:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000408:0x8c:0x0]: returning size 512 00010000:00010000:3.0:1772305910.470857:0:55653:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d02430e8/0xa5e9c8c58c6f09f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.470863:0:55653:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d02430e8/0xa5e9c8c58c6f09f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.470867:0:55653:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d02430e8/0xa5e9c8c58c6f09f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.470871:0:55653:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d02430e8 already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305910.470872:0:55653:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d02430e8/0xa5e9c8c58c6f09f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.470876:0:55653:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d02430e8/0xa5e9c8c58c6f09f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.470882:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:3.0:1772305910.470889:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305910.470892:0:55653:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d02430e8/0xa5e9c8c58c6f09f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305910.470898:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d02430e8/0xa5e9c8c58c6f09f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1772305910.470908:0:55653:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000006b94893a reply state 0000000076a9d262 transno 8589934848 ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6f0a6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305910.470962:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006b94893a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+50:97454:x1858396225361024:12345-192.168.203.30@tcp:36:lfs.0 Request processed in 2075us (2145us total) trans 8589934848 rc 0/0 00000100:00100000:3.0:1772305910.470968:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 818 00010000:00010000:2.0:1772305910.471442:0:2978:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6f0a6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305910.471450:0:2978:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6f0a6 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305910.471454:0:2978:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6f0a6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305910.471458:0:2978:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ca5be8d6 already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305910.471460:0:2978:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6f0a6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305910.471464:0:2978:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6f0a6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305910.471470:0:2978:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb470a5f1 (00000000fbf2c1ae) 00010000:00010000:2.0:1772305910.471472:0:2978:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305910.471473:0:2978:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6f0a6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305910.471477:0:2978:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6f0a6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb470a5f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305910.473710:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772305910.474058:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305910.474091:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225361152 00000100:00100000:1.0:1772305910.475529:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305910.479689:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305910.480996:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305910.482017:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305910.486844:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305910.487964:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305910.489158:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00010000:2.0:1772305910.490526:0:2977:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f15c lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x8c:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305910.490534:0:2977:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f15c lrc: 2/0,0 mode: PW/PW res: [0x200000408:0x8c:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305910.490538:0:2977:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f15c lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x8c:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305910.490542:0:2977:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000f7a426e already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305910.490544:0:2977:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f15c lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x8c:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305910.490548:0:2977:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f15c lrc: 4/0,0 mode: PW/PW res: [0x200000408:0x8c:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305910.490555:0:2977:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8c:0x0].0x5e0cd9fa (000000003892ce01) 00010000:00010000:2.0:1772305910.490557:0:2977:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305910.490558:0:2977:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f15c lrc: 2/0,0 mode: --/PW res: [0x200000408:0x8c:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305910.490562:0:2977:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f15c lrc: 0/0,0 mode: --/PW res: [0x200000408:0x8c:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305910.490929:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305910.492008:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305910.492051:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225361792 00000100:00100000:2.0:1772305910.492083:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5706 00000100:00100000:2.0:1772305910.492087:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002aca8cc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+223:2216:x1858396225361792:12345-192.168.203.30@tcp:101:cp.0 00010000:00010000:2.0:1772305910.492094:0:6306:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305910.492104:0:6306:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8ea7e31/0xa5e9c8c58c6f17f lrc: 2/0,0 mode: --/PR res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ede9 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1772305910.492119:0:6306:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x1ad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1772305910.492131:0:6306:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1772305910.492132:0:6306:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1772305910.492138:0:6306:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8ea7e31/0xa5e9c8c58c6f17f lrc: 3/0,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ede9 expref: 224 pid: 6306 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1772305910.492146:0:6306:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e8ea7e31/0xa5e9c8c58c6f17f lrc: 3/0,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ede9 expref: 224 pid: 6306 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1772305910.492158:0:6306:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e8ea7e31, rc 0) 00000100:00100000:2.0:1772305910.492190:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002aca8cc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+224:2216:x1858396225361792:12345-192.168.203.30@tcp:101:cp.0 Request processed in 101us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305910.492198:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5706 00000100:00100000:1.0:1772305910.493111:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305910.493146:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225361856 00000100:00100000:2.0:1772305910.493183:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5707 00000100:00100000:2.0:1772305910.493188:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e53cfa76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+224:97457:x1858396225361856:12345-192.168.203.30@tcp:101:cp.0 00010000:00010000:2.0:1772305910.493197:0:6306:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305910.493207:0:6306:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6f186 lrc: 2/0,0 mode: --/PW res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196edf0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305910.493222:0:6306:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e8ea7e31/0xa5e9c8c58c6f17f lrc: 2/0,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ede9 expref: 225 pid: 6306 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1772305910.493228:0:6306:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1772305910.493229:0:6306:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1772305910.493230:0:6306:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6f186 lrc: 4/0,0 mode: --/PW res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196edf0 expref: 225 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305910.493252:0:6306:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e8ea7e31/0xa5e9c8c58c6f17f lrc: 3/0,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ede9 expref: 225 pid: 6306 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1772305910.493259:0:6306:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e8ea7e31/0xa5e9c8c58c6f17f lrc: 4/0,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ede9 expref: 225 pid: 6306 timeout: 1322 lvb_type: 1 00000100:00100000:2.0:1772305910.493268:0:6306:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000091bd8ecf pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6306:1858396216601536:192.168.203.30@tcp:104: 00000100:00100000:2.0:1772305910.493313:0:6306:0:(client.c:2500:ptlrpc_set_wait()) set 00000000fcabfc50 going to sleep for 6 seconds 00000100:00100000:2.0:1772305910.493996:0:6306:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000091bd8ecf pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6306:1858396216601536:192.168.203.30@tcp:104: 00010000:00010000:2.0:1772305910.494017:0:6306:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6f186 lrc: 3/0,0 mode: --/PW res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196edf0 expref: 225 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305910.494031:0:6306:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010dea6ba, rc 0) 00000100:00100000:2.0:1772305910.494066:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e53cfa76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+225:97457:x1858396225361856:12345-192.168.203.30@tcp:101:cp.0 Request processed in 876us (955us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305910.494081:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5707 00000100:00100000:3.0:1772305910.494164:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305910.495375:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305910.495420:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225362048 00000100:00100000:2.0:1772305910.495452:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 101 00000100:00100000:2.0:1772305910.495457:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000769fc9a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+67:97457:x1858396225362048:12345-192.168.203.30@tcp:35:cp.0 00000100:00100000:2.0:1772305910.495619:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000769fc9a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+68:97457:x1858396225362048:12345-192.168.203.30@tcp:35:cp.0 Request processed in 162us (245us total) trans 8589934850 rc 0/0 00000100:00100000:2.0:1772305910.495647:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 101 00000100:00100000:3.0:1772305910.505926:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305910.505992:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225362112 00000100:00100000:1.0:1772305910.506040:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 828 00000100:00100000:1.0:1772305910.506046:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000209acf4e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+50:97460:x1858396225362112:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:1.0:1772305910.506063:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305910.506080:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6f18d lrc: 2/0,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196edf7 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.506137:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c6f194 lrc: 3/1,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.506153:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c6f194 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.506165:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c6f194 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.506180:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6f19b lrc: 3/1,0 mode: --/PR res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.506207:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6f19b lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.506215:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6f19b lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.506273:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c6f194 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.506278:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c6f194 lrc: 2/0,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.506284:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c6f194 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.506288:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000776565ed already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305910.506290:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c6f194 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.506295:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c6f194 lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.506303:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8c:0x0].0x0 (0000000021d5f76c) 00010000:00010000:1.0:1772305910.506305:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305910.506308:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c6f194 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.506311:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c6f194 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.506328:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6f19b lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.506332:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6f19b lrc: 2/0,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.506335:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6f19b lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.506338:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000004a9f3864 already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305910.506340:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6f19b lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.506343:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6f19b lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.506347:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8c:0x0].0xfa5f3888 (0000000027e5c018) 00010000:00010000:1.0:1772305910.506349:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305910.506350:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6f19b lrc: 2/0,0 mode: --/PR res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.506353:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6f19b lrc: 0/0,0 mode: --/PR res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.506382:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6f18d lrc: 1/0,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196edf7 expref: 51 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.506390:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6f18d lrc: 0/0,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196edf7 expref: 51 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.506412:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d142a9ac, rc 0) 00000100:00100000:1.0:1772305910.506468:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000209acf4e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+50:97460:x1858396225362112:12345-192.168.203.30@tcp:101:bash.0 Request processed in 420us (548us total) trans 0 rc 301/301 00000100:00100000:1.0:1772305910.506477:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 828 00000100:00100000:1.0:1772305910.510495:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305910.511939:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225362240 00000100:00100000:1.0:1772305910.511988:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 830 00000100:00100000:1.0:1772305910.511997:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000d7fa04a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+68:97461:x1858396225362240:12345-192.168.203.30@tcp:101:rm.0 00010000:00010000:1.0:1772305910.512011:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305910.512026:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6f1b7 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ee05 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.512083:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6f1be lrc: 3/1,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.512096:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6f1be lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.512107:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6f1be lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.512123:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6f1c5 lrc: 3/1,0 mode: --/PR res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.512132:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6f1c5 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.512141:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6f1c5 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.512195:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6f1be lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.512205:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6f1be lrc: 2/0,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.512212:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6f1be lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.512220:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000025cc37fd already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305910.512224:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6f1be lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.512231:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6f1be lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.512243:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8c:0x0].0x0 (0000000021d5f76c) 00010000:00010000:1.0:1772305910.512246:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305910.512249:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6f1be lrc: 2/0,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.512257:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6f1be lrc: 0/0,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.512270:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6f1c5 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.512277:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6f1c5 lrc: 2/0,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.512295:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6f1c5 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.512301:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a178fe80 already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305910.512303:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6f1c5 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.512309:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6f1c5 lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.512317:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8c:0x0].0xfa5f3888 (00000000c75acf1a) 00010000:00010000:1.0:1772305910.512320:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305910.512322:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6f1c5 lrc: 2/0,0 mode: --/PR res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.512327:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6f1c5 lrc: 0/0,0 mode: --/PR res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.512349:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6f1b7 lrc: 1/0,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee05 expref: 69 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.512356:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6f1b7 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee05 expref: 69 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.512364:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c609f04e, rc 0) 00000100:00100000:1.0:1772305910.512398:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000d7fa04a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+68:97461:x1858396225362240:12345-192.168.203.30@tcp:101:rm.0 Request processed in 402us (508us total) trans 0 rc 301/301 00000100:00100000:1.0:1772305910.512406:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 830 00000100:00100000:3.0:1772305910.517917:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305910.517962:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225362304 00000100:00100000:1.0:1772305910.517997:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 831 00000100:00100000:1.0:1772305910.518002:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007d0501e6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+68:97462:x1858396225362304:12345-192.168.203.30@tcp:101:cp.0 00010000:00010000:1.0:1772305910.518014:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305910.518026:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6f1cc lrc: 2/0,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ee0c expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.518061:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6f1d3 lrc: 3/1,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.518069:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6f1d3 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.518075:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6f1d3 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.518083:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c6f1da lrc: 3/1,0 mode: --/PR res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.518087:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c6f1da lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.518093:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c6f1da lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.518138:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6f1d3 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.518146:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6f1d3 lrc: 2/0,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.518167:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6f1d3 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.518173:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000004a9f3864 already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305910.518176:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6f1d3 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.518182:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6f1d3 lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.518191:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8c:0x0].0x0 (0000000021d5f76c) 00010000:00010000:1.0:1772305910.518194:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305910.518197:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6f1d3 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.518202:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6f1d3 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.518212:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c6f1da lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.518218:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c6f1da lrc: 2/0,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.518223:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c6f1da lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.518229:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000776565ed already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305910.518230:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c6f1da lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.518242:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c6f1da lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.518250:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8c:0x0].0xfa5f3888 (0000000027e5c018) 00010000:00010000:1.0:1772305910.518253:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305910.518255:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c6f1da lrc: 2/0,0 mode: --/PR res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.518261:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c6f1da lrc: 0/0,0 mode: --/PR res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.518282:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6f1cc lrc: 1/0,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee0c expref: 69 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.518290:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6f1cc lrc: 0/0,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee0c expref: 69 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.518299:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d142a9ac, rc 0) 00000100:00100000:1.0:1772305910.518339:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007d0501e6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+68:97462:x1858396225362304:12345-192.168.203.30@tcp:101:cp.0 Request processed in 335us (427us total) trans 0 rc 301/301 00000100:00100000:1.0:1772305910.518347:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 831 00000100:00100000:2.0:1772305910.519155:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305910.519187:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225362368 00000100:00100000:1.0:1772305910.519211:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 832 00000100:00100000:1.0:1772305910.519214:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000091bd8ecf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+68:97462:x1858396225362368:12345-192.168.203.30@tcp:101:cp.0 00010000:00010000:1.0:1772305910.519221:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305910.519229:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000016b42150/0xa5e9c8c58c6f1e1 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ee13 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.519260:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6f1e8 lrc: 3/1,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.519266:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6f1e8 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.519271:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6f1e8 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.519278:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6f1ef lrc: 3/1,0 mode: --/PR res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.519284:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6f1ef lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.519291:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6f1ef lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.519317:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6f1e8 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.519325:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6f1e8 lrc: 2/0,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.519331:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6f1e8 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.519337:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000295bd7c already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305910.519340:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6f1e8 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.519351:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6f1e8 lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.519357:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8c:0x0].0x0 (0000000021d5f76c) 00010000:00010000:1.0:1772305910.519359:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305910.519361:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6f1e8 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.519365:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6f1e8 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.519370:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6f1ef lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.519374:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6f1ef lrc: 2/0,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.519377:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6f1ef lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.519381:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000048d87789 already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305910.519382:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6f1ef lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.519385:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6f1ef lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.519389:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8c:0x0].0xfa5f3888 (0000000067720f33) 00010000:00010000:1.0:1772305910.519390:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305910.519395:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6f1ef lrc: 2/0,0 mode: --/PR res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.519399:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6f1ef lrc: 0/0,0 mode: --/PR res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.519414:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000016b42150/0xa5e9c8c58c6f1e1 lrc: 1/0,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee13 expref: 69 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.519419:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000016b42150/0xa5e9c8c58c6f1e1 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee13 expref: 69 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.519423:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000016b42150, rc 0) 00000100:00100000:1.0:1772305910.519447:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000091bd8ecf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+68:97462:x1858396225362368:12345-192.168.203.30@tcp:101:cp.0 Request processed in 232us (293us total) trans 0 rc 301/301 00000100:00100000:1.0:1772305910.519452:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 832 00000100:00100000:1.0:1772305910.520528:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225362496 00000100:00100000:1.0:1772305910.520560:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 833 00000100:00100000:1.0:1772305910.520566:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000033506aed pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+68:97462:x1858396225362496:12345-192.168.203.30@tcp:101:cp.0 00010000:00010000:1.0:1772305910.520576:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305910.520585:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6f1f6 lrc: 2/0,0 mode: --/CW res: [0x200000408:0x8c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ee1a expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.520676:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6f1fd lrc: 3/0,1 mode: --/CW res: [0x200000408:0x8c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.520687:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6f1fd lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.520696:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6f1fd lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.520716:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6f204 lrc: 3/0,1 mode: --/PW res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.520725:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6f204 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.520733:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6f204 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1772305910.521173:0:54697:0:(osp_object.c:1645:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x100010000:0x1ae:0x0], index 1: 0 00010000:00010000:1.0:1772305910.521320:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6f20b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x327:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.521331:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6f20b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x327:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.521339:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6f20b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x327:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.521372:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6f1fd lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.521380:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6f1fd lrc: 2/0,0 mode: CW/CW res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.521387:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6f1fd lrc: 3/0,0 mode: CW/CW res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.521393:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000001cde7dd0 already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305910.521401:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6f1fd lrc: 3/0,0 mode: CW/CW res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.521409:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6f1fd lrc: 4/0,0 mode: CW/CW res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.521418:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8c:0x0].0x0 (0000000021d5f76c) 00010000:00010000:1.0:1772305910.521420:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305910.521422:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6f1fd lrc: 2/0,0 mode: --/CW res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.521429:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6f1fd lrc: 0/0,0 mode: --/CW res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1772305910.521439:0:54697:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000033506aed reply state 00000000ce72d7b3 transno 8589934851 ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6f204 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.521461:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6f1f6 lrc: 0/0,0 mode: --/CW res: [0x200000408:0x8c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee1a expref: 71 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.521473:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6f20b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x327:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee1a expref: 70 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.521479:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x327:0x0].0x0 (00000000c10a8182) 00010000:00010000:1.0:1772305910.521481:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1772305910.521498:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000748ac5ea, rc 0) 00000100:00100000:1.0:1772305910.521541:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000033506aed pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+71:97462:x1858396225362496:12345-192.168.203.30@tcp:101:cp.0 Request processed in 973us (1064us total) trans 8589934851 rc 0/0 00000100:00100000:1.0:1772305910.521549:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 833 00010000:00010000:2.0:1772305910.522022:0:2978:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6f204 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305910.522033:0:2978:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6f204 lrc: 2/0,0 mode: PW/PW res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305910.522040:0:2978:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6f204 lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305910.522047:0:2978:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a84c62ba already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305910.522050:0:2978:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6f204 lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305910.522059:0:2978:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6f204 lrc: 4/0,0 mode: PW/PW res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305910.522069:0:2978:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8c:0x0].0xfa5f3888 (0000000045f3282f) 00010000:00010000:2.0:1772305910.522072:0:2978:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305910.522074:0:2978:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6f204 lrc: 2/0,0 mode: --/PW res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305910.522080:0:2978:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6f204 lrc: 0/0,0 mode: --/PW res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305910.522542:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225362560 00000100:00100000:1.0:1772305910.522570:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 834 00000100:00100000:1.0:1772305910.522573:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f086b207 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+70:97462:x1858396225362560:12345-192.168.203.30@tcp:101:cp.0 00010000:00010000:1.0:1772305910.522582:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305910.522590:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6f219 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ee21 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.522612:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6f220 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x327:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.522619:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6f220 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x327:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.522643:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6f220 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x327:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1772305910.522659:0:54697:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1772305910.522666:0:54697:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6f220 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x327:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.522672:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6f220 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x327:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.522683:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6f219 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee21 expref: 72 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.522690:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6f220 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x327:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee21 expref: 71 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.522695:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x327:0x0].0x0 (00000000c10a8182) 00010000:00010000:1.0:1772305910.522702:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1772305910.522703:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a178fe80, rc 0) 00000100:00100000:1.0:1772305910.522727:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f086b207 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+71:97462:x1858396225362560:12345-192.168.203.30@tcp:101:cp.0 Request processed in 153us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305910.522732:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 834 00000100:00100000:3.0:1772305910.523723:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305910.523787:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225362624 00000100:00100000:2.0:1772305910.523825:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5708 00000100:00100000:2.0:1772305910.523831:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000890ea8c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2215:x1858396225362624:12345-192.168.203.30@tcp:101:cp.0 00010000:00010000:2.0:1772305910.523842:0:6306:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305910.523858:0:6306:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e3177f5/0xa5e9c8c58c6f227 lrc: 2/0,0 mode: --/PR res: [0x1ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ee28 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1772305910.523878:0:6306:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x1ae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1772305910.523899:0:6306:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1772305910.523902:0:6306:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1772305910.523913:0:6306:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e3177f5/0xa5e9c8c58c6f227 lrc: 3/0,0 mode: PR/PR res: [0x1ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee28 expref: 228 pid: 6306 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1772305910.523927:0:6306:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004e3177f5/0xa5e9c8c58c6f227 lrc: 3/0,0 mode: PR/PR res: [0x1ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee28 expref: 228 pid: 6306 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1772305910.523944:0:6306:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004e3177f5, rc 0) 00000100:00100000:2.0:1772305910.523977:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000890ea8c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+228:2215:x1858396225362624:12345-192.168.203.30@tcp:101:cp.0 Request processed in 146us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305910.523984:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5708 00000100:00100000:2.0:1772305910.525061:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305910.526094:0:6306:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c42ef24f pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6306:1858396216601664:192.168.203.30@tcp:104: 00010000:00010000:2.0:1772305910.526112:0:6306:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000020fba8b5/0xa5e9c8c58c6f22e lrc: 3/0,0 mode: --/PW res: [0x1ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee2f expref: 229 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305910.526122:0:6306:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000020fba8b5, rc 0) 00000100:00100000:2.0:1772305910.526152:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000774a31b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+229:97462:x1858396225362688:12345-192.168.203.30@tcp:101:cp.0 Request processed in 1001us (1093us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305910.526157:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5709 00000100:00100000:3.0:1772305910.526240:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305910.527696:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305910.527743:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225362880 00000100:00100000:2.0:1772305910.527778:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 102 00000100:00100000:2.0:1772305910.527784:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000054388a3a pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+71:97462:x1858396225362880:12345-192.168.203.30@tcp:35:cp.0 00000100:00100000:2.0:1772305910.527970:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000054388a3a pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+72:97462:x1858396225362880:12345-192.168.203.30@tcp:35:cp.0 Request processed in 187us (277us total) trans 8589934852 rc 0/0 00000100:00100000:2.0:1772305910.527976:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 102 00000100:00100000:3.0:1772305910.538781:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305910.538848:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225362944 00000100:00100000:1.0:1772305910.538894:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 835 00000100:00100000:1.0:1772305910.538899:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005ad28dc1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+50:97287:x1858396225362944:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:1.0:1772305910.538917:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305910.538935:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6f235 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ee36 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.538981:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6f23c lrc: 3/1,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.538992:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6f23c lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.539000:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6f23c lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.539009:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6f243 lrc: 3/1,0 mode: --/PR res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.539014:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6f243 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.539018:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6f243 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.539079:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6f23c lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.539085:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6f23c lrc: 2/0,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.539089:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6f23c lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.539093:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006a4f0137 already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305910.539095:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6f23c lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.539099:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6f23c lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.539108:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8c:0x0].0x0 (0000000021d5f76c) 00010000:00010000:1.0:1772305910.539111:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305910.539115:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6f23c lrc: 2/0,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.539121:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6f23c lrc: 0/0,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.539133:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6f243 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.539140:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6f243 lrc: 2/0,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.539158:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6f243 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.539164:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000001cde7dd0 already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305910.539167:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6f243 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.539173:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6f243 lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.539181:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8c:0x0].0xf629a772 (00000000a61c25fb) 00010000:00010000:1.0:1772305910.539183:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305910.539186:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6f243 lrc: 2/0,0 mode: --/PR res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.539191:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6f243 lrc: 0/0,0 mode: --/PR res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.539221:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6f235 lrc: 1/0,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee36 expref: 51 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.539229:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6f235 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee36 expref: 51 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.539238:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c609f04e, rc 0) 00000100:00100000:1.0:1772305910.539291:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005ad28dc1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+50:97287:x1858396225362944:12345-192.168.203.30@tcp:101:bash.0 Request processed in 389us (515us total) trans 0 rc 301/301 00000100:00100000:1.0:1772305910.539299:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 835 00000100:00100000:1.0:1772305910.542880:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305910.544598:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225363072 00000100:00100000:1.0:1772305910.544662:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 837 00000100:00100000:1.0:1772305910.544667:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000098196c2d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+72:97465:x1858396225363072:12345-192.168.203.30@tcp:101:rm.0 00010000:00010000:1.0:1772305910.544675:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305910.544682:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6f25f lrc: 2/0,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ee44 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.544704:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6f266 lrc: 3/1,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.544711:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6f266 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.544717:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6f266 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.544723:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6f26d lrc: 3/1,0 mode: --/PR res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.544728:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6f26d lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.544732:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6f26d lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.544751:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6f266 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.544755:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6f266 lrc: 2/0,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.544765:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6f266 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.544769:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000001cde7dd0 already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305910.544770:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6f266 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.544774:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6f266 lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.544780:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8c:0x0].0x0 (0000000021d5f76c) 00010000:00010000:1.0:1772305910.544782:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305910.544783:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6f266 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.544787:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6f266 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.544793:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6f26d lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.544796:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6f26d lrc: 2/0,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.544799:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6f26d lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.544803:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006a4f0137 already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305910.544804:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6f26d lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.544812:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6f26d lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.544817:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8c:0x0].0xf629a772 (00000000a61c25fb) 00010000:00010000:1.0:1772305910.544818:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305910.544819:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6f26d lrc: 2/0,0 mode: --/PR res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.544822:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6f26d lrc: 0/0,0 mode: --/PR res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.544836:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6f25f lrc: 1/0,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee44 expref: 73 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.544841:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6f25f lrc: 0/0,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee44 expref: 73 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.544845:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c609f04e, rc 0) 00000100:00100000:1.0:1772305910.544871:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000098196c2d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+72:97465:x1858396225363072:12345-192.168.203.30@tcp:101:rm.0 Request processed in 204us (312us total) trans 0 rc 301/301 00000100:00100000:1.0:1772305910.544876:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 837 00000100:00100000:3.0:1772305910.550517:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305910.550568:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225363136 00000100:00100000:1.0:1772305910.550614:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 838 00000100:00100000:1.0:1772305910.550622:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000226f5fc2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+72:97466:x1858396225363136:12345-192.168.203.30@tcp:101:cp.0 00010000:00010000:1.0:1772305910.550666:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305910.550682:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000016b42150/0xa5e9c8c58c6f274 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ee4b expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.550741:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6f27b lrc: 3/1,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.550750:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6f27b lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.550758:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6f27b lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.550767:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6f282 lrc: 3/1,0 mode: --/PR res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.550772:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6f282 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.550776:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6f282 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.550816:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6f27b lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.550820:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6f27b lrc: 2/0,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.550825:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6f27b lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.550829:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000048d87789 already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305910.550831:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6f27b lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.550847:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6f27b lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.550855:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8c:0x0].0x0 (0000000021d5f76c) 00010000:00010000:1.0:1772305910.550857:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305910.550860:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6f27b lrc: 2/0,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.550864:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6f27b lrc: 0/0,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.550870:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6f282 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.550874:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6f282 lrc: 2/0,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.550877:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6f282 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.550881:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000295bd7c already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305910.550882:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6f282 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.550885:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6f282 lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.550889:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8c:0x0].0xf629a772 (0000000060b58ddc) 00010000:00010000:1.0:1772305910.550890:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305910.550897:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6f282 lrc: 2/0,0 mode: --/PR res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.550901:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6f282 lrc: 0/0,0 mode: --/PR res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.550922:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000016b42150/0xa5e9c8c58c6f274 lrc: 1/0,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee4b expref: 73 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.550927:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000016b42150/0xa5e9c8c58c6f274 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee4b expref: 73 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.550932:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000016b42150, rc 0) 00000100:00100000:1.0:1772305910.550970:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000226f5fc2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+72:97466:x1858396225363136:12345-192.168.203.30@tcp:101:cp.0 Request processed in 349us (459us total) trans 0 rc 301/301 00000100:00100000:1.0:1772305910.550976:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 838 00000100:00100000:2.0:1772305910.551953:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305910.551999:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225363200 00000100:00100000:1.0:1772305910.552040:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 839 00000100:00100000:1.0:1772305910.552045:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bbac71e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+72:97466:x1858396225363200:12345-192.168.203.30@tcp:101:cp.0 00010000:00010000:1.0:1772305910.552053:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305910.552061:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6f289 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ee52 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.552091:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c6f290 lrc: 3/1,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.552098:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c6f290 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.552104:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c6f290 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.552119:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6f297 lrc: 3/1,0 mode: --/PR res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.552124:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6f297 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.552128:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6f297 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.552150:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c6f290 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.552154:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c6f290 lrc: 2/0,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.552168:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c6f290 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.552174:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000776565ed already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305910.552176:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c6f290 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.552183:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c6f290 lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.552191:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8c:0x0].0x0 (0000000021d5f76c) 00010000:00010000:1.0:1772305910.552194:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305910.552197:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c6f290 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.552216:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c6f290 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.552227:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6f297 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.552233:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6f297 lrc: 2/0,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.552238:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6f297 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.552243:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000004a9f3864 already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305910.552246:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6f297 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.552251:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6f297 lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.552259:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8c:0x0].0xf629a772 (000000004dada68c) 00010000:00010000:1.0:1772305910.552261:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305910.552263:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6f297 lrc: 2/0,0 mode: --/PR res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.552268:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6f297 lrc: 0/0,0 mode: --/PR res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.552290:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6f289 lrc: 1/0,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee52 expref: 73 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.552308:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6f289 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee52 expref: 73 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.552317:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d142a9ac, rc 0) 00000100:00100000:1.0:1772305910.552350:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bbac71e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+72:97466:x1858396225363200:12345-192.168.203.30@tcp:101:cp.0 Request processed in 304us (399us total) trans 0 rc 301/301 00000100:00100000:1.0:1772305910.552358:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 839 00000100:00100000:1.0:1772305910.553523:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225363328 00000100:00100000:1.0:1772305910.553549:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 840 00000100:00100000:1.0:1772305910.553554:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000016a92645 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+72:97466:x1858396225363328:12345-192.168.203.30@tcp:101:cp.0 00010000:00010000:1.0:1772305910.553562:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305910.553571:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6f29e lrc: 2/0,0 mode: --/CW res: [0x200000408:0x8c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ee59 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.553643:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6f2a5 lrc: 3/0,1 mode: --/CW res: [0x200000408:0x8c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.553652:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6f2a5 lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.553662:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6f2a5 lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.553674:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6f2ac lrc: 3/0,1 mode: --/PW res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.553682:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6f2ac lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.553697:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6f2ac lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1772305910.553998:0:54697:0:(osp_object.c:1645:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x100000000:0x1ae:0x0], index 0: 0 00010000:00010000:1.0:1772305910.554148:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6f2b3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x328:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.554157:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6f2b3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x328:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.554164:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6f2b3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x328:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.554191:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6f2a5 lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.554198:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6f2a5 lrc: 2/0,0 mode: CW/CW res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.554204:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6f2a5 lrc: 3/0,0 mode: CW/CW res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.554209:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006a4f0137 already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305910.554211:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6f2a5 lrc: 3/0,0 mode: CW/CW res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.554217:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6f2a5 lrc: 4/0,0 mode: CW/CW res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.554236:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8c:0x0].0x0 (0000000021d5f76c) 00010000:00010000:1.0:1772305910.554239:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305910.554241:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6f2a5 lrc: 2/0,0 mode: --/CW res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.554247:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6f2a5 lrc: 0/0,0 mode: --/CW res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1772305910.554256:0:54697:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000016a92645 reply state 00000000535277a6 transno 8589934853 ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6f2ac lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.554276:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6f29e lrc: 0/0,0 mode: --/CW res: [0x200000408:0x8c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee59 expref: 75 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.554288:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6f2b3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x328:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee59 expref: 74 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.554294:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x328:0x0].0x0 (0000000045f3282f) 00010000:00010000:1.0:1772305910.554297:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1772305910.554299:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000025cc37fd, rc 0) 00000100:00100000:1.0:1772305910.554339:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000016a92645 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+75:97466:x1858396225363328:12345-192.168.203.30@tcp:101:cp.0 Request processed in 783us (875us total) trans 8589934853 rc 0/0 00000100:00100000:1.0:1772305910.554346:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 840 00010000:00010000:2.0:1772305910.554992:0:2977:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6f2ac lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305910.555002:0:2977:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6f2ac lrc: 2/0,0 mode: PW/PW res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305910.555009:0:2977:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6f2ac lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305910.555016:0:2977:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000001cde7dd0 already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305910.555019:0:2977:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6f2ac lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305910.555025:0:2977:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6f2ac lrc: 4/0,0 mode: PW/PW res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305910.555035:0:2977:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8c:0x0].0xf629a772 (00000000a61c25fb) 00010000:00010000:2.0:1772305910.555038:0:2977:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305910.555041:0:2977:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6f2ac lrc: 2/0,0 mode: --/PW res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305910.555047:0:2977:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c6f2ac lrc: 0/0,0 mode: --/PW res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305910.555688:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225363392 00000100:00100000:1.0:1772305910.555720:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 841 00000100:00100000:1.0:1772305910.555732:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c42ef24f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+74:97466:x1858396225363392:12345-192.168.203.30@tcp:101:cp.0 00010000:00010000:1.0:1772305910.555748:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305910.555765:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000017162762/0xa5e9c8c58c6f2c1 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ee60 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.555800:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6f2c8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x328:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.555809:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6f2c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x328:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.555816:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6f2c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x328:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1772305910.555837:0:54697:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1772305910.555847:0:54697:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6f2c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x328:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.555856:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6f2c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x328:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.555872:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000017162762/0xa5e9c8c58c6f2c1 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee60 expref: 76 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.555885:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6f2c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x328:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee60 expref: 75 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305910.555890:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x328:0x0].0x0 (0000000045f3282f) 00010000:00010000:1.0:1772305910.555891:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1772305910.555893:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a84c62ba, rc 0) 00000100:00100000:1.0:1772305910.555924:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c42ef24f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+75:97466:x1858396225363392:12345-192.168.203.30@tcp:101:cp.0 Request processed in 198us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305910.555929:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 841 00000100:00100000:3.0:1772305910.556836:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305910.556880:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225363456 00000100:00100000:2.0:1772305910.556910:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5710 00000100:00100000:2.0:1772305910.556914:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001f9afe5d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+224:2217:x1858396225363456:12345-192.168.203.30@tcp:101:cp.0 00010000:00010000:2.0:1772305910.556922:0:6306:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305910.556934:0:6306:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c937f2b9/0xa5e9c8c58c6f2cf lrc: 2/0,0 mode: --/PR res: [0x1ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ee67 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1772305910.556951:0:6306:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x1ae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1772305910.556962:0:6306:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1772305910.556964:0:6306:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1772305910.556968:0:6306:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c937f2b9/0xa5e9c8c58c6f2cf lrc: 3/0,0 mode: PR/PR res: [0x1ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee67 expref: 225 pid: 6306 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1772305910.556978:0:6306:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c937f2b9/0xa5e9c8c58c6f2cf lrc: 3/0,0 mode: PR/PR res: [0x1ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee67 expref: 225 pid: 6306 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1772305910.556985:0:6306:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c937f2b9, rc 0) 00000100:00100000:2.0:1772305910.557009:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001f9afe5d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+225:2217:x1858396225363456:12345-192.168.203.30@tcp:101:cp.0 Request processed in 94us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305910.557014:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5710 00000100:00100000:2.0:1772305910.558134:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305910.559307:0:6306:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f8a1bcf1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6306:1858396216601792:192.168.203.30@tcp:104: 00010000:00010000:2.0:1772305910.559327:0:6306:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005a75225a/0xa5e9c8c58c6f2d6 lrc: 3/0,0 mode: --/PW res: [0x1ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee6e expref: 226 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305910.559338:0:6306:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005a75225a, rc 0) 00000100:00100000:1.0:1772305910.559353:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305910.559369:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006755215f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+226:97466:x1858396225363520:12345-192.168.203.30@tcp:101:cp.0 Request processed in 1137us (1236us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305910.559376:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5711 00000100:00100000:1.0:1772305910.560827:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305910.560883:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225363712 00000100:00100000:2.0:1772305910.560920:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 103 00000100:00100000:2.0:1772305910.560927:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e47bd691 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+75:97466:x1858396225363712:12345-192.168.203.30@tcp:35:cp.0 00000100:00100000:2.0:1772305910.561182:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e47bd691 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+76:97466:x1858396225363712:12345-192.168.203.30@tcp:35:cp.0 Request processed in 255us (355us total) trans 8589934854 rc 0/0 00000100:00100000:2.0:1772305910.561188:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 103 00000001:00080000:2.0:1772305910.747062:0:54724:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934849 is committed 00000001:00080000:2.0:1772305910.747075:0:54724:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934853 is committed 00000001:00080000:2.0:1772305910.747088:0:54724:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934854 is committed 00000100:00100000:3.0:1772305911.241780:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f8a1bcf1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216601984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1772305911.241780:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006b96b036 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216601920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1772305911.241854:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305911.241887:0:7591:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216601920 00000100:00100000:3.0:1772305911.241933:0:7591:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216601984 00000100:00100000:2.0:1772305911.241945:0:6310:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 451 00000100:00100000:2.0:1772305911.241953:0:6310:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007d9dabf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216601920:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1772305911.241966:0:7591:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 452 00000100:00100000:3.0:1772305911.241971:0:7591:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000084abacb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216601984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1772305911.241988:0:6310:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 693829632 pending 0 free 3606052864 avail 3603955712 00002000:00000024:3.0:1772305911.241993:0:7591:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 740884480 pending 0 free 3829399552 avail 3827302400 00000100:00100000:2.0:1772305911.242042:0:6310:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007d9dabf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216601920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305911.242049:0:7591:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000084abacb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216601984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305911.242055:0:6310:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 451 00000100:00100000:3.0:1772305911.242062:0:7591:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 452 00000100:00100000:3.0:1772305911.242106:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f8a1bcf1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216601984:0@lo:13:osp-pre-0-0.0 00000040:00100000:3.0:1772305911.242136:0:54721:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 10 in log [0xd:0x1:0x0] 00000020:00000080:1.0:1772305911.459441:0:69443:0:(class_obd.c:302:class_handle_ioctl()) cmd = c008667f 00000020:00000080:1.0:1772305911.459450:0:69443:0:(class_obd.c:126:class_resolve_dev_name()) device name lustre-MDT0000 00000020:00000080:1.0:1772305911.459455:0:69443:0:(class_obd.c:133:class_resolve_dev_name()) device name lustre-MDT0000, dev 5 00000020:00000080:1.0:1772305911.459491:0:69443:0:(class_obd.c:302:class_handle_ioctl()) cmd = 424066b1 00000004:00000080:1.0:1772305911.459499:0:69443:0:(mdt_handler.c:7411:mdt_iocontrol()) handling ioctl cmd 0x424066b1 00000040:00080000:1.0:1772305911.459738:0:69443:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x11:0x0].12, 80 off9152 00000004:00000080:1.0:1772305911.459759:0:69443:0:(mdd_device.c:1821:mdd_changelog_user_register()) lustre-MDD0000: registered changelog user 'cl12', mask 0x0 00000004:02000000:1.0:1772305911.459762:0:69443:0:(mdd_device.c:460:mdd_changelog_on()) lustre-MDD0000: changelog on 00000100:00100000:3.0:1772305911.485431:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00010000:0.0:1772305911.485706:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000878a11a2/0xa5e9c8c58c6f2e4 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305911.485729:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000878a11a2/0xa5e9c8c58c6f2e4 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305911.485741:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000073b42f2f/0xa5e9c8c58c6f2eb lrc: 3/1,0 mode: --/PR res: [0x200000408:0x8c:0x0].0x5e0cd9fa bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305911.485746:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000073b42f2f/0xa5e9c8c58c6f2eb lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305911.485751:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000073b42f2f/0xa5e9c8c58c6f2eb lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305911.485845:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000007c4795ba/0xa5e9c8c58c6f2f2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x326:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305911.485851:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007c4795ba/0xa5e9c8c58c6f2f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x326:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305911.485856:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007c4795ba/0xa5e9c8c58c6f2f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x326:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305911.485881:0:54697:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x326:0x0]: returning size 1516 00000004:00200000:0.0:1772305911.485884:0:54697:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1772305911.485897:0:54697:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 000000007c4795ba/0xa5e9c8c58c6f2f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x326:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305911.485905:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007c4795ba/0xa5e9c8c58c6f2f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x326:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305911.485911:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000878a11a2/0xa5e9c8c58c6f2e4 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305911.485923:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000878a11a2/0xa5e9c8c58c6f2e4 lrc: 2/0,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305911.485929:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000878a11a2/0xa5e9c8c58c6f2e4 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305911.485933:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000878a11a2 already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305911.485936:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000878a11a2/0xa5e9c8c58c6f2e4 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305911.485941:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000878a11a2/0xa5e9c8c58c6f2e4 lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305911.485950:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8c:0x0].0x0 (0000000021d5f76c) 00010000:00010000:0.0:1772305911.485953:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305911.485956:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000878a11a2/0xa5e9c8c58c6f2e4 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305911.485960:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000878a11a2/0xa5e9c8c58c6f2e4 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305911.485968:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000073b42f2f/0xa5e9c8c58c6f2eb lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305911.485972:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000073b42f2f/0xa5e9c8c58c6f2eb lrc: 2/0,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305911.485975:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000073b42f2f/0xa5e9c8c58c6f2eb lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305911.485997:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000073b42f2f already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305911.486000:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000073b42f2f/0xa5e9c8c58c6f2eb lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305911.486007:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000073b42f2f/0xa5e9c8c58c6f2eb lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305911.486026:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8c:0x0].0x5e0cd9fa (00000000955bccbc) 00010000:00010000:0.0:1772305911.486029:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305911.486032:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000073b42f2f/0xa5e9c8c58c6f2eb lrc: 2/0,0 mode: --/PR res: [0x200000408:0x8c:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305911.486039:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000073b42f2f/0xa5e9c8c58c6f2eb lrc: 0/0,0 mode: --/PR res: [0x200000408:0x8c:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305911.486071:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c90074c9/0xa5e9c8c58c6f2dd lrc: 0/0,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee75 expref: 51 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305911.486083:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000007c4795ba/0xa5e9c8c58c6f2f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x326:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee75 expref: 50 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305911.486088:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x326:0x0].0x0 (00000000e29893a3) 00010000:00010000:0.0:1772305911.486090:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1772305911.486091:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007c4795ba, rc 0) 00000100:00100000:0.0:1772305911.486138:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000becfd887 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+50:97503:x1858396225363776:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 561us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305911.486146:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 842 00000100:00100000:2.0:1772305911.487661:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305911.487701:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225363840 00000100:00100000:0.0:1772305911.487742:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5712 00000100:00100000:0.0:1772305911.487747:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e5233900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+161:2216:x1858396225363840:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1772305911.487756:0:6306:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305911.487768:0:6306:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027bbef42/0xa5e9c8c58c6f2f9 lrc: 2/0,0 mode: --/PR res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ee7c expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305911.487815:0:6306:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000004473942 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6306:1858396216602048:192.168.203.30@tcp:106: 00000100:00100000:0.0:1772305911.487874:0:6306:0:(client.c:2500:ptlrpc_set_wait()) set 00000000e6086982 going to sleep for 6 seconds 00002000:00010000:2.0:1772305911.488673:0:6306:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x1ad:0x0:0x0] updating lvb size: 0 -> 1516 00002000:00010000:2.0:1772305911.488677:0:6306:0:(ofd_lvb.c:284:ofd_lvbo_update()) res: [0x1ad:0x0:0x0] updating lvb mtime: 0 -> 1772305910 00002000:00010000:2.0:1772305911.488678:0:6306:0:(ofd_lvb.c:290:ofd_lvbo_update()) res: [0x1ad:0x0:0x0] updating lvb atime: 0 -> 1772305910 00002000:00010000:2.0:1772305911.488679:0:6306:0:(ofd_lvb.c:296:ofd_lvbo_update()) res: [0x1ad:0x0:0x0] updating lvb ctime: 0 -> 1772305910 00000100:00100000:2.0:1772305911.488695:0:6306:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000004473942 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6306:1858396216602048:192.168.203.30@tcp:106: 00010000:00010000:2.0:1772305911.488714:0:6306:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027bbef42/0xa5e9c8c58c6f2f9 lrc: 1/0,0 mode: --/PR res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee7c expref: 162 pid: 6306 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1772305911.488724:0:6306:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027bbef42/0xa5e9c8c58c6f2f9 lrc: 0/0,0 mode: --/PR res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee7c expref: 162 pid: 6306 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1772305911.488734:0:6306:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027bbef42, rc 0) 00000100:00100000:2.0:1772305911.488767:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e5233900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+161:2216:x1858396225363840:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 1019us (1108us total) trans 0 rc 301/301 00000100:00100000:2.0:1772305911.488780:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5712 00000100:00100000:3.0:1772305911.489871:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305911.489909:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225363904 00000100:00100000:0.0:1772305911.489940:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 843 00000100:00100000:0.0:1772305911.489946:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cb7be42b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+50:97503:x1858396225363904:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1772305911.489954:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305911.489964:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000003bb10b1c/0xa5e9c8c58c6f300 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ee83 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305911.490006:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f307 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305911.490020:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f307 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305911.490031:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f307 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305911.490082:0:54697:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:0.0:1772305911.490085:0:54697:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 107 stripe count 1 MDT count 1 00000004:00010000:0.0:1772305911.490101:0:54697:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f307 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305911.490128:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000003bb10b1c/0xa5e9c8c58c6f300 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee83 expref: 52 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305911.490141:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f307 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee83 expref: 51 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305911.490147:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:0.0:1772305911.490149:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1772305911.490151:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000f7a426e, rc 0) 00000100:00100000:0.0:1772305911.490183:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cb7be42b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+51:97503:x1858396225363904:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 236us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305911.490189:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 843 00000100:00100000:3.0:1772305911.491233:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305911.491277:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225363968 00000100:00100000:0.0:1772305911.491306:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 844 00000100:00100000:0.0:1772305911.491312:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006ade2649 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+51:97503:x1858396225363968:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1772305911.491320:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305911.491328:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f30e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ee8a expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305911.491357:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6f315 lrc: 3/1,0 mode: --/PR res: [0x200000408:0x8c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305911.491364:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6f315 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305911.491370:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6f315 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305911.491410:0:54697:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000408:0x8c:0x0]: returning size 11776 00000004:00200000:0.0:1772305911.491412:0:54697:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1772305911.491423:0:54697:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6f315 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305911.491436:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f30e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee8a expref: 53 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305911.491445:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6f315 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee8a expref: 52 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305911.491449:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8c:0x0].0x0 (0000000021d5f76c) 00010000:00010000:0.0:1772305911.491451:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1772305911.491454:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000034fec1fd, rc 0) 00000100:00100000:0.0:1772305911.491496:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006ade2649 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+52:97503:x1858396225363968:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 183us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305911.491503:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 844 00000100:00100000:2.0:1772305911.492582:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305911.492607:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225364032 00000100:00100000:3.0:1772305911.492659:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5713 00000100:00100000:3.0:1772305911.492666:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000032bc5322 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+161:2215:x1858396225364032:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1772305911.492676:0:6306:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305911.492689:0:6306:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d02430e8/0xa5e9c8c58c6f31c lrc: 2/0,0 mode: --/PR res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ee91 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305911.492727:0:6306:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000075ede1e3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6306:1858396216602112:192.168.203.30@tcp:106: 00000100:00100000:3.0:1772305911.492766:0:6306:0:(client.c:2500:ptlrpc_set_wait()) set 0000000041fdb5c3 going to sleep for 6 seconds 00000100:00100000:2.0:1772305911.493533:0:6306:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000075ede1e3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6306:1858396216602112:192.168.203.30@tcp:106: 00010000:00010000:2.0:1772305911.493553:0:6306:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d02430e8/0xa5e9c8c58c6f31c lrc: 1/0,0 mode: --/PR res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee91 expref: 162 pid: 6306 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1772305911.493566:0:6306:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d02430e8/0xa5e9c8c58c6f31c lrc: 0/0,0 mode: --/PR res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee91 expref: 162 pid: 6306 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1772305911.493579:0:6306:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d02430e8, rc 0) 00000100:00100000:2.0:1772305911.493615:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000032bc5322 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+161:2215:x1858396225364032:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 948us (1032us total) trans 0 rc 301/301 00000100:00100000:2.0:1772305911.493623:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5713 00000100:00100000:2.0:1772305911.495324:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305911.495376:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225364160 00000100:00100000:1.0:1772305911.495418:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 845 00000100:00100000:1.0:1772305911.495425:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6e261 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+52:97503:x1858396225364160:12345-192.168.203.30@tcp:58:lfs.0 00000040:00080000:1.0:1772305911.495853:0:54697:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xf:0x0].37, 136 off13224 00000100:00100000:1.0:1772305911.495911:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6e261 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+52:97503:x1858396225364160:12345-192.168.203.30@tcp:58:lfs.0 Request processed in 485us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305911.495920:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 845 00010000:00010000:3.0:1772305911.496709:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772305911.752770:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000004473942 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:70aae467-c860-409f-ba1b-742f4d042da6:2991:1858396216602176:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1772305911.752779:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000ad6883e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:2992:1858396216602240:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1772305911.752813:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000339dc28b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:2993:1858396216602304:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1772305911.752855:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305911.752855:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772305911.752871:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000597692b4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:2994:1858396216602368:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1772305911.752907:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305911.752935:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216602240 00000100:00100000:2.0:1772305911.752948:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216602176 00000100:00100000:0.0:1772305911.752970:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216602368 00000100:00100000:2.0:1772305911.752986:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1772305911.752986:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1772305911.752993:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ce5f32e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2991:x1858396216602176:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1772305911.752998:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002c77b239 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:2992:x1858396216602240:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1772305911.753018:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1772305911.753025:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fe03945a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:2994:x1858396216602368:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1772305911.753045:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ce5f32e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2991:x1858396216602176:12345-0@lo:400:kworker/u8:0.0 Request processed in 52us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305911.753052:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1772305911.753060:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002c77b239 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:2992:x1858396216602240:12345-0@lo:400:kworker/u8:0.0 Request processed in 64us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305911.753070:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1772305911.753086:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fe03945a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:2994:x1858396216602368:12345-0@lo:400:kworker/u8:0.0 Request processed in 59us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305911.753094:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772305911.753109:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1772305911.753119:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216602304 00000100:00100000:2.0:1772305911.753151:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000ad6883e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:2992:1858396216602240:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1772305911.753157:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1772305911.753160:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000597692b4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:2994:1858396216602368:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1772305911.753168:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ea7c71cc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:2993:x1858396216602304:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1772305911.753188:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000004473942 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:70aae467-c860-409f-ba1b-742f4d042da6:2991:1858396216602176:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1772305911.753217:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ea7c71cc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:2993:x1858396216602304:12345-0@lo:400:kworker/u8:0.0 Request processed in 49us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305911.753225:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1772305911.753229:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000339dc28b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:2993:1858396216602304:0@lo:400:kworker/u8:0.0 00000040:00080000:3.0:1772305911.781228:0:69493:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305911.781235:0:69493:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305911.781315:0:69493:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 38 count 13 00000040:00080000:3.0:1772305911.781319:0:69493:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:0.0:1772305911.880813:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772305911.880818:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772305911.880852:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 38 count 13 00000040:00080000:0.0:1772305911.880860:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:0.0:1772305911.881069:0:54732:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x13:0x0].58, 136 off17680 00000100:00100000:0.0:1772305911.881135:0:54732:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000597692b4 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:54732:1858396216602432:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1772305911.881201:0:54732:0:(client.c:2500:ptlrpc_set_wait()) set 000000008e0c1554 going to sleep for 6 seconds 00000100:00100000:0.0:1772305911.882397:0:54732:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000597692b4 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:54732:1858396216602432:192.168.203.30@tcp:107:hsm_cdtr.0 00000040:00080000:0.0:1772305911.882508:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772305911.882511:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772305911.882597:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 38 count 13 00000040:00080000:0.0:1772305911.882607:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:3.0:1772305911.882855:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305911.882949:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225364224 00000100:00100000:1.0:1772305911.882995:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 846 00000100:00100000:1.0:1772305911.883001:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000082992e06 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+68:97514:x1858396225364224:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1772305911.883029:0:54696:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x326:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1772305911.883085:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000082992e06 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+68:97514:x1858396225364224:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 84us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305911.883101:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 846 00000100:00100000:2.0:1772305911.884302:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305911.884351:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225364352 00000100:00100000:1.0:1772305911.884377:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 847 00000100:00100000:1.0:1772305911.884381:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001c01c9b0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+68:97514:x1858396225364352:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1772305911.884390:0:54696:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305911.884405:0:54696:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000017162762/0xa5e9c8c58c6f323 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ee98 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305911.884456:0:54696:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6f32a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305911.884471:0:54696:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6f32a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305911.884496:0:54696:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6f32a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305911.884512:0:54696:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6f331 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c347574 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305911.884526:0:54696:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6f331 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c347574 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305911.884534:0:54696:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6f331 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c347574 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305911.884574:0:54696:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6f338 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x326:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305911.884581:0:54696:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6f338 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x326:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305911.884585:0:54696:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6f338 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x326:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1772305911.884591:0:54696:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x326:0x0]: returning size 1516 00010000:00010000:1.0:1772305911.884693:0:54696:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6f32a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305911.884699:0:54696:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6f32a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305911.884704:0:54696:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6f32a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305911.884708:0:54696:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c609f04e already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305911.884710:0:54696:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6f32a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305911.884715:0:54696:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6f32a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305911.884723:0:54696:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (00000000c78481f6) 00010000:00010000:1.0:1772305911.884726:0:54696:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305911.884729:0:54696:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6f32a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305911.884733:0:54696:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6f32a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305911.884740:0:54696:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6f331 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c347574 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305911.884744:0:54696:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6f331 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c347574 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305911.884747:0:54696:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6f331 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c347574 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305911.884751:0:54696:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006a4f0137 already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305911.884752:0:54696:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6f331 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c347574 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305911.884755:0:54696:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6f331 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c347574 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305911.884759:0:54696:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c347574 (0000000027e5c018) 00010000:00010000:1.0:1772305911.884760:0:54696:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305911.884761:0:54696:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6f331 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c347574 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305911.884768:0:54696:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6f331 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c347574 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305911.884789:0:54696:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000017162762/0xa5e9c8c58c6f323 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee98 expref: 71 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305911.884796:0:54696:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6f338 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x326:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee98 expref: 70 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305911.884800:0:54696:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x326:0x0].0x0 (00000000e29893a3) 00010000:00010000:1.0:1772305911.884802:0:54696:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1772305911.884803:0:54696:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d142a9ac, rc 0) 00000100:00100000:1.0:1772305911.884831:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001c01c9b0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+70:97514:x1858396225364352:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 450us (533us total) trans 8589934855 rc 0/0 00000100:00100000:1.0:1772305911.884836:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 847 00000100:00100000:3.0:1772305911.886110:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305911.886143:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305911.886172:0:6323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225364416 00000100:00100000:0.0:1772305911.886225:0:6323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1046 00000100:00100000:2.0:1772305911.886228:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225364480 00000100:00100000:0.0:1772305911.886235:0:6323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000695a247a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+70:2215:x1858396225364416:12345-192.168.203.30@tcp:103:ldlm_bl_07.0 00010000:00010000:0.0:1772305911.886249:0:6323:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1772305911.886266:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5714 00010000:00010000:0.0:1772305911.886269:0:6323:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c6f338 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x326:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee98 expref: 70 pid: 54696 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305911.886275:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006e7b3ee8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+225:2216:x1858396225364480:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1772305911.886296:0:6323:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x326:0x0].0x0 (00000000e29893a3) 00010000:00010000:2.0:1772305911.886302:0:6306:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6f346 lrc: 3/1,0 mode: --/PR res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305911.886303:0:6323:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1772305911.886316:0:6306:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6f186 lrc: 2/0,0 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196edf0 expref: 225 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305911.886323:0:6306:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1772305911.886325:0:6306:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1772305911.886326:0:6306:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6f346 lrc: 4/1,0 mode: --/PR res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305911.886349:0:6323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000695a247a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:2215:x1858396225364416:12345-192.168.203.30@tcp:103:ldlm_bl_07.0 Request processed in 114us (238us total) trans 0 rc 0/0 00010000:00010000:2.0:1772305911.886350:0:6306:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6f186 lrc: 3/0,0 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196edf0 expref: 225 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305911.886360:0:6306:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6f186 lrc: 4/0,0 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196edf0 expref: 225 pid: 6306 timeout: 1323 lvb_type: 0 00000100:00100000:2.0:1772305911.886377:0:6306:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bfe1381b pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6306:1858396216602496:192.168.203.30@tcp:104: 00000100:00100000:0.0:1772305911.886389:0:6323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1046 00000100:00100000:2.0:1772305911.886418:0:6306:0:(client.c:2500:ptlrpc_set_wait()) set 000000004675ada8 going to sleep for 6 seconds 00000100:00100000:2.0:1772305911.887172:0:6306:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bfe1381b pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6306:1858396216602496:192.168.203.30@tcp:104: 00010000:00010000:2.0:1772305911.887187:0:6306:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6f346 lrc: 3/1,0 mode: --/PR res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305911.887496:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305911.887533:0:21399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225364544 00002000:00100000:0.0:1772305911.887553:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ad:0x0] (0->1515) req@00000000a794f851 x1858396225364544/t0(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:42/0 lens 2008/0 e 0 to 0 dl 1772305917 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cp.0' 00002000:00100000:0.0:1772305911.887561:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 00000000a794f851 with x1858396225364544 ext(0->1515) 00010000:00010000:0.0:1772305911.887567:0:21399:0:(ldlm_lockd.c:601:ldlm_refresh_waiting_lock()) ### refreshed to 56s ns: filter-lustre-OST0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6f186 lrc: 4/0,0 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196edf0 expref: 226 pid: 6306 timeout: 1323 lvb_type: 0 00002000:00010000:0.0:1772305911.887573:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req 00000000a794f851 00000100:00100000:0.0:1772305911.887589:0:21399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 66 00000100:00100000:0.0:1772305911.887592:0:21399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a794f851 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+226:2215:x1858396225364544:12345-192.168.203.30@tcp:4:cp.0 00000100:00100000:0.0:1772305911.887915:0:21399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a794f851 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+228:2215:x1858396225364544:12345-192.168.203.30@tcp:4:cp.0 Request processed in 321us (489us total) trans 4294968305 rc 0/0 00000100:00100000:0.0:1772305911.887921:0:21399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 66 00002000:00100000:0.0:1772305911.887925:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ad:0x0] (0->1515) req@00000000a794f851 x1858396225364544/t4294968305(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:42/0 lens 2008/448 e 0 to 0 dl 1772305917 ref 1 fl Complete:H/0/0 rc 0/0 job:'cp.0' 00002000:00100000:0.0:1772305911.887931:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 00000000a794f851 with x1858396225364544 ext(0->1515) 00010000:00010000:0.0:1772305911.887938:0:21399:0:(ldlm_lockd.c:601:ldlm_refresh_waiting_lock()) ### refreshed to 56s ns: filter-lustre-OST0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6f186 lrc: 4/0,0 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196edf0 expref: 228 pid: 6306 timeout: 1323 lvb_type: 0 00002000:00010000:0.0:1772305911.887945:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req 00000000a794f851 00000100:00100000:3.0:1772305911.888744:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305911.888777:0:6323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225364608 00010000:00010000:0.0:1772305911.888790:0:6323:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6f186 lrc: 4/0,0 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196edf0 expref: 228 pid: 6306 timeout: 1323 lvb_type: 0 00000100:00100000:0.0:1772305911.888823:0:6323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3085 00000100:00100000:0.0:1772305911.888827:0:6323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d42e5d79 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+228:2216:x1858396225364608:12345-192.168.203.30@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1772305911.888833:0:6323:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1772305911.888842:0:6323:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6f186 lrc: 4/0,0 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196edf0 expref: 228 pid: 6306 timeout: 1323 lvb_type: 0 00010000:00010000:0.0:1772305911.888848:0:6323:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6f186 lrc: 3/0,0 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196edf0 expref: 228 pid: 6306 timeout: 1323 lvb_type: 0 00010000:00010000:0.0:1772305911.888859:0:6323:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6f186 lrc: 0/0,0 mode: --/PW res: [0x1ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196edf0 expref: 228 pid: 6306 timeout: 1323 lvb_type: 0 00010000:00010000:0.0:1772305911.888867:0:6323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305911.888868:0:6323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305911.888869:0:6323:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6f346 lrc: 3/1,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305911.888874:0:6323:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6f346 lrc: 4/1,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305911.888890:0:6323:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1772305911.888910:0:6323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d42e5d79 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2216:x1858396225364608:12345-192.168.203.30@tcp:103:ldlm_bl_04.0 Request processed in 83us (167us total) trans 0 rc 0/0 00010000:00010000:2.0:1772305911.888915:0:6306:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6f346 lrc: 3/1,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305911.888916:0:6323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3085 00010000:00010000:2.0:1772305911.888925:0:6306:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6f346 lrc: 3/1,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305911.888940:0:6306:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6f346 lrc: 3/1,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305911.888946:0:6306:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6f346 lrc: 2/0,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305911.888963:0:6306:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1772305911.888981:0:5496:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1772305911.888987:0:5496:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6f346 lrc: 2/0,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305911.888995:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006e7b3ee8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+226:2216:x1858396225364480:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 Request processed in 2718us (2849us total) trans 0 rc 0/0 00010000:00010000:1.0:1772305911.889005:0:5496:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006c757b88 already unused, calling callback (00000000b5e4f3c0) 00000100:00100000:2.0:1772305911.889009:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5714 00010000:00010000:1.0:1772305911.889010:0:5496:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6f346 lrc: 2/0,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305911.889018:0:5496:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6f346 lrc: 3/0,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305911.889031:0:5496:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6f346 lrc: 1/0,0 mode: --/PR res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305911.889036:0:5496:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6f346 lrc: 0/0,0 mode: --/PR res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305911.889047:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1772305911.889048:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1772305911.889049:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1772305911.889642:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305911.889684:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225364736 00000100:00100000:1.0:1772305911.889714:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 848 00000100:00100000:1.0:1772305911.889720:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b830b726 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:97514:x1858396225364736:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1772305911.889770:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b830b726 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:97514:x1858396225364736:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 51us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305911.889775:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 848 00000100:00100000:3.0:1772305911.891013:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305911.891059:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225364800 00000100:00100000:2.0:1772305911.891081:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5715 00000100:00100000:2.0:1772305911.891086:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000af22ffe1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+226:2215:x1858396225364800:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1772305911.891093:0:6306:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305911.891104:0:6306:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e44a0294/0xa5e9c8c58c6f34d lrc: 2/0,0 mode: --/PR res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ee9f expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1772305911.891114:0:6306:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x1ad:0x0] initial LVB size: 1516, mtime: 0x69a33df6, atime: 0x0, ctime: 0x69a33df6, blocks: 0x1 00010000:00010000:2.0:1772305911.891123:0:6306:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1772305911.891125:0:6306:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1772305911.891128:0:6306:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e44a0294/0xa5e9c8c58c6f34d lrc: 3/0,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee9f expref: 227 pid: 6306 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1772305911.891136:0:6306:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e44a0294/0xa5e9c8c58c6f34d lrc: 3/0,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee9f expref: 227 pid: 6306 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1772305911.891144:0:6306:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e44a0294, rc 0) 00000100:00100000:2.0:1772305911.891166:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000af22ffe1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2215:x1858396225364800:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 81us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305911.891171:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5715 00000100:00100000:3.0:1772305911.891905:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305911.891940:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225364928 00000100:00100000:1.0:1772305911.891965:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 849 00000100:00100000:1.0:1772305911.891968:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001460fd38 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:97514:x1858396225364928:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1772305911.892006:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001460fd38 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:97514:x1858396225364928:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 37us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305911.892011:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 849 00000100:00100000:3.0:1772305911.892908:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305911.892950:0:21399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225365056 00002000:00100000:0.0:1772305911.892972:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ad:0x0] (0->4095) req@00000000695a247a x1858396225365056/t0(0) o3->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:42/0 lens 488/0 e 0 to 0 dl 1772305917 ref 1 fl New:/0/ffffffff rc 0/-1 job:'lhsmtool_posix.0' 00002000:00100000:0.0:1772305911.892989:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 00000000695a247a with x1858396225365056 ext(0->4095) 00002000:00010000:0.0:1772305911.892993:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000695a247a 00000100:00100000:0.0:1772305911.893017:0:21399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2041 00000100:00100000:0.0:1772305911.893022:0:21399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000695a247a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2216:x1858396225365056:12345-192.168.203.30@tcp:3:lhsmtool_posix.0 00000100:00100000:0.0:1772305911.893108:0:21399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000695a247a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2216:x1858396225365056:12345-192.168.203.30@tcp:3:lhsmtool_posix.0 Request processed in 85us (202us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1772305911.893113:0:21399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2041 00002000:00100000:0.0:1772305911.893117:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ad:0x0] (0->4095) req@00000000695a247a x1858396225365056/t0(0) o3->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:42/0 lens 488/4536 e 0 to 0 dl 1772305917 ref 1 fl Complete:/0/0 rc 4096/4096 job:'lhsmtool_posix.0' 00002000:00100000:0.0:1772305911.893123:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 00000000695a247a with x1858396225365056 ext(0->4095) 00002000:00010000:0.0:1772305911.893125:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000695a247a 00000100:00100000:3.0:1772305911.894227:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305911.894269:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225365120 00000100:00100000:1.0:1772305911.894294:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 850 00000100:00100000:1.0:1772305911.894297:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000075ede1e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:97514:x1858396225365120:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1772305911.894304:0:54696:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305911.894314:0:54696:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000017162762/0xa5e9c8c58c6f354 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x326:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196eea6 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305911.894341:0:54696:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6f35b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x326:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305911.894350:0:54696:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6f35b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x326:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305911.894357:0:54696:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6f35b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x326:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305911.894410:0:54696:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000017162762/0xa5e9c8c58c6f354 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x326:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eea6 expref: 71 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305911.894419:0:54696:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000006a4f0137/0xa5e9c8c58c6f35b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x326:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eea6 expref: 70 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305911.894425:0:54696:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x326:0x0].0x0 (00000000e29893a3) 00010000:00010000:1.0:1772305911.894426:0:54696:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1772305911.894428:0:54696:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006a4f0137, rc 0) 00000100:00100000:1.0:1772305911.894451:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000075ede1e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+70:97514:x1858396225365120:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 153us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305911.894456:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 850 00000100:00100000:3.0:1772305911.895718:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305911.895763:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225365184 00000100:00100000:1.0:1772305911.895797:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 851 00000100:00100000:1.0:1772305911.895802:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006b96b036 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+70:97514:x1858396225365184:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1772305911.895820:0:54696:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x326:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1772305911.895889:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006b96b036 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+70:97514:x1858396225365184:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 86us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305911.895900:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 851 00000100:00100000:3.0:1772305911.896842:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305911.896891:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225365248 00000100:00100000:2.0:1772305911.896922:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5716 00000100:00100000:2.0:1772305911.896927:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f8a1bcf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2215:x1858396225365248:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1772305911.896950:0:6306:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c6f362 lrc: 3/1,0 mode: --/PR res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305911.896960:0:6306:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1772305911.896963:0:6306:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1772305911.896967:0:6306:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c6f362 lrc: 3/1,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305911.896978:0:6306:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c6f362 lrc: 3/1,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305911.896994:0:6306:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c6f362 lrc: 3/1,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305911.897001:0:6306:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c6f362 lrc: 2/0,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305911.897019:0:6306:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1772305911.897033:0:38581:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1772305911.897039:0:38581:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c6f362 lrc: 2/0,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305911.897049:0:38581:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000089dbe966 already unused, calling callback (00000000b5e4f3c0) 00010000:00010000:3.0:1772305911.897053:0:38581:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c6f362 lrc: 2/0,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305911.897061:0:38581:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c6f362 lrc: 3/0,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305911.897068:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f8a1bcf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2215:x1858396225365248:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 Request processed in 136us (223us total) trans 0 rc 0/0 00010000:00010000:3.0:1772305911.897078:0:38581:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c6f362 lrc: 1/0,0 mode: --/PR res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305911.897079:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5716 00010000:00010000:3.0:1772305911.897088:0:38581:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c6f362 lrc: 0/0,0 mode: --/PR res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305911.897102:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1772305911.897104:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1772305911.897108:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1772305911.897770:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305911.897821:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225365376 00000100:00100000:1.0:1772305911.897854:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 852 00000100:00100000:1.0:1772305911.897860:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b896dfee pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+70:97514:x1858396225365376:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000040:00080000:1.0:1772305911.898100:0:54696:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x13:0x0].59, 168 off17848 00000040:00080000:1.0:1772305911.898210:0:54696:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x13:0x0].60, 168 off18016 00000001:00080000:1.0:1772305911.898215:0:54696:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934856 00000040:00080000:1.0:1772305911.898280:0:54696:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305911.898284:0:54696:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305911.898345:0:54696:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 38 count 13 00000040:00080000:1.0:1772305911.898353:0:54696:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:1.0:1772305911.898411:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b896dfee pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+71:97514:x1858396225365376:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 549us (643us total) trans 8589934856 rc 0/0 00000100:00100000:1.0:1772305911.898420:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 852 00000040:00080000:0.0:1772305911.898439:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772305911.898443:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772305911.898930:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 13 00000040:00080000:0.0:1772305911.898939:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:0.0:1772305911.899260:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305911.899301:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225365504 00000100:00100000:3.0:1772305911.899360:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 104 00000100:00100000:3.0:1772305911.899369:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000597692b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+71:97514:x1858396225365504:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1772305911.899570:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000597692b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+72:97514:x1858396225365504:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 201us (308us total) trans 8589934857 rc 0/0 00000100:00100000:3.0:1772305911.899581:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 104 00010000:00010000:2.0:1772305912.520758:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1772305913.070172:0:69544:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305913.070177:0:69544:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305913.070230:0:69544:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 38 count 13 00000040:00080000:3.0:1772305913.070234:0:69544:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:2.0:1772305913.086028:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305913.086068:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225365568 00000100:00100000:1.0:1772305913.086125:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 853 00000100:00100000:1.0:1772305913.086132:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bfe1381b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+52:97522:x1858396225365568:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1772305913.086152:0:54696:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305913.086171:0:54696:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000017162762/0xa5e9c8c58c6f369 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196eead expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305913.086228:0:54696:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6f370 lrc: 3/1,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305913.086242:0:54696:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6f370 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305913.086260:0:54696:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6f370 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305913.086274:0:54696:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6f377 lrc: 3/1,0 mode: --/PR res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305913.086282:0:54696:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6f377 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305913.086289:0:54696:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6f377 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305913.086407:0:54696:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c6f37e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x327:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305913.086416:0:54696:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c6f37e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x327:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305913.086424:0:54696:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c6f37e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x327:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1772305913.086454:0:54696:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x327:0x0]: returning size 1516 00000004:00200000:1.0:1772305913.086459:0:54696:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1772305913.086494:0:54696:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c6f37e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x327:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305913.086505:0:54696:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c6f37e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x327:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305913.086513:0:54696:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6f370 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305913.086521:0:54696:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6f370 lrc: 2/0,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305913.086528:0:54696:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6f370 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305913.086535:0:54696:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c609f04e already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305913.086538:0:54696:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6f370 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305913.086545:0:54696:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6f370 lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305913.086557:0:54696:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8c:0x0].0x0 (0000000021d5f76c) 00010000:00010000:1.0:1772305913.086560:0:54696:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305913.086564:0:54696:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6f370 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305913.086570:0:54696:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6f370 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305913.086581:0:54696:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6f377 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305913.086586:0:54696:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6f377 lrc: 2/0,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305913.086592:0:54696:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6f377 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305913.086602:0:54696:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000004a9f3864 already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305913.086604:0:54696:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6f377 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305913.086609:0:54696:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6f377 lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305913.086616:0:54696:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8c:0x0].0xfa5f3888 (0000000027e5c018) 00010000:00010000:1.0:1772305913.086618:0:54696:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305913.086619:0:54696:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6f377 lrc: 2/0,0 mode: --/PR res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305913.086624:0:54696:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6f377 lrc: 0/0,0 mode: --/PR res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305913.086694:0:54696:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000017162762/0xa5e9c8c58c6f369 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eead expref: 54 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305913.086708:0:54696:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c6f37e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x327:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eead expref: 53 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305913.086716:0:54696:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x327:0x0].0x0 (00000000c10a8182) 00010000:00010000:1.0:1772305913.086718:0:54696:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1772305913.086721:0:54696:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000776565ed, rc 0) 00000100:00100000:1.0:1772305913.086776:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bfe1381b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+53:97522:x1858396225365568:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 643us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305913.086785:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 853 00000100:00100000:2.0:1772305913.088178:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305913.088224:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225365632 00000100:00100000:3.0:1772305913.088264:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5717 00000100:00100000:3.0:1772305913.088270:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000f39354b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+140:2215:x1858396225365632:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1772305913.088282:0:6306:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305913.088296:0:6306:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cace9935/0xa5e9c8c58c6f385 lrc: 2/0,0 mode: --/PR res: [0x1ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196eeb4 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305913.088352:0:6306:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fb0c289e pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6306:1858396216602560:192.168.203.30@tcp:106: 00000100:00100000:3.0:1772305913.088412:0:6306:0:(client.c:2500:ptlrpc_set_wait()) set 00000000ec4651f3 going to sleep for 6 seconds 00002000:00010000:3.0:1772305913.089189:0:6306:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x1ae:0x0:0x0] updating lvb size: 0 -> 1516 00002000:00010000:3.0:1772305913.089193:0:6306:0:(ofd_lvb.c:284:ofd_lvbo_update()) res: [0x1ae:0x0:0x0] updating lvb mtime: 0 -> 1772305910 00002000:00010000:3.0:1772305913.089194:0:6306:0:(ofd_lvb.c:290:ofd_lvbo_update()) res: [0x1ae:0x0:0x0] updating lvb atime: 0 -> 1772305910 00002000:00010000:3.0:1772305913.089196:0:6306:0:(ofd_lvb.c:296:ofd_lvbo_update()) res: [0x1ae:0x0:0x0] updating lvb ctime: 0 -> 1772305910 00000100:00100000:3.0:1772305913.089209:0:6306:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fb0c289e pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6306:1858396216602560:192.168.203.30@tcp:106: 00010000:00010000:3.0:1772305913.089231:0:6306:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cace9935/0xa5e9c8c58c6f385 lrc: 1/0,0 mode: --/PR res: [0x1ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eeb4 expref: 141 pid: 6306 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1772305913.089252:0:6306:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cace9935/0xa5e9c8c58c6f385 lrc: 0/0,0 mode: --/PR res: [0x1ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eeb4 expref: 141 pid: 6306 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1772305913.089261:0:6306:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000cace9935, rc 0) 00000100:00100000:3.0:1772305913.089290:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000f39354b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+140:2215:x1858396225365632:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 1020us (1114us total) trans 0 rc 301/301 00000100:00100000:3.0:1772305913.089296:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5717 00000100:00100000:3.0:1772305913.090755:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305913.090791:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225365696 00000100:00100000:0.0:1772305913.090824:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5718 00000100:00100000:0.0:1772305913.090837:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fb0c289e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+140:2216:x1858396225365696:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1772305913.090849:0:6306:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305913.090858:0:6306:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f38c lrc: 2/0,0 mode: --/PR res: [0x1ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196eebb expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305913.090888:0:6306:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000036f569f0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6306:1858396216602624:192.168.203.30@tcp:106: 00000100:00100000:0.0:1772305913.090935:0:6306:0:(client.c:2500:ptlrpc_set_wait()) set 00000000b69fcfd9 going to sleep for 6 seconds 00000100:00100000:0.0:1772305913.091740:0:6306:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000036f569f0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6306:1858396216602624:192.168.203.30@tcp:106: 00010000:00010000:0.0:1772305913.091762:0:6306:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f38c lrc: 1/0,0 mode: --/PR res: [0x1ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eebb expref: 141 pid: 6306 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1772305913.091777:0:6306:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f38c lrc: 0/0,0 mode: --/PR res: [0x1ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eebb expref: 141 pid: 6306 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1772305913.091790:0:6306:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a7782eea, rc 0) 00000100:00100000:0.0:1772305913.091829:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fb0c289e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+140:2216:x1858396225365696:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 990us (1074us total) trans 0 rc 301/301 00000100:00100000:0.0:1772305913.091837:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5718 00000100:00100000:1.0:1772305913.093588:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305913.093683:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225365824 00000100:00100000:3.0:1772305913.093728:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 854 00000100:00100000:3.0:1772305913.093736:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cc7871e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+53:97522:x1858396225365824:12345-192.168.203.30@tcp:58:lfs.0 00000040:00080000:3.0:1772305913.093922:0:54696:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xf:0x0].38, 136 off13360 00000100:00100000:3.0:1772305913.093971:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cc7871e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+53:97522:x1858396225365824:12345-192.168.203.30@tcp:58:lfs.0 Request processed in 235us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305913.093978:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 854 00000040:00080000:3.0:1772305913.370220:0:69595:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305913.370225:0:69595:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305913.370287:0:69595:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 39 count 14 00000040:00080000:3.0:1772305913.370291:0:69595:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772305913.544812:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1772305913.923842:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305913.923890:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305913.923915:0:54689:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225365888 00000100:00100000:3.0:1772305913.923930:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305913.923964:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305913.923969:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225365952 00000100:00100000:2.0:1772305913.923971:0:54689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 142 00000100:00100000:2.0:1772305913.923982:0:54689:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009a65e7bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2218:x1858396225365888:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1772305913.924000:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305913.924003:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225366016 00000100:00100000:1.0:1772305913.924029:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 146 00000100:00100000:1.0:1772305913.924038:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f5fe1428 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+72:2217:x1858396225365952:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:0.0:1772305913.924044:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225366080 00000100:00100000:2.0:1772305913.924055:0:54689:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009a65e7bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2218:x1858396225365888:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 74us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305913.924069:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225366208 00000100:00100000:3.0:1772305913.924070:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305913.924071:0:54689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 142 00000100:00100000:0.0:1772305913.924096:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1175 00000100:00100000:1.0:1772305913.924101:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f5fe1428 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+72:2217:x1858396225365952:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 52us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305913.924103:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002c08a67a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2218:x1858396225366016:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:1.0:1772305913.924120:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 146 00000100:00100000:2.0:1772305913.924145:0:18149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1176 00000100:00100000:1.0:1772305913.924146:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225366144 00000100:00100000:3.0:1772305913.924150:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305913.924150:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002c08a67a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2218:x1858396225366016:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 44us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305913.924155:0:18149:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d90d4880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+228:2217:x1858396225366080:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:0.0:1772305913.924159:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1175 00000100:00100000:1.0:1772305913.924184:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 147 00000100:00100000:2.0:1772305913.924189:0:18149:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d90d4880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+228:2217:x1858396225366080:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 35us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305913.924195:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a7de87ba pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+53:2218:x1858396225366144:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1772305913.924204:0:18149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1176 00000100:00100000:2.0:1772305913.924220:0:18149:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225366272 00000100:00100000:1.0:1772305913.924254:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a7de87ba pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+53:2218:x1858396225366144:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 57us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305913.924255:0:18149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1177 00000100:00100000:2.0:1772305913.924264:0:18149:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ecb2dceb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f935b4d0-e17f-49c8-8011-4be99ba75430+161:2217:x1858396225366208:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:1.0:1772305913.924271:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 147 00000100:00100000:2.0:1772305913.924300:0:18149:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ecb2dceb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f935b4d0-e17f-49c8-8011-4be99ba75430+161:2217:x1858396225366208:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 35us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305913.924312:0:18149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1177 00000100:00100000:1.0:1772305913.924320:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1178 00000100:00100000:1.0:1772305913.924329:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d538581f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+140:2218:x1858396225366272:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:1.0:1772305913.924369:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d538581f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+140:2218:x1858396225366272:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 40us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305913.924379:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1178 00000040:00080000:0.0:1772305913.928796:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772305913.928801:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772305913.928852:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 39 count 14 00000040:00080000:0.0:1772305913.928861:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:0.0:1772305913.929106:0:54732:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x13:0x0].61, 136 off18152 00000100:00100000:0.0:1772305913.929174:0:54732:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000004563a97 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:54732:1858396216602688:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1772305913.929243:0:54732:0:(client.c:2500:ptlrpc_set_wait()) set 00000000ca0b76ae going to sleep for 6 seconds 00000100:00100000:0.0:1772305913.930213:0:54732:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000004563a97 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:54732:1858396216602688:192.168.203.30@tcp:107:hsm_cdtr.0 00000040:00080000:0.0:1772305913.930259:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772305913.930262:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772305913.930299:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 39 count 14 00000040:00080000:0.0:1772305913.930303:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:3.0:1772305913.930586:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305913.930658:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225366336 00000100:00100000:0.0:1772305913.930698:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 855 00000100:00100000:0.0:1772305913.930703:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000022640fb5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+72:97533:x1858396225366336:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1772305913.930724:0:55653:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x327:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1772305913.930789:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000022640fb5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+72:97533:x1858396225366336:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 85us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305913.930798:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 855 00000100:00100000:1.0:1772305913.931828:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305913.931876:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225366464 00000100:00100000:0.0:1772305913.931901:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 856 00000100:00100000:0.0:1772305913.931904:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003fc0ed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+72:97533:x1858396225366464:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1772305913.931913:0:55653:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305913.931929:0:55653:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f393 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196eec2 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305913.931975:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f39a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305913.931987:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f39a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305913.931995:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f39a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305913.932011:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f3a1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4672eba5 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305913.932016:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f3a1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4672eba5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305913.932021:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f3a1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4672eba5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305913.932062:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c6f3a8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x327:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305913.932068:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c6f3a8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x327:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305913.932072:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c6f3a8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x327:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305913.932078:0:55653:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x327:0x0]: returning size 1516 00010000:00010000:0.0:1772305913.932133:0:55653:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f39a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305913.932138:0:55653:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f39a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305913.932143:0:55653:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f39a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305913.932147:0:55653:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000082c88ffe already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305913.932149:0:55653:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f39a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305913.932159:0:55653:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f39a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305913.932168:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (00000000c78481f6) 00010000:00010000:0.0:1772305913.932170:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305913.932173:0:55653:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f39a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305913.932177:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f39a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305913.932186:0:55653:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f3a1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4672eba5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305913.932189:0:55653:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f3a1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4672eba5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305913.932193:0:55653:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f3a1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4672eba5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305913.932196:0:55653:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000079ce3603 already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305913.932197:0:55653:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f3a1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4672eba5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305913.932201:0:55653:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f3a1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4672eba5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305913.932205:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4672eba5 (000000005046deb8) 00010000:00010000:0.0:1772305913.932206:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305913.932211:0:55653:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f3a1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4672eba5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305913.932215:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f3a1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4672eba5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305913.932237:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f393 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eec2 expref: 75 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305913.932244:0:55653:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c6f3a8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x327:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eec2 expref: 74 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305913.932248:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x327:0x0].0x0 (00000000c10a8182) 00010000:00010000:0.0:1772305913.932250:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1772305913.932251:0:55653:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000004820b6c, rc 0) 00000100:00100000:0.0:1772305913.932277:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003fc0ed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+74:97533:x1858396225366464:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 372us (452us total) trans 8589934858 rc 0/0 00000100:00100000:0.0:1772305913.932286:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 856 00000100:00100000:3.0:1772305913.933389:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305913.933441:0:6323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225366528 00000100:00100000:3.0:1772305913.933487:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305913.933496:0:6323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1047 00000100:00100000:0.0:1772305913.933502:0:6323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ebc3b500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+74:2215:x1858396225366528:12345-192.168.203.30@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1772305913.933511:0:6323:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1772305913.933523:0:6323:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c6f3a8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x327:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eec2 expref: 74 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305913.933534:0:6323:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x327:0x0].0x0 (00000000c10a8182) 00010000:00010000:0.0:1772305913.933537:0:6323:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1772305913.933547:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225366592 00000100:00100000:0.0:1772305913.933565:0:6323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ebc3b500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+73:2215:x1858396225366528:12345-192.168.203.30@tcp:103:ldlm_bl_02.0 Request processed in 61us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305913.933578:0:6323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1047 00000100:00100000:2.0:1772305913.933590:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5719 00000100:00100000:2.0:1772305913.933598:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f50ff6e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+228:2216:x1858396225366592:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1772305913.933657:0:6307:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007319ba46/0xa5e9c8c58c6f3b6 lrc: 3/1,0 mode: --/PR res: [0x1ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305913.933671:0:6307:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000020fba8b5/0xa5e9c8c58c6f22e lrc: 2/0,0 mode: PW/PW res: [0x1ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee2f expref: 228 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305913.933677:0:6307:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1772305913.933679:0:6307:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1772305913.933680:0:6307:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007319ba46/0xa5e9c8c58c6f3b6 lrc: 4/1,0 mode: --/PR res: [0x1ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305913.933700:0:6307:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000020fba8b5/0xa5e9c8c58c6f22e lrc: 3/0,0 mode: PW/PW res: [0x1ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee2f expref: 228 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305913.933709:0:6307:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000020fba8b5/0xa5e9c8c58c6f22e lrc: 4/0,0 mode: PW/PW res: [0x1ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee2f expref: 228 pid: 6306 timeout: 1325 lvb_type: 0 00000100:00100000:2.0:1772305913.933719:0:6307:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fb0c28f5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6307:1858396216602752:192.168.203.30@tcp:104: 00000100:00100000:2.0:1772305913.933748:0:6307:0:(client.c:2500:ptlrpc_set_wait()) set 0000000020eea823 going to sleep for 6 seconds 00000100:00100000:2.0:1772305913.934365:0:6307:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fb0c28f5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6307:1858396216602752:192.168.203.30@tcp:104: 00010000:00010000:2.0:1772305913.934383:0:6307:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007319ba46/0xa5e9c8c58c6f3b6 lrc: 3/1,0 mode: --/PR res: [0x1ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305913.934686:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305913.934719:0:21399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225366656 00002000:00100000:0.0:1772305913.934739:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x100010000:0x1ae:0x0] (0->1515) req@0000000020b0ad0a x1858396225366656/t0(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:44/0 lens 2008/0 e 0 to 0 dl 1772305919 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cp.0' 00002000:00100000:0.0:1772305913.934746:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 0000000020b0ad0a with x1858396225366656 ext(0->1515) 00010000:00010000:0.0:1772305913.934753:0:21399:0:(ldlm_lockd.c:601:ldlm_refresh_waiting_lock()) ### refreshed to 56s ns: filter-lustre-OST0001_UUID lock: 0000000020fba8b5/0xa5e9c8c58c6f22e lrc: 4/0,0 mode: PW/PW res: [0x1ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee2f expref: 229 pid: 6306 timeout: 1325 lvb_type: 0 00002000:00010000:0.0:1772305913.934759:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req 0000000020b0ad0a 00000100:00100000:0.0:1772305913.934776:0:21399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 67 00000100:00100000:0.0:1772305913.934780:0:21399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000020b0ad0a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+229:2216:x1858396225366656:12345-192.168.203.30@tcp:4:cp.0 00000100:00100000:0.0:1772305913.935092:0:21399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000020b0ad0a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+231:2216:x1858396225366656:12345-192.168.203.30@tcp:4:cp.0 Request processed in 311us (406us total) trans 4294968345 rc 0/0 00000100:00100000:0.0:1772305913.935098:0:21399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 67 00002000:00100000:0.0:1772305913.935103:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x100010000:0x1ae:0x0] (0->1515) req@0000000020b0ad0a x1858396225366656/t4294968345(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:44/0 lens 2008/448 e 0 to 0 dl 1772305919 ref 1 fl Complete:H/0/0 rc 0/0 job:'cp.0' 00002000:00100000:0.0:1772305913.935109:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 0000000020b0ad0a with x1858396225366656 ext(0->1515) 00010000:00010000:0.0:1772305913.935115:0:21399:0:(ldlm_lockd.c:601:ldlm_refresh_waiting_lock()) ### refreshed to 56s ns: filter-lustre-OST0001_UUID lock: 0000000020fba8b5/0xa5e9c8c58c6f22e lrc: 4/0,0 mode: PW/PW res: [0x1ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee2f expref: 231 pid: 6306 timeout: 1325 lvb_type: 0 00002000:00010000:0.0:1772305913.935121:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req 0000000020b0ad0a 00000100:00100000:3.0:1772305913.935939:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305913.935976:0:6323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225366720 00010000:00010000:0.0:1772305913.935989:0:6323:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000020fba8b5/0xa5e9c8c58c6f22e lrc: 4/0,0 mode: PW/PW res: [0x1ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee2f expref: 231 pid: 6306 timeout: 1325 lvb_type: 0 00000100:00100000:0.0:1772305913.936019:0:6323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3086 00000100:00100000:0.0:1772305913.936022:0:6323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005b0c5d35 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+231:2215:x1858396225366720:12345-192.168.203.30@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1772305913.936028:0:6323:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1772305913.936037:0:6323:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000020fba8b5/0xa5e9c8c58c6f22e lrc: 4/0,0 mode: PW/PW res: [0x1ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee2f expref: 231 pid: 6306 timeout: 1325 lvb_type: 0 00010000:00010000:0.0:1772305913.936044:0:6323:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000020fba8b5/0xa5e9c8c58c6f22e lrc: 3/0,0 mode: PW/PW res: [0x1ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee2f expref: 231 pid: 6306 timeout: 1325 lvb_type: 0 00010000:00010000:0.0:1772305913.936062:0:6323:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020fba8b5/0xa5e9c8c58c6f22e lrc: 0/0,0 mode: --/PW res: [0x1ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee2f expref: 231 pid: 6306 timeout: 1325 lvb_type: 0 00010000:00010000:0.0:1772305913.936070:0:6323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305913.936071:0:6323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305913.936072:0:6323:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007319ba46/0xa5e9c8c58c6f3b6 lrc: 3/1,0 mode: PR/PR res: [0x1ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305913.936078:0:6323:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007319ba46/0xa5e9c8c58c6f3b6 lrc: 4/1,0 mode: PR/PR res: [0x1ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305913.936095:0:6323:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1772305913.936121:0:6323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005b0c5d35 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2215:x1858396225366720:12345-192.168.203.30@tcp:103:ldlm_bl_01.0 Request processed in 97us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305913.936129:0:6323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3086 00010000:00010000:2.0:1772305913.936132:0:6307:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007319ba46/0xa5e9c8c58c6f3b6 lrc: 3/1,0 mode: PR/PR res: [0x1ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305913.936140:0:6307:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007319ba46/0xa5e9c8c58c6f3b6 lrc: 3/1,0 mode: PR/PR res: [0x1ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305913.936157:0:6307:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007319ba46/0xa5e9c8c58c6f3b6 lrc: 3/1,0 mode: PR/PR res: [0x1ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305913.936164:0:6307:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007319ba46/0xa5e9c8c58c6f3b6 lrc: 2/0,0 mode: PR/PR res: [0x1ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305913.936182:0:6307:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1772305913.936190:0:5496:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1772305913.936201:0:5496:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007319ba46/0xa5e9c8c58c6f3b6 lrc: 2/0,0 mode: PR/PR res: [0x1ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305913.936210:0:5496:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000007319ba46 already unused, calling callback (00000000b5e4f3c0) 00000100:00100000:2.0:1772305913.936211:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f50ff6e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+229:2216:x1858396225366592:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 Request processed in 2613us (2726us total) trans 0 rc 0/0 00010000:00010000:1.0:1772305913.936214:0:5496:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007319ba46/0xa5e9c8c58c6f3b6 lrc: 2/0,0 mode: PR/PR res: [0x1ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305913.936222:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5719 00010000:00010000:1.0:1772305913.936227:0:5496:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007319ba46/0xa5e9c8c58c6f3b6 lrc: 3/0,0 mode: PR/PR res: [0x1ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305913.936241:0:5496:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007319ba46/0xa5e9c8c58c6f3b6 lrc: 1/0,0 mode: --/PR res: [0x1ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305913.936246:0:5496:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007319ba46/0xa5e9c8c58c6f3b6 lrc: 0/0,0 mode: --/PR res: [0x1ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305913.936256:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1772305913.936258:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1772305913.936259:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1772305913.936894:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305913.936934:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225366848 00000100:00100000:0.0:1772305913.936960:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 857 00000100:00100000:0.0:1772305913.936970:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008f3ff7b7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+73:97533:x1858396225366848:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1772305913.937018:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008f3ff7b7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+73:97533:x1858396225366848:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 48us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305913.937023:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 857 00000100:00100000:3.0:1772305913.938008:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305913.938049:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225366912 00000100:00100000:2.0:1772305913.938077:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5720 00000100:00100000:2.0:1772305913.938082:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000037f02e11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+229:2216:x1858396225366912:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1772305913.938091:0:6307:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305913.938104:0:6307:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd78dae3/0xa5e9c8c58c6f3bd lrc: 2/0,0 mode: --/PR res: [0x1ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196eec9 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1772305913.938118:0:6307:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x1ae:0x0] initial LVB size: 1516, mtime: 0x69a33df6, atime: 0x0, ctime: 0x69a33df6, blocks: 0x1 00010000:00010000:2.0:1772305913.938129:0:6307:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1772305913.938131:0:6307:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1772305913.938134:0:6307:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd78dae3/0xa5e9c8c58c6f3bd lrc: 3/0,0 mode: PR/PR res: [0x1ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eec9 expref: 230 pid: 6307 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1772305913.938142:0:6307:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fd78dae3/0xa5e9c8c58c6f3bd lrc: 3/0,0 mode: PR/PR res: [0x1ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eec9 expref: 230 pid: 6307 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1772305913.938149:0:6307:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fd78dae3, rc 0) 00000100:00100000:2.0:1772305913.938175:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000037f02e11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2216:x1858396225366912:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 93us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305913.938180:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5720 00000100:00100000:1.0:1772305913.938909:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305913.938952:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225367040 00000100:00100000:0.0:1772305913.938979:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 858 00000100:00100000:0.0:1772305913.938983:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000957f52ed pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+73:97533:x1858396225367040:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1772305913.939022:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000957f52ed pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+73:97533:x1858396225367040:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 39us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305913.939027:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 858 00000100:00100000:3.0:1772305913.939932:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305913.939964:0:21399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225367168 00002000:00100000:0.0:1772305913.939981:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x100010000:0x1ae:0x0] (0->4095) req@00000000c89eca49 x1858396225367168/t0(0) o3->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:44/0 lens 488/0 e 0 to 0 dl 1772305919 ref 1 fl New:/0/ffffffff rc 0/-1 job:'lhsmtool_posix.0' 00002000:00100000:0.0:1772305913.939988:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 00000000c89eca49 with x1858396225367168 ext(0->4095) 00002000:00010000:0.0:1772305913.939990:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000c89eca49 00000100:00100000:0.0:1772305913.940005:0:21399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2042 00000100:00100000:0.0:1772305913.940008:0:21399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c89eca49 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2215:x1858396225367168:12345-192.168.203.30@tcp:3:lhsmtool_posix.0 00000100:00100000:0.0:1772305913.940086:0:21399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c89eca49 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2215:x1858396225367168:12345-192.168.203.30@tcp:3:lhsmtool_posix.0 Request processed in 76us (155us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1772305913.940091:0:21399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2042 00002000:00100000:0.0:1772305913.940096:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x100010000:0x1ae:0x0] (0->4095) req@00000000c89eca49 x1858396225367168/t0(0) o3->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:44/0 lens 488/4536 e 0 to 0 dl 1772305919 ref 1 fl Complete:/0/0 rc 4096/4096 job:'lhsmtool_posix.0' 00002000:00100000:0.0:1772305913.940102:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 00000000c89eca49 with x1858396225367168 ext(0->4095) 00002000:00010000:0.0:1772305913.940111:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000c89eca49 00000100:00100000:3.0:1772305913.941105:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305913.941134:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225367232 00000100:00100000:0.0:1772305913.941169:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 859 00000100:00100000:0.0:1772305913.941174:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b7ea6417 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+73:97533:x1858396225367232:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1772305913.941184:0:55653:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305913.941196:0:55653:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f3c4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x327:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196eed0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305913.941220:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000004ef5fcf0/0xa5e9c8c58c6f3cb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x327:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305913.941229:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000004ef5fcf0/0xa5e9c8c58c6f3cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x327:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305913.941235:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004ef5fcf0/0xa5e9c8c58c6f3cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x327:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305913.941289:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f3c4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x327:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eed0 expref: 75 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305913.941298:0:55653:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000004ef5fcf0/0xa5e9c8c58c6f3cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x327:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eed0 expref: 74 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305913.941303:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x327:0x0].0x0 (00000000c10a8182) 00010000:00010000:0.0:1772305913.941305:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1772305913.941307:0:55653:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004ef5fcf0, rc 0) 00000100:00100000:0.0:1772305913.941331:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b7ea6417 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+74:97533:x1858396225367232:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 157us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305913.941336:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 859 00000100:00100000:1.0:1772305913.942358:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305913.942400:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225367296 00000100:00100000:0.0:1772305913.942427:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 860 00000100:00100000:0.0:1772305913.942430:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000049a6801b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+74:97533:x1858396225367296:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1772305913.942446:0:55653:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x327:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1772305913.942525:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000049a6801b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+74:97533:x1858396225367296:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 92us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305913.942534:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 860 00000100:00100000:3.0:1772305913.943405:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305913.943440:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225367360 00000100:00100000:2.0:1772305913.943490:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5721 00000100:00100000:2.0:1772305913.943495:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003e43a9e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2216:x1858396225367360:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1772305913.943516:0:6307:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001967872f/0xa5e9c8c58c6f3d2 lrc: 3/1,0 mode: --/PR res: [0x1ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305913.943525:0:6307:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1772305913.943527:0:6307:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1772305913.943531:0:6307:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001967872f/0xa5e9c8c58c6f3d2 lrc: 3/1,0 mode: PR/PR res: [0x1ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305913.943538:0:6307:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001967872f/0xa5e9c8c58c6f3d2 lrc: 3/1,0 mode: PR/PR res: [0x1ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305913.943554:0:6307:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001967872f/0xa5e9c8c58c6f3d2 lrc: 3/1,0 mode: PR/PR res: [0x1ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305913.943562:0:6307:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001967872f/0xa5e9c8c58c6f3d2 lrc: 2/0,0 mode: PR/PR res: [0x1ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305913.943580:0:6307:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1772305913.943589:0:38581:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1772305913.943594:0:38581:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001967872f/0xa5e9c8c58c6f3d2 lrc: 2/0,0 mode: PR/PR res: [0x1ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305913.943601:0:38581:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000001967872f already unused, calling callback (00000000b5e4f3c0) 00010000:00010000:3.0:1772305913.943604:0:38581:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001967872f/0xa5e9c8c58c6f3d2 lrc: 2/0,0 mode: PR/PR res: [0x1ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305913.943609:0:38581:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001967872f/0xa5e9c8c58c6f3d2 lrc: 3/0,0 mode: PR/PR res: [0x1ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305913.943619:0:38581:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001967872f/0xa5e9c8c58c6f3d2 lrc: 1/0,0 mode: --/PR res: [0x1ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305913.943622:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003e43a9e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2216:x1858396225367360:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 Request processed in 123us (215us total) trans 0 rc 0/0 00010000:00010000:3.0:1772305913.943645:0:38581:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001967872f/0xa5e9c8c58c6f3d2 lrc: 0/0,0 mode: --/PR res: [0x1ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305913.943654:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1772305913.943660:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5721 00010000:00010000:3.0:1772305913.943664:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1772305913.943667:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1772305913.944331:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305913.944364:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225367488 00000100:00100000:0.0:1772305913.944389:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 861 00000100:00100000:0.0:1772305913.944393:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008a3f3626 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+74:97533:x1858396225367488:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000040:00080000:0.0:1772305913.944598:0:55653:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x13:0x0].62, 168 off18320 00000040:00080000:0.0:1772305913.944708:0:55653:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x13:0x0].63, 168 off18488 00000001:00080000:0.0:1772305913.944712:0:55653:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934859 00000040:00080000:0.0:1772305913.944753:0:55653:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772305913.944756:0:55653:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772305913.944795:0:55653:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 39 count 14 00000040:00080000:0.0:1772305913.944800:0:55653:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:0.0:1772305913.944844:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008a3f3626 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+75:97533:x1858396225367488:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 449us (514us total) trans 8589934859 rc 0/0 00000100:00100000:0.0:1772305913.944851:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 861 00000040:00080000:1.0:1772305913.944879:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305913.944882:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305913.945294:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 14 00000040:00080000:1.0:1772305913.945301:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:1.0:1772305913.945499:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305913.945534:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225367616 00000100:00100000:3.0:1772305913.945559:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 105 00000100:00100000:3.0:1772305913.945563:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000094ce544a pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+75:97533:x1858396225367616:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1772305913.945680:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000094ce544a pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+76:97533:x1858396225367616:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 116us (182us total) trans 8589934860 rc 0/0 00000100:00100000:3.0:1772305913.945686:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 105 00010000:00010000:2.0:1772305914.568720:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1772305914.670399:0:69646:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772305914.670406:0:69646:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772305914.670519:0:69646:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 39 count 14 00000040:00080000:0.0:1772305914.670527:0:69646:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:0.0:1772305914.686228:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305914.686304:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225367680 00000100:00100000:1.0:1772305914.686356:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5722 00000100:00100000:1.0:1772305914.686364:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000004563a97 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+161:2216:x1858396225367680:12345-192.168.203.30@tcp:101:rm.0 00010000:00010000:1.0:1772305914.686380:0:6307:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305914.686398:0:6307:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017162762/0xa5e9c8c58c6f3d9 lrc: 2/0,0 mode: --/PR res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196eed7 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305914.686419:0:6307:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305914.686421:0:6307:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305914.686430:0:6307:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017162762/0xa5e9c8c58c6f3d9 lrc: 3/0,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eed7 expref: 162 pid: 6307 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1772305914.686442:0:6307:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000017162762/0xa5e9c8c58c6f3d9 lrc: 3/0,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eed7 expref: 162 pid: 6307 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1772305914.686453:0:6307:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000017162762, rc 0) 00000100:00100000:1.0:1772305914.686516:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000004563a97 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+162:2216:x1858396225367680:12345-192.168.203.30@tcp:101:rm.0 Request processed in 153us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305914.686522:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5722 00000100:00100000:2.0:1772305914.687975:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305914.688033:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225367808 00000100:00100000:1.0:1772305914.688079:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 862 00000100:00100000:1.0:1772305914.688087:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fb0c28f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+53:97542:x1858396225367808:12345-192.168.203.30@tcp:36:rm.0 00010000:00010000:1.0:1772305914.688129:0:55653:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1772305914.688151:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007c4795ba/0xa5e9c8c58c6f2f2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x326:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee75 expref: 53 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305914.688166:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x326:0x0].0x0 (00000000e29893a3) 00010000:00010000:1.0:1772305914.688173:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6f315 lrc: 0/0,0 mode: --/PR res: [0x200000408:0x8c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee8a expref: 52 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305914.688181:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8c:0x0].0x0 (0000000021d5f76c) 00010000:00010000:1.0:1772305914.688184:0:55653:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1772305914.688214:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6f3e0 lrc: 3/0,1 mode: --/CW res: [0x200000408:0x8c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305914.688227:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6f3e0 lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305914.688237:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6f3e0 lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305914.688252:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6f3e7 lrc: 3/0,1 mode: --/PW res: [0x200000408:0x8c:0x0].0x5e0cd9fa bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305914.688259:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6f3e7 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x8c:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305914.688266:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6f3e7 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x8c:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305914.688380:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000016b42150/0xa5e9c8c58c6f3ee lrc: 3/0,1 mode: --/EX res: [0x200000402:0x326:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305914.688391:0:55653:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6f163 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x326:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eddb expref: 75 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305914.688397:0:55653:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000eca741a1/0xa5e9c8c58c6f178 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x326:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ede2 expref: 75 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305914.688401:0:55653:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 0000000016b42150/0xa5e9c8c58c6f3ee lrc: 5/0,1 mode: --/EX res: [0x200000402:0x326:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305914.688424:0:55653:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000eca741a1/0xa5e9c8c58c6f178 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x326:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ede2 expref: 75 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305914.688432:0:55653:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000eca741a1/0xa5e9c8c58c6f178 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x326:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ede2 expref: 75 pid: 54697 timeout: 1326 lvb_type: 0 00000100:00100000:1.0:1772305914.688447:0:55653:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002aca8cc4 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:55653:1858396216602816:192.168.203.30@tcp:104: 00010000:00010000:1.0:1772305914.688523:0:55653:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6f163 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x326:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eddb expref: 75 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305914.688533:0:55653:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6f163 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x326:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eddb expref: 75 pid: 54697 timeout: 1326 lvb_type: 0 00000100:00100000:1.0:1772305914.688542:0:55653:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e53cfa76 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:55653:1858396216602880:192.168.203.30@tcp:104: 00000100:00100000:1.0:1772305914.688567:0:55653:0:(client.c:2500:ptlrpc_set_wait()) set 000000005af7ba9f going to sleep for 6 seconds 00000100:00100000:0.0:1772305914.689507:0:55653:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002aca8cc4 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:55653:1858396216602816:192.168.203.30@tcp:104: 00000100:00100000:0.0:1772305914.689521:0:55653:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e53cfa76 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:55653:1858396216602880:192.168.203.30@tcp:104: 00010000:00010000:0.0:1772305914.689551:0:55653:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 0000000016b42150/0xa5e9c8c58c6f3ee lrc: 3/0,1 mode: --/EX res: [0x200000402:0x326:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305914.689717:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305914.689750:0:6323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225367872 00010000:00010000:0.0:1772305914.689768:0:6323:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6f163 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x326:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eddb expref: 76 pid: 54697 timeout: 1326 lvb_type: 0 00000100:00100000:3.0:1772305914.689797:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305914.689811:0:6323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225367936 00000100:00100000:1.0:1772305914.689824:0:16126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3087 00010000:00010000:0.0:1772305914.689824:0:6323:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000eca741a1/0xa5e9c8c58c6f178 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x326:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ede2 expref: 77 pid: 54697 timeout: 1326 lvb_type: 0 00000100:00100000:1.0:1772305914.689833:0:16126:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b04e3f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+77:2216:x1858396225367872:12345-192.168.203.30@tcp:103:ldlm_bl_06.0 00010000:00010000:1.0:1772305914.689850:0:16126:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1772305914.689857:0:16126:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6f163 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x326:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eddb expref: 77 pid: 54697 timeout: 1326 lvb_type: 0 00010000:00010000:1.0:1772305914.689865:0:16126:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6f163 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x326:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eddb expref: 77 pid: 54697 timeout: 1326 lvb_type: 0 00010000:00010000:1.0:1772305914.689876:0:16126:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6f163 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x326:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eddb expref: 77 pid: 54697 timeout: 1326 lvb_type: 0 00010000:00010000:1.0:1772305914.689884:0:16126:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x326:0x0].0x0 (00000000e29893a3) 00010000:00010000:1.0:1772305914.689887:0:16126:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: 0000000016b42150/0xa5e9c8c58c6f3ee lrc: 3/0,1 mode: --/EX res: [0x200000402:0x326:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305914.689892:0:16126:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: 0000000016b42150/0xa5e9c8c58c6f3ee lrc: 3/0,1 mode: --/EX res: [0x200000402:0x326:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305914.689897:0:16126:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1772305914.689923:0:5494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3088 00000100:00100000:1.0:1772305914.689927:0:16126:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b04e3f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+76:2216:x1858396225367872:12345-192.168.203.30@tcp:103:ldlm_bl_06.0 Request processed in 94us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305914.689934:0:5494:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004ca72e12 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+76:2215:x1858396225367936:12345-192.168.203.30@tcp:103:ldlm_bl_05.0 00000100:00100000:1.0:1772305914.689936:0:16126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3087 00010000:00010000:3.0:1772305914.689950:0:5494:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1772305914.689957:0:5494:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000eca741a1/0xa5e9c8c58c6f178 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x326:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ede2 expref: 75 pid: 54697 timeout: 1326 lvb_type: 0 00010000:00010000:3.0:1772305914.689970:0:5494:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000eca741a1/0xa5e9c8c58c6f178 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x326:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ede2 expref: 75 pid: 54697 timeout: 1326 lvb_type: 0 00010000:00010000:3.0:1772305914.689985:0:5494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000eca741a1/0xa5e9c8c58c6f178 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x326:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ede2 expref: 75 pid: 54697 timeout: 1326 lvb_type: 0 00010000:00010000:3.0:1772305914.690000:0:5494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x326:0x0].0x0 (00000000e29893a3) 00010000:00010000:3.0:1772305914.690003:0:5494:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: 0000000016b42150/0xa5e9c8c58c6f3ee lrc: 3/0,1 mode: --/EX res: [0x200000402:0x326:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.690025:0:5494:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 0000000016b42150/0xa5e9c8c58c6f3ee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x326:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.690031:0:5494:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000016b42150/0xa5e9c8c58c6f3ee lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x326:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.690113:0:5494:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1772305914.690136:0:55653:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 0000000016b42150/0xa5e9c8c58c6f3ee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x326:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305914.690146:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000016b42150/0xa5e9c8c58c6f3ee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x326:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305914.690154:0:5494:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004ca72e12 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+74:2215:x1858396225367936:12345-192.168.203.30@tcp:103:ldlm_bl_05.0 Request processed in 218us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305914.690166:0:5494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3088 00000040:00080000:0.0:1772305914.690764:0:55653:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xb:0x0].9, 64 off8840 00000004:00080000:0.0:1772305914.690771:0:55653:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1226585143014ns, next at 1227585140666ns, rc = 0 00000040:00080000:0.0:1772305914.690792:0:55653:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x13:0x0].64, 192 off18680 00010000:00010000:0.0:1772305914.690868:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f3f5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x326:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305914.690879:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f3f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x326:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 18446631284783354304 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305914.690889:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f3f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x326:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 18446631284783354304 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305914.690898:0:55653:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f3f5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x326:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 18446631284783354304 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305914.690913:0:55653:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f3f5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x326:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 18446631284783354304 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305914.690918:0:55653:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f3f5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x326:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 18446631284783354304 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305914.690934:0:55653:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1772305914.690948:0:55653:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000fb0c28f5 reply state 00000000649fddf8 transno 8589934861 ns: mdt-lustre-MDT0000_UUID lock: 0000000016b42150/0xa5e9c8c58c6f3ee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x326:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.690985:0:6322:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1772305914.690989:0:55653:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6f3e0 lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.690991:0:6322:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f3f5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x326:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 18446631284783354304 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305914.690998:0:55653:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6f3e0 lrc: 2/0,0 mode: CW/CW res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305914.691003:0:55653:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6f3e0 lrc: 3/0,0 mode: CW/CW res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305914.691007:0:55653:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000004a9f3864 already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305914.691009:0:55653:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6f3e0 lrc: 3/0,0 mode: CW/CW res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305914.691027:0:55653:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6f3e0 lrc: 4/0,0 mode: CW/CW res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305914.691037:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8c:0x0].0x0 (0000000021d5f76c) 00010000:00010000:3.0:1772305914.691038:0:6322:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006e08f961 already unused, calling callback (00000000b5e4f3c0) 00010000:00010000:0.0:1772305914.691041:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305914.691044:0:6322:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f3f5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x326:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 18446631284783354304 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305914.691053:0:55653:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6f3e0 lrc: 2/0,0 mode: --/CW res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305914.691062:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c6f3e0 lrc: 0/0,0 mode: --/CW res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1772305914.691073:0:55653:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000fb0c28f5 reply state 00000000649fddf8 transno 8589934861 ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6f3e7 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x8c:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.691084:0:6322:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f3f5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x326:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 18446631284783354304 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305914.691137:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fb0c28f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+53:97542:x1858396225367808:12345-192.168.203.30@tcp:36:rm.0 Request processed in 3051us (3166us total) trans 8589934861 rc 0/0 00000100:00100000:0.0:1772305914.691144:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 862 00010000:00010000:3.0:1772305914.691180:0:6322:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x326:0x0].0x0 (00000000e29893a3) 00010000:00010000:3.0:1772305914.691185:0:6322:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1772305914.691188:0:6322:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f3f5 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x326:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 18446631284783354304 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.691195:0:6322:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f3f5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x326:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 18446631284783354304 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.691344:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1772305914.691345:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1772305914.691347:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1772305914.691807:0:2978:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6f3e7 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x8c:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305914.691819:0:2978:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6f3e7 lrc: 2/0,0 mode: PW/PW res: [0x200000408:0x8c:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305914.691826:0:2978:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6f3e7 lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x8c:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305914.691833:0:2978:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c609f04e already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305914.691836:0:2978:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6f3e7 lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x8c:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305914.691843:0:2978:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6f3e7 lrc: 4/0,0 mode: PW/PW res: [0x200000408:0x8c:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305914.691856:0:2978:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8c:0x0].0x5e0cd9fa (0000000027e5c018) 00010000:00010000:2.0:1772305914.691860:0:2978:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305914.691863:0:2978:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6f3e7 lrc: 2/0,0 mode: --/PW res: [0x200000408:0x8c:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305914.691871:0:2978:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c6f3e7 lrc: 0/0,0 mode: --/PW res: [0x200000408:0x8c:0x0].0x5e0cd9fa bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305914.691888:0:2978:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000016b42150/0xa5e9c8c58c6f3ee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x326:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305914.691895:0:2978:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000016b42150/0xa5e9c8c58c6f3ee lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x326:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305914.691901:0:2978:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000016b42150/0xa5e9c8c58c6f3ee lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x326:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305914.691906:0:2978:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000016b42150 already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305914.691909:0:2978:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000016b42150/0xa5e9c8c58c6f3ee lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x326:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305914.691916:0:2978:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000016b42150/0xa5e9c8c58c6f3ee lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x326:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305914.691926:0:2978:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x326:0x0].0x0 (00000000e29893a3) 00010000:00010000:2.0:1772305914.691929:0:2978:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1772305914.691932:0:2978:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000016b42150/0xa5e9c8c58c6f3ee lrc: 2/0,0 mode: --/EX res: [0x200000402:0x326:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305914.691939:0:2978:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000016b42150/0xa5e9c8c58c6f3ee lrc: 0/0,0 mode: --/EX res: [0x200000402:0x326:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305914.703404:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305914.703468:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225368000 00000100:00100000:0.0:1772305914.703516:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 863 00000100:00100000:0.0:1772305914.703522:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000025278777 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+74:97546:x1858396225368000:12345-192.168.203.30@tcp:501:chlg_load_threa.0 00000100:00100000:0.0:1772305914.703700:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000025278777 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+74:97546:x1858396225368000:12345-192.168.203.30@tcp:501:chlg_load_threa.0 Request processed in 177us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305914.703711:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 863 00000100:00100000:1.0:1772305914.704445:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305914.704500:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225368064 00000100:00100000:2.0:1772305914.704543:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 864 00000100:00100000:2.0:1772305914.704549:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e53cfa76 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+74:97546:x1858396225368064:12345-192.168.203.30@tcp:503:chlg_load_threa.0 00000100:00100000:2.0:1772305914.704787:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e53cfa76 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+74:97546:x1858396225368064:12345-192.168.203.30@tcp:503:chlg_load_threa.0 Request processed in 237us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305914.704798:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 864 00000100:00100000:2.0:1772305914.705678:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305914.705706:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225368128 00000100:00100000:3.0:1772305914.705733:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 865 00000100:00100000:3.0:1772305914.705736:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a17edbba pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+74:97546:x1858396225368128:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1772305914.705855:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a17edbba pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+74:97546:x1858396225368128:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 117us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305914.705861:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 865 00000100:00100000:1.0:1772305914.706495:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305914.706543:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225368192 00000100:00100000:2.0:1772305914.706581:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 866 00000100:00100000:2.0:1772305914.706588:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002aca8cc4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+74:97546:x1858396225368192:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1772305914.706789:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002aca8cc4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+74:97546:x1858396225368192:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 201us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305914.706798:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 866 00000100:00100000:1.0:1772305914.707562:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305914.707592:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225368256 00000100:00100000:0.0:1772305914.707674:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 867 00000100:00100000:0.0:1772305914.707683:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009692b1d6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+74:97546:x1858396225368256:12345-192.168.203.30@tcp:501:chlg_load_threa.0 00000100:00100000:0.0:1772305914.707740:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009692b1d6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+74:97546:x1858396225368256:12345-192.168.203.30@tcp:501:chlg_load_threa.0 Request processed in 58us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305914.707749:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 867 00000100:00100000:2.0:1772305914.708325:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305914.708350:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225368320 00000100:00100000:3.0:1772305914.708375:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 868 00000100:00100000:3.0:1772305914.708380:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004ab5c349 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+74:97546:x1858396225368320:12345-192.168.203.30@tcp:503:chlg_load_threa.0 00000100:00100000:3.0:1772305914.708470:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004ab5c349 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+74:97546:x1858396225368320:12345-192.168.203.30@tcp:503:chlg_load_threa.0 Request processed in 74us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305914.708477:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 868 00000100:00100000:2.0:1772305914.709096:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305914.709120:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225368384 00000100:00100000:3.0:1772305914.709144:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 869 00000100:00100000:3.0:1772305914.709202:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000034cdda9e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+74:97546:x1858396225368384:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1772305914.709305:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000034cdda9e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+74:97546:x1858396225368384:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 103us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305914.709311:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 869 00000100:00100000:0.0:1772305914.709948:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305914.709972:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225368448 00000100:00100000:3.0:1772305914.709999:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 870 00000100:00100000:3.0:1772305914.710010:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000036f569f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+74:97546:x1858396225368448:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1772305914.710087:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000036f569f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+74:97546:x1858396225368448:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 77us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305914.710093:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 870 00000100:00100000:2.0:1772305914.733508:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305914.733621:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225368512 00000100:00100000:3.0:1772305914.733695:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 871 00000100:00100000:3.0:1772305914.733701:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000269f4b78 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+74:97554:x1858396225368512:12345-192.168.203.30@tcp:501:chlg_load_threa.0 00000100:00100000:3.0:1772305914.733831:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000269f4b78 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+74:97554:x1858396225368512:12345-192.168.203.30@tcp:501:chlg_load_threa.0 Request processed in 129us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305914.733837:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 871 00000100:00100000:2.0:1772305914.734491:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305914.734530:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225368576 00000100:00100000:3.0:1772305914.734560:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 872 00000100:00100000:3.0:1772305914.734566:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b975fc8d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+74:97554:x1858396225368576:12345-192.168.203.30@tcp:503:chlg_load_threa.0 00000100:00100000:3.0:1772305914.734748:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b975fc8d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+74:97554:x1858396225368576:12345-192.168.203.30@tcp:503:chlg_load_threa.0 Request processed in 182us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305914.734754:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 872 00000100:00100000:0.0:1772305914.735361:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305914.735389:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225368640 00000100:00100000:3.0:1772305914.735446:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 873 00000100:00100000:3.0:1772305914.735450:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e9e81c30 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+74:97554:x1858396225368640:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1772305914.735579:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e9e81c30 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+74:97554:x1858396225368640:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 127us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305914.735585:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 873 00000100:00100000:2.0:1772305914.736148:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305914.736176:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225368704 00000100:00100000:3.0:1772305914.736200:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 874 00000100:00100000:3.0:1772305914.736213:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000f39354b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+74:97554:x1858396225368704:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1772305914.736313:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000f39354b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+74:97554:x1858396225368704:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 100us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305914.736318:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 874 00000100:00100000:2.0:1772305914.736996:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305914.737027:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225368768 00000100:00100000:3.0:1772305914.737049:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 875 00000100:00100000:3.0:1772305914.737052:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000004473942 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+74:97554:x1858396225368768:12345-192.168.203.30@tcp:501:chlg_load_threa.0 00000100:00100000:3.0:1772305914.737088:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000004473942 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+74:97554:x1858396225368768:12345-192.168.203.30@tcp:501:chlg_load_threa.0 Request processed in 35us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305914.737093:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 875 00000100:00100000:0.0:1772305914.737687:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305914.737713:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225368832 00000100:00100000:3.0:1772305914.737735:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 876 00000100:00100000:3.0:1772305914.737738:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fd7b4ff5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+74:97554:x1858396225368832:12345-192.168.203.30@tcp:503:chlg_load_threa.0 00000100:00100000:3.0:1772305914.737799:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fd7b4ff5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+74:97554:x1858396225368832:12345-192.168.203.30@tcp:503:chlg_load_threa.0 Request processed in 60us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305914.737805:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 876 00000100:00100000:2.0:1772305914.738523:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305914.738558:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225368896 00000100:00100000:3.0:1772305914.738646:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 877 00000100:00100000:3.0:1772305914.738652:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006121cd31 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+74:97554:x1858396225368896:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1772305914.738737:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006121cd31 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+74:97554:x1858396225368896:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 85us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305914.738742:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 877 00000100:00100000:2.0:1772305914.739363:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305914.739389:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225368960 00000100:00100000:3.0:1772305914.739410:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 878 00000100:00100000:3.0:1772305914.739419:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000601911f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+74:97554:x1858396225368960:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1772305914.739496:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000601911f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+74:97554:x1858396225368960:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 77us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305914.739502:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 878 00000100:00100000:0.0:1772305914.791619:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305914.791755:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225369024 00000100:00100000:3.0:1772305914.791798:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 879 00000100:00100000:3.0:1772305914.791804:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004ebc4db7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+52:97564:x1858396225369024:12345-192.168.203.30@tcp:101:mv.0 00010000:00010000:3.0:1772305914.791827:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305914.791845:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6f3fc lrc: 2/0,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196eede expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.791893:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f403 lrc: 3/1,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.791904:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f403 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.791912:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f403 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.791922:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f40a lrc: 3/1,0 mode: --/PR res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.791927:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f40a lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.791931:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f40a lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.792021:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000d6b71f01/0xa5e9c8c58c6f411 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x328:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.792027:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d6b71f01/0xa5e9c8c58c6f411 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x328:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.792032:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d6b71f01/0xa5e9c8c58c6f411 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x328:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1772305914.792057:0:54698:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x328:0x0]: returning size 1516 00000004:00200000:3.0:1772305914.792061:0:54698:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1772305914.792081:0:54698:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000d6b71f01/0xa5e9c8c58c6f411 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x328:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.792088:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d6b71f01/0xa5e9c8c58c6f411 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x328:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.792094:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f403 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.792098:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f403 lrc: 2/0,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.792102:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f403 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.792106:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000099c1b7e6 already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305914.792108:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f403 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.792121:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f403 lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.792130:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8c:0x0].0x0 (0000000021d5f76c) 00010000:00010000:3.0:1772305914.792132:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305914.792135:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f403 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.792139:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f403 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.792149:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f40a lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.792152:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f40a lrc: 2/0,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.792155:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f40a lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.792159:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002f753c58 already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305914.792160:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f40a lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.792163:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f40a lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.792167:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8c:0x0].0xf629a772 (00000000fbf2c1ae) 00010000:00010000:3.0:1772305914.792168:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305914.792173:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f40a lrc: 2/0,0 mode: --/PR res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.792177:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f40a lrc: 0/0,0 mode: --/PR res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.792199:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6f3fc lrc: 0/0,0 mode: --/CR res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eede expref: 54 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.792207:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000d6b71f01/0xa5e9c8c58c6f411 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x328:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eede expref: 53 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.792212:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x328:0x0].0x0 (0000000045f3282f) 00010000:00010000:3.0:1772305914.792213:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1772305914.792215:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6b71f01, rc 0) 00000100:00100000:3.0:1772305914.792263:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004ebc4db7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+53:97564:x1858396225369024:12345-192.168.203.30@tcp:101:mv.0 Request processed in 459us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305914.792268:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 879 00000100:00100000:2.0:1772305914.793808:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305914.793871:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225369088 00000100:00100000:1.0:1772305914.793907:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5723 00000100:00100000:1.0:1772305914.793913:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000018743e89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+140:2216:x1858396225369088:12345-192.168.203.30@tcp:101:mv.0 00010000:00010000:1.0:1772305914.793925:0:6307:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305914.793939:0:6307:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000295bd7c/0xa5e9c8c58c6f418 lrc: 2/0,0 mode: --/PR res: [0x1ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196eee5 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305914.793955:0:6307:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305914.793957:0:6307:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305914.793962:0:6307:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000295bd7c/0xa5e9c8c58c6f418 lrc: 3/0,0 mode: PR/PR res: [0x1ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eee5 expref: 141 pid: 6307 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1772305914.793973:0:6307:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000295bd7c/0xa5e9c8c58c6f418 lrc: 3/0,0 mode: PR/PR res: [0x1ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eee5 expref: 141 pid: 6307 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1772305914.793982:0:6307:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000295bd7c, rc 0) 00000100:00100000:1.0:1772305914.794011:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000018743e89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+141:2216:x1858396225369088:12345-192.168.203.30@tcp:101:mv.0 Request processed in 99us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305914.794019:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5723 00000100:00100000:2.0:1772305914.795082:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305914.795130:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225369152 00000100:00100000:1.0:1772305914.795155:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5724 00000100:00100000:1.0:1772305914.795159:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000ad6883e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+162:2215:x1858396225369152:12345-192.168.203.30@tcp:101:mv.0 00010000:00010000:1.0:1772305914.795167:0:6307:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305914.795177:0:6307:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6f41f lrc: 2/0,0 mode: --/PR res: [0x1ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196eeec expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305914.795226:0:6307:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004c9f0c35 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6307:1858396216602944:192.168.203.30@tcp:106: 00000100:00100000:1.0:1772305914.795269:0:6307:0:(client.c:2500:ptlrpc_set_wait()) set 0000000046fc67c3 going to sleep for 6 seconds 00002000:00010000:1.0:1772305914.796078:0:6307:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x1ae:0x0:0x0] updating lvb size: 0 -> 1516 00002000:00010000:1.0:1772305914.796081:0:6307:0:(ofd_lvb.c:284:ofd_lvbo_update()) res: [0x1ae:0x0:0x0] updating lvb mtime: 0 -> 1772305910 00002000:00010000:1.0:1772305914.796083:0:6307:0:(ofd_lvb.c:290:ofd_lvbo_update()) res: [0x1ae:0x0:0x0] updating lvb atime: 0 -> 1772305910 00002000:00010000:1.0:1772305914.796084:0:6307:0:(ofd_lvb.c:296:ofd_lvbo_update()) res: [0x1ae:0x0:0x0] updating lvb ctime: 0 -> 1772305910 00000100:00100000:1.0:1772305914.796100:0:6307:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004c9f0c35 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6307:1858396216602944:192.168.203.30@tcp:106: 00010000:00010000:1.0:1772305914.796123:0:6307:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6f41f lrc: 1/0,0 mode: --/PR res: [0x1ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eeec expref: 163 pid: 6307 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1772305914.796135:0:6307:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6f41f lrc: 0/0,0 mode: --/PR res: [0x1ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eeec expref: 163 pid: 6307 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1772305914.796148:0:6307:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000048d87789, rc 0) 00000100:00100000:1.0:1772305914.796183:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000ad6883e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+162:2215:x1858396225369152:12345-192.168.203.30@tcp:101:mv.0 Request processed in 1022us (1102us total) trans 0 rc 301/301 00000100:00100000:1.0:1772305914.796191:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5724 00000100:00100000:2.0:1772305914.797433:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305914.797487:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225369280 00000100:00100000:3.0:1772305914.797524:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 880 00000100:00100000:3.0:1772305914.797530:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000556f98b0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+53:97564:x1858396225369280:12345-192.168.203.30@tcp:36:mv.0 00010000:00010000:3.0:1772305914.797569:0:54698:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1772305914.797586:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c6f37e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x327:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eead expref: 53 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.797597:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x327:0x0].0x0 (00000000c10a8182) 00010000:00010000:3.0:1772305914.797603:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d6b71f01/0xa5e9c8c58c6f411 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x328:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eede expref: 52 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.797644:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x328:0x0].0x0 (0000000045f3282f) 00010000:00010000:3.0:1772305914.797647:0:54698:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1772305914.797666:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f426 lrc: 3/0,1 mode: --/CW res: [0x200000408:0x8c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.797676:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f426 lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.797683:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f426 lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.797697:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d02430e8/0xa5e9c8c58c6f42d lrc: 3/0,1 mode: --/PW res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.797705:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d02430e8/0xa5e9c8c58c6f42d lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.797712:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d02430e8/0xa5e9c8c58c6f42d lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.797734:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6f434 lrc: 3/0,1 mode: --/PW res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.797742:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6f434 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.797749:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6f434 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.797889:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6f43b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x328:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.797901:0:54698:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6f2b3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x328:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee59 expref: 73 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.797909:0:54698:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6f2c8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x328:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee60 expref: 73 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.797916:0:54698:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6f43b lrc: 5/0,1 mode: --/EX res: [0x200000402:0x328:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.797940:0:54698:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6f2c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x328:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee60 expref: 73 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.797963:0:54698:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6f2c8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x328:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee60 expref: 73 pid: 54697 timeout: 1326 lvb_type: 0 00000100:00100000:3.0:1772305914.797975:0:54698:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008066f4bf pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:54698:1858396216603008:192.168.203.30@tcp:104: 00010000:00010000:3.0:1772305914.798025:0:54698:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6f2b3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x328:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee59 expref: 73 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.798034:0:54698:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6f2b3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x328:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee59 expref: 73 pid: 54697 timeout: 1326 lvb_type: 0 00000100:00100000:3.0:1772305914.798044:0:54698:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f9492fe6 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:54698:1858396216603072:192.168.203.30@tcp:104: 00000100:00100000:3.0:1772305914.798071:0:54698:0:(client.c:2500:ptlrpc_set_wait()) set 000000000f75287c going to sleep for 6 seconds 00000100:00100000:3.0:1772305914.798899:0:54698:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008066f4bf pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:54698:1858396216603008:192.168.203.30@tcp:104: 00000100:00100000:3.0:1772305914.798911:0:54698:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f9492fe6 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:54698:1858396216603072:192.168.203.30@tcp:104: 00010000:00010000:3.0:1772305914.798926:0:54698:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6f43b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x328:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305914.799182:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305914.799207:0:5494:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225369344 00010000:00010000:3.0:1772305914.799224:0:5494:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6f2c8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x328:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee60 expref: 74 pid: 54697 timeout: 1326 lvb_type: 0 00000100:00100000:2.0:1772305914.799238:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305914.799261:0:5494:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225369408 00010000:00010000:3.0:1772305914.799273:0:5494:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6f2b3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x328:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee59 expref: 75 pid: 54697 timeout: 1326 lvb_type: 0 00000100:00100000:1.0:1772305914.799287:0:16126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3089 00000100:00100000:1.0:1772305914.799295:0:16126:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c60a4162 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+75:2216:x1858396225369344:12345-192.168.203.30@tcp:103:ldlm_bl_07.0 00010000:00010000:1.0:1772305914.799308:0:16126:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1772305914.799318:0:16126:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6f2c8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x328:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee60 expref: 75 pid: 54697 timeout: 1326 lvb_type: 0 00000100:00100000:0.0:1772305914.799318:0:5493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3090 00000100:00100000:0.0:1772305914.799330:0:5493:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000026617907 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+75:2215:x1858396225369408:12345-192.168.203.30@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1772305914.799337:0:16126:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6f2c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x328:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee60 expref: 75 pid: 54697 timeout: 1326 lvb_type: 0 00010000:00010000:0.0:1772305914.799343:0:5493:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1772305914.799352:0:5493:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6f2b3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x328:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee59 expref: 75 pid: 54697 timeout: 1326 lvb_type: 0 00010000:00010000:1.0:1772305914.799361:0:16126:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6f2c8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x328:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee60 expref: 75 pid: 54697 timeout: 1326 lvb_type: 0 00010000:00010000:0.0:1772305914.799366:0:5493:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6f2b3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x328:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee59 expref: 75 pid: 54697 timeout: 1326 lvb_type: 0 00010000:00010000:1.0:1772305914.799388:0:16126:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x328:0x0].0x0 (0000000045f3282f) 00010000:00010000:0.0:1772305914.799388:0:5493:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c6f2b3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x328:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee59 expref: 74 pid: 54697 timeout: 1326 lvb_type: 0 00010000:00010000:1.0:1772305914.799396:0:16126:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6f43b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x328:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305914.799407:0:16126:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6f43b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x328:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305914.799414:0:16126:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6f43b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x328:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305914.799423:0:5493:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x328:0x0].0x0 (0000000045f3282f) 00010000:00010000:0.0:1772305914.799429:0:5493:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1772305914.799439:0:16126:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1772305914.799448:0:54698:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6f43b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x328:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.799468:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6f43b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x328:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305914.799475:0:5493:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000026617907 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+73:2215:x1858396225369408:12345-192.168.203.30@tcp:103:ldlm_bl_04.0 Request processed in 146us (239us total) trans 0 rc 0/0 00010000:00010000:3.0:1772305914.799484:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6f442 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x327:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305914.799492:0:16126:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c60a4162 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+73:2216:x1858396225369344:12345-192.168.203.30@tcp:103:ldlm_bl_07.0 Request processed in 189us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305914.799492:0:5493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3090 00010000:00010000:3.0:1772305914.799500:0:54698:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6f20b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x327:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee1a expref: 73 pid: 54697 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305914.799511:0:16126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3089 00010000:00010000:3.0:1772305914.799515:0:54698:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6f220 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x327:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee21 expref: 72 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.799524:0:54698:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6f442 lrc: 5/0,1 mode: --/EX res: [0x200000402:0x327:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.799550:0:54698:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6f220 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x327:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee21 expref: 71 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.799557:0:54698:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6f220 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x327:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee21 expref: 71 pid: 54697 timeout: 1326 lvb_type: 0 00000100:00100000:3.0:1772305914.799564:0:54698:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f9492fe6 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:54698:1858396216603136:192.168.203.30@tcp:104: 00010000:00010000:3.0:1772305914.799595:0:54698:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6f20b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x327:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee1a expref: 71 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.799601:0:54698:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6f20b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x327:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee1a expref: 71 pid: 54697 timeout: 1326 lvb_type: 0 00000100:00100000:3.0:1772305914.799607:0:54698:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008066f4bf pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:54698:1858396216603200:192.168.203.30@tcp:104: 00000100:00100000:3.0:1772305914.799748:0:54698:0:(client.c:2500:ptlrpc_set_wait()) set 000000000f75287c going to sleep for 6 seconds 00000100:00100000:3.0:1772305914.800525:0:54698:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f9492fe6 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:54698:1858396216603136:192.168.203.30@tcp:104: 00000100:00100000:3.0:1772305914.800536:0:54698:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008066f4bf pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:54698:1858396216603200:192.168.203.30@tcp:104: 00010000:00010000:3.0:1772305914.800548:0:54698:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6f442 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x327:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305914.800796:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305914.800837:0:16126:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225369472 00000100:00100000:2.0:1772305914.800851:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00010000:1.0:1772305914.800856:0:16126:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6f220 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x327:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee21 expref: 72 pid: 54697 timeout: 1326 lvb_type: 0 00000100:00100000:1.0:1772305914.800895:0:16126:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225369536 00010000:00010000:1.0:1772305914.800909:0:16126:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6f20b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x327:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee1a expref: 73 pid: 54697 timeout: 1326 lvb_type: 0 00000100:00100000:0.0:1772305914.800910:0:5493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3091 00000100:00100000:0.0:1772305914.800922:0:5493:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004295a2fe pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+73:2216:x1858396225369472:12345-192.168.203.30@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1772305914.800932:0:5493:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1772305914.800938:0:5493:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6f220 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x327:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee21 expref: 73 pid: 54697 timeout: 1326 lvb_type: 0 00000100:00100000:1.0:1772305914.800948:0:16126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3092 00010000:00010000:0.0:1772305914.800955:0:5493:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6f220 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x327:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee21 expref: 73 pid: 54697 timeout: 1326 lvb_type: 0 00000100:00100000:1.0:1772305914.800960:0:16126:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008d45073f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+73:2215:x1858396225369536:12345-192.168.203.30@tcp:103:ldlm_bl_08.0 00010000:00010000:1.0:1772305914.800977:0:16126:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1772305914.800980:0:5493:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c6f220 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x327:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee21 expref: 73 pid: 54697 timeout: 1326 lvb_type: 0 00010000:00010000:1.0:1772305914.800985:0:16126:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6f20b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x327:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee1a expref: 73 pid: 54697 timeout: 1326 lvb_type: 0 00010000:00010000:1.0:1772305914.801014:0:16126:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6f20b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x327:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee1a expref: 72 pid: 54697 timeout: 1326 lvb_type: 0 00010000:00010000:0.0:1772305914.801023:0:5493:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x327:0x0].0x0 (00000000c10a8182) 00010000:00010000:0.0:1772305914.801027:0:5493:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6f442 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x327:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305914.801036:0:5493:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6f442 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x327:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305914.801042:0:5493:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1772305914.801052:0:16126:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6f20b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x327:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee1a expref: 72 pid: 54697 timeout: 1326 lvb_type: 0 00010000:00010000:1.0:1772305914.801068:0:16126:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x327:0x0].0x0 (00000000c10a8182) 00010000:00010000:1.0:1772305914.801072:0:16126:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6f442 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x327:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305914.801073:0:5493:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004295a2fe pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+71:2216:x1858396225369472:12345-192.168.203.30@tcp:103:ldlm_bl_03.0 Request processed in 153us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305914.801088:0:5493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3091 00010000:00010000:1.0:1772305914.801089:0:16126:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6f442 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x327:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305914.801098:0:16126:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6f442 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x327:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305914.801125:0:16126:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1772305914.801136:0:54698:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6f442 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x327:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.801145:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6f442 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x327:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305914.801157:0:16126:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008d45073f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+70:2215:x1858396225369536:12345-192.168.203.30@tcp:103:ldlm_bl_08.0 Request processed in 199us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305914.801176:0:16126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3092 00000040:00080000:3.0:1772305914.801817:0:54698:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xd:0x0].11, 64 off8944 00000004:00080000:3.0:1772305914.801823:0:54698:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1226696194989ns, next at 1227696193514ns, rc = 0 00000040:00080000:3.0:1772305914.801842:0:54698:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x13:0x0].65, 240 off18920 00000004:00010000:3.0:1772305914.801920:0:54698:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000556f98b0 reply state 00000000fce7f795 transno 8589934862 ns: mdt-lustre-MDT0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6f442 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x327:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1772305914.801930:0:54698:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000556f98b0 reply state 00000000fce7f795 transno 8589934862 ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6f43b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x328:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1772305914.801940:0:54698:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000556f98b0 reply state 00000000fce7f795 transno 8589934862 ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6f434 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.801948:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f426 lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.801953:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f426 lrc: 2/0,0 mode: CW/CW res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.801957:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f426 lrc: 3/0,0 mode: CW/CW res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.801961:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000009fea887 already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305914.801963:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f426 lrc: 3/0,0 mode: CW/CW res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.801967:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f426 lrc: 4/0,0 mode: CW/CW res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.801983:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8c:0x0].0x0 (0000000021d5f76c) 00010000:00010000:3.0:1772305914.801985:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305914.801987:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f426 lrc: 2/0,0 mode: --/CW res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.801991:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f426 lrc: 0/0,0 mode: --/CW res: [0x200000408:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1772305914.801998:0:54698:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000556f98b0 reply state 00000000fce7f795 transno 8589934862 ns: mdt-lustre-MDT0000_UUID lock: 00000000d02430e8/0xa5e9c8c58c6f42d lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.802008:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f449 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x327:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.802014:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f449 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x327:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.802019:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f449 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x327:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.802023:0:54698:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f449 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x327:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.802027:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f449 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x327:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.802030:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f449 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x327:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305914.802044:0:54698:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1772305914.802072:0:5496:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1772305914.802078:0:5496:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f449 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x327:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305914.802089:0:5496:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002f753c58 already unused, calling callback (00000000b5e4f3c0) 00010000:00010000:1.0:1772305914.802092:0:5496:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f449 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x327:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305914.802099:0:5496:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f449 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x327:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305914.802111:0:5496:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x327:0x0].0x0 (00000000c10a8182) 00010000:00010000:1.0:1772305914.802114:0:5496:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00000100:00100000:3.0:1772305914.802117:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000556f98b0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+53:97564:x1858396225369280:12345-192.168.203.30@tcp:36:mv.0 Request processed in 4585us (4683us total) trans 8589934862 rc 0/0 00010000:00010000:1.0:1772305914.802118:0:5496:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f449 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x327:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305914.802129:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 880 00010000:00010000:1.0:1772305914.802135:0:5496:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f449 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x327:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305914.802149:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1772305914.802151:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1772305914.802153:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1772305914.802708:0:2977:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d02430e8/0xa5e9c8c58c6f42d lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305914.802717:0:2977:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d02430e8/0xa5e9c8c58c6f42d lrc: 2/0,0 mode: PW/PW res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305914.802729:0:2977:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d02430e8/0xa5e9c8c58c6f42d lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305914.802735:0:2977:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d02430e8 already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305914.802738:0:2977:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d02430e8/0xa5e9c8c58c6f42d lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305914.802744:0:2977:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d02430e8/0xa5e9c8c58c6f42d lrc: 4/0,0 mode: PW/PW res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305914.802754:0:2977:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8c:0x0].0xf629a772 (00000000ff843bf1) 00010000:00010000:1.0:1772305914.802757:0:2977:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305914.802759:0:2977:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d02430e8/0xa5e9c8c58c6f42d lrc: 2/0,0 mode: --/PW res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305914.802765:0:2977:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d02430e8/0xa5e9c8c58c6f42d lrc: 0/0,0 mode: --/PW res: [0x200000408:0x8c:0x0].0xf629a772 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305914.802779:0:2977:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6f434 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305914.802785:0:2977:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6f434 lrc: 2/0,0 mode: PW/PW res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305914.802791:0:2977:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6f434 lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305914.802796:0:2977:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d90d1abd already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305914.802799:0:2977:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6f434 lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305914.802805:0:2977:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6f434 lrc: 4/0,0 mode: PW/PW res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305914.802814:0:2977:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8c:0x0].0xfa5f3888 (000000005333691a) 00010000:00010000:1.0:1772305914.802816:0:2977:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305914.802818:0:2977:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6f434 lrc: 2/0,0 mode: --/PW res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305914.802825:0:2977:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6f434 lrc: 0/0,0 mode: --/PW res: [0x200000408:0x8c:0x0].0xfa5f3888 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305914.802836:0:2977:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6f43b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x328:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305914.802843:0:2977:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6f43b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x328:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305914.802848:0:2977:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6f43b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x328:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305914.802854:0:2977:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ca5be8d6 already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305914.802856:0:2977:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6f43b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x328:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305914.802862:0:2977:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6f43b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x328:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305914.802869:0:2977:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x328:0x0].0x0 (0000000045f3282f) 00010000:00010000:1.0:1772305914.802871:0:2977:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1772305914.802874:0:2977:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6f43b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x328:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305914.802879:0:2977:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6f43b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x328:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305914.802889:0:2977:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6f442 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x327:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305914.802894:0:2977:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6f442 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x327:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305914.802900:0:2977:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6f442 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x327:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305914.802905:0:2977:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cace9935 already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305914.802907:0:2977:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6f442 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x327:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305914.802913:0:2977:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6f442 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x327:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305914.802921:0:2977:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x327:0x0].0x0 (00000000c10a8182) 00010000:00010000:1.0:1772305914.802924:0:2977:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1772305914.802926:0:2977:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6f442 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x327:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305914.802931:0:2977:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6f442 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x327:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305914.821756:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305914.821863:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225369600 00000100:00100000:3.0:1772305914.821920:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 881 00000100:00100000:3.0:1772305914.821928:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009811a663 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+70:97570:x1858396225369600:12345-192.168.203.30@tcp:501:chlg_load_threa.0 00000100:00100000:3.0:1772305914.822091:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009811a663 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+70:97570:x1858396225369600:12345-192.168.203.30@tcp:501:chlg_load_threa.0 Request processed in 162us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305914.822102:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 881 00000100:00100000:2.0:1772305914.822853:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305914.822905:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225369664 00000100:00100000:3.0:1772305914.822937:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 882 00000100:00100000:3.0:1772305914.822944:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000eb97fd71 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+70:97570:x1858396225369664:12345-192.168.203.30@tcp:503:chlg_load_threa.0 00000100:00100000:3.0:1772305914.823112:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000eb97fd71 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+70:97570:x1858396225369664:12345-192.168.203.30@tcp:503:chlg_load_threa.0 Request processed in 168us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305914.823121:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 882 00000100:00100000:2.0:1772305914.823845:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305914.823910:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225369728 00000100:00100000:3.0:1772305914.823932:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 883 00000100:00100000:3.0:1772305914.823935:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000018f22afe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+70:97570:x1858396225369728:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1772305914.824056:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000018f22afe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+70:97570:x1858396225369728:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 118us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305914.824065:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 883 00000100:00100000:2.0:1772305914.824698:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305914.824742:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225369792 00000100:00100000:3.0:1772305914.824776:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 884 00000100:00100000:3.0:1772305914.824782:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000804c4ec1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+70:97570:x1858396225369792:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1772305914.824915:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000804c4ec1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+70:97570:x1858396225369792:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 133us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305914.824925:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 884 00000100:00100000:2.0:1772305914.825659:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305914.825696:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225369856 00000100:00100000:0.0:1772305914.825776:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 885 00000100:00100000:0.0:1772305914.825785:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cb5c186d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+70:97570:x1858396225369856:12345-192.168.203.30@tcp:501:chlg_load_threa.0 00000100:00100000:0.0:1772305914.825844:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cb5c186d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+70:97570:x1858396225369856:12345-192.168.203.30@tcp:501:chlg_load_threa.0 Request processed in 60us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305914.825852:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 885 00000100:00100000:2.0:1772305914.826492:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305914.826544:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225369920 00000100:00100000:0.0:1772305914.826577:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 886 00000100:00100000:0.0:1772305914.826582:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000aeb0f39b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+70:97570:x1858396225369920:12345-192.168.203.30@tcp:503:chlg_load_threa.0 00000100:00100000:0.0:1772305914.826702:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000aeb0f39b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+70:97570:x1858396225369920:12345-192.168.203.30@tcp:503:chlg_load_threa.0 Request processed in 118us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305914.826710:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 886 00000100:00100000:2.0:1772305914.827518:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305914.827563:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225369984 00000100:00100000:0.0:1772305914.827585:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 887 00000100:00100000:0.0:1772305914.827594:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009965df7c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+70:97570:x1858396225369984:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1772305914.827724:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009965df7c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+70:97570:x1858396225369984:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 128us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305914.827732:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 887 00000100:00100000:2.0:1772305914.828803:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305914.828846:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225370048 00000100:00100000:0.0:1772305914.828868:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 888 00000100:00100000:0.0:1772305914.828871:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a584233c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+70:97570:x1858396225370048:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1772305914.828962:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a584233c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+70:97570:x1858396225370048:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 88us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305914.828970:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 888 00010000:00010000:3.0:1772305915.592806:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1772305915.871459:0:7114:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-OST0001: transno 4294968345 is committed 00000001:00080000:0.0:1772305915.875346:0:6332:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-OST0000: transno 4294968305 is committed 00000001:00080000:2.0:1772305915.877975:0:69322:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934861 is committed 00000004:00080000:2.0:1772305915.877982:0:69322:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000001:00080000:0.0:1772305915.877994:0:54724:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934856 is committed 00000001:00080000:2.0:1772305915.878012:0:69322:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934859 is committed 00000001:00080000:0.0:1772305915.878021:0:54724:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934862 is committed 00000004:00080000:0.0:1772305915.878027:0:54724:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 11 committed 00000001:00080000:0.0:1772305915.878047:0:54724:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934860 is committed 00000100:00100000:3.0:1772305915.878125:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001770c2e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216603328:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1772305915.878126:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008066f4bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216603264:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1772305915.878212:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305915.878245:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305915.878266:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216603264 00000100:00100000:3.0:1772305915.878296:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216603328 00000100:00100000:1.0:1772305915.878323:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5725 00000100:00100000:1.0:1772305915.878333:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000027e204b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216603264:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1772305915.878353:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5726 00002000:00080000:1.0:1772305915.878361:0:6307:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:429 count 1 00000100:00100000:0.0:1772305915.878364:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f9492fe6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216603328:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1772305915.878389:0:6307:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6f450 lrc: 3/0,1 mode: --/PW res: [0x1ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1772305915.878396:0:6306:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:430 count 1 00010000:00010000:1.0:1772305915.878409:0:6307:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e44a0294/0xa5e9c8c58c6f34d lrc: 2/0,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee9f expref: 224 pid: 6306 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1772305915.878417:0:6307:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000017162762/0xa5e9c8c58c6f3d9 lrc: 2/0,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eed7 expref: 161 pid: 6307 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1772305915.878422:0:6307:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305915.878423:0:6307:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305915.878428:0:6307:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6f450 lrc: 5/0,1 mode: --/PW res: [0x1ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305915.878428:0:6306:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004820b6c/0xa5e9c8c58c6f457 lrc: 3/0,1 mode: --/PW res: [0x1ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305915.878501:0:6306:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fd78dae3/0xa5e9c8c58c6f3bd lrc: 2/0,0 mode: PR/PR res: [0x1ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eec9 expref: 227 pid: 6307 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1772305915.878513:0:6306:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000295bd7c/0xa5e9c8c58c6f418 lrc: 2/0,0 mode: PR/PR res: [0x1ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eee5 expref: 140 pid: 6307 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1772305915.878519:0:6307:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000017162762/0xa5e9c8c58c6f3d9 lrc: 3/0,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eed7 expref: 161 pid: 6307 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1772305915.878543:0:6307:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000017162762/0xa5e9c8c58c6f3d9 lrc: 4/0,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eed7 expref: 161 pid: 6307 timeout: 1327 lvb_type: 1 00010000:00010000:0.0:1772305915.878544:0:6306:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305915.878548:0:6306:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305915.878552:0:6306:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004820b6c/0xa5e9c8c58c6f457 lrc: 5/0,1 mode: --/PW res: [0x1ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305915.878573:0:6307:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004c9f0c35 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6307:1858396216603392:192.168.203.30@tcp:104: 00010000:00010000:0.0:1772305915.878595:0:6306:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000295bd7c/0xa5e9c8c58c6f418 lrc: 3/0,0 mode: PR/PR res: [0x1ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eee5 expref: 140 pid: 6307 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1772305915.878611:0:6306:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000295bd7c/0xa5e9c8c58c6f418 lrc: 4/0,0 mode: PR/PR res: [0x1ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eee5 expref: 140 pid: 6307 timeout: 1327 lvb_type: 1 00010000:00010000:1.0:1772305915.878698:0:6307:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e44a0294/0xa5e9c8c58c6f34d lrc: 3/0,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee9f expref: 224 pid: 6306 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1772305915.878715:0:6307:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e44a0294/0xa5e9c8c58c6f34d lrc: 4/0,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee9f expref: 224 pid: 6306 timeout: 1327 lvb_type: 1 00000100:00100000:1.0:1772305915.878728:0:6307:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000002171660 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6307:1858396216603520:192.168.203.30@tcp:104: 00000100:00100000:0.0:1772305915.878735:0:6306:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000edb23783 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6306:1858396216603456:192.168.203.30@tcp:104: 00000100:00100000:1.0:1772305915.878753:0:6307:0:(client.c:2500:ptlrpc_set_wait()) set 00000000593953b5 going to sleep for 6 seconds 00010000:00010000:0.0:1772305915.878813:0:6306:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fd78dae3/0xa5e9c8c58c6f3bd lrc: 3/0,0 mode: PR/PR res: [0x1ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eec9 expref: 227 pid: 6307 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1772305915.878828:0:6306:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fd78dae3/0xa5e9c8c58c6f3bd lrc: 4/0,0 mode: PR/PR res: [0x1ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eec9 expref: 227 pid: 6307 timeout: 1327 lvb_type: 1 00000100:00100000:0.0:1772305915.878842:0:6306:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006f4c803f pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6306:1858396216603584:192.168.203.30@tcp:104: 00000100:00100000:0.0:1772305915.878877:0:6306:0:(client.c:2500:ptlrpc_set_wait()) set 000000007630f830 going to sleep for 6 seconds 00000100:00100000:3.0:1772305915.880163:0:6307:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004c9f0c35 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6307:1858396216603392:192.168.203.30@tcp:104: 00000100:00100000:3.0:1772305915.880185:0:6307:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000002171660 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6307:1858396216603520:192.168.203.30@tcp:104: 00000100:00100000:0.0:1772305915.880185:0:6306:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000edb23783 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6306:1858396216603456:192.168.203.30@tcp:104: 00000100:00100000:0.0:1772305915.880214:0:6306:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006f4c803f pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6306:1858396216603584:192.168.203.30@tcp:104: 00010000:00010000:3.0:1772305915.880220:0:6307:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6f450 lrc: 3/0,1 mode: --/PW res: [0x1ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305915.880243:0:6306:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000004820b6c/0xa5e9c8c58c6f457 lrc: 3/0,1 mode: --/PW res: [0x1ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305915.880675:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305915.880712:0:16126:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225370176 00000100:00100000:2.0:1772305915.880721:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00010000:1.0:1772305915.880736:0:16126:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fd78dae3/0xa5e9c8c58c6f3bd lrc: 4/0,0 mode: PR/PR res: [0x1ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eec9 expref: 228 pid: 6307 timeout: 1327 lvb_type: 1 00000100:00100000:2.0:1772305915.880777:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305915.880780:0:16126:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225370304 00010000:00010000:1.0:1772305915.880790:0:16126:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e44a0294/0xa5e9c8c58c6f34d lrc: 4/0,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee9f expref: 225 pid: 6306 timeout: 1327 lvb_type: 1 00000100:00100000:0.0:1772305915.880800:0:5493:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225370112 00010000:00010000:0.0:1772305915.880828:0:5493:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000017162762/0xa5e9c8c58c6f3d9 lrc: 4/0,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eed7 expref: 162 pid: 6307 timeout: 1327 lvb_type: 1 00000100:00100000:1.0:1772305915.880846:0:16126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3093 00000100:00100000:1.0:1772305915.880861:0:16126:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cc2949c6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+228:2217:x1858396225370176:12345-192.168.203.30@tcp:103:ldlm_bl_04.0 00000100:00100000:2.0:1772305915.880864:0:6323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3094 00010000:00010000:1.0:1772305915.880871:0:16126:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1772305915.880878:0:16126:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fd78dae3/0xa5e9c8c58c6f3bd lrc: 4/0,0 mode: PR/PR res: [0x1ae:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eec9 expref: 228 pid: 6307 timeout: 1327 lvb_type: 1 00000100:00100000:2.0:1772305915.880879:0:6323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fbb012e1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+225:2217:x1858396225370304:12345-192.168.203.30@tcp:103:ldlm_bl_06.0 00000100:00100000:3.0:1772305915.880892:0:5494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3095 00000100:00100000:3.0:1772305915.880906:0:5494:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000026617907 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+162:2216:x1858396225370112:12345-192.168.203.30@tcp:103:ldlm_bl_05.0 00010000:00010000:1.0:1772305915.880912:0:16126:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fd78dae3/0xa5e9c8c58c6f3bd lrc: 3/0,0 mode: PR/PR res: [0x1ae:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eec9 expref: 228 pid: 6307 timeout: 1327 lvb_type: 1 00010000:00010000:2.0:1772305915.880914:0:6323:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1772305915.880919:0:5494:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1772305915.880929:0:6323:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e44a0294/0xa5e9c8c58c6f34d lrc: 4/0,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee9f expref: 225 pid: 6306 timeout: 1327 lvb_type: 1 00010000:00010000:3.0:1772305915.880932:0:5494:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000017162762/0xa5e9c8c58c6f3d9 lrc: 4/0,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eed7 expref: 162 pid: 6307 timeout: 1327 lvb_type: 1 00010000:00010000:1.0:1772305915.880956:0:16126:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd78dae3/0xa5e9c8c58c6f3bd lrc: 0/0,0 mode: --/PR res: [0x1ae:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eec9 expref: 228 pid: 6307 timeout: 1327 lvb_type: 1 00010000:00010000:1.0:1772305915.880984:0:16126:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1772305915.881009:0:5494:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000017162762/0xa5e9c8c58c6f3d9 lrc: 3/0,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eed7 expref: 162 pid: 6307 timeout: 1327 lvb_type: 1 00000100:00100000:1.0:1772305915.881024:0:16126:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cc2949c6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2217:x1858396225370176:12345-192.168.203.30@tcp:103:ldlm_bl_04.0 Request processed in 167us (394us total) trans 0 rc 0/0 00010000:00010000:2.0:1772305915.881029:0:6323:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e44a0294/0xa5e9c8c58c6f34d lrc: 3/0,0 mode: PR/PR res: [0x1ad:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee9f expref: 225 pid: 6306 timeout: 1327 lvb_type: 1 00000100:00100000:1.0:1772305915.881042:0:16126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3093 00010000:00010000:3.0:1772305915.881080:0:5494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017162762/0xa5e9c8c58c6f3d9 lrc: 0/0,0 mode: --/PR res: [0x1ad:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eed7 expref: 162 pid: 6307 timeout: 1327 lvb_type: 1 00010000:00010000:2.0:1772305915.881092:0:6323:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e44a0294/0xa5e9c8c58c6f34d lrc: 0/0,0 mode: --/PR res: [0x1ad:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee9f expref: 225 pid: 6306 timeout: 1327 lvb_type: 1 00010000:00010000:3.0:1772305915.881114:0:5494:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1772305915.881117:0:5494:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1772305915.881120:0:5494:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6f450 lrc: 3/0,1 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305915.881127:0:5494:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6f450 lrc: 4/0,1 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305915.881135:0:6323:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1772305915.881147:0:5494:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1772305915.881165:0:6307:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6f450 lrc: 3/0,1 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305915.881172:0:6323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fbb012e1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+224:2217:x1858396225370304:12345-192.168.203.30@tcp:103:ldlm_bl_06.0 Request processed in 290us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305915.881184:0:5494:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000026617907 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+161:2216:x1858396225370112:12345-192.168.203.30@tcp:103:ldlm_bl_05.0 Request processed in 270us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305915.881216:0:6323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3094 00010000:00010000:1.0:1772305915.881217:0:6307:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6f450 lrc: 3/0,1 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305915.881231:0:5494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3095 00010000:00010000:1.0:1772305915.881241:0:6307:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6f450 lrc: 3/0,1 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305915.881248:0:6307:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6f450 lrc: 2/0,0 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305915.881268:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00010000:1.0:1772305915.881273:0:6307:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1772305915.881293:0:5495:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225370240 00010000:00010000:0.0:1772305915.881304:0:5497:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1772305915.881313:0:5497:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6f450 lrc: 2/0,0 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305915.881314:0:5495:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000295bd7c/0xa5e9c8c58c6f418 lrc: 4/0,0 mode: PR/PR res: [0x1ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eee5 expref: 141 pid: 6307 timeout: 1327 lvb_type: 1 00010000:00010000:0.0:1772305915.881334:0:5497:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000748ac5ea already unused, calling callback (00000000b5e4f3c0) 00010000:00010000:0.0:1772305915.881340:0:5497:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6f450 lrc: 2/0,0 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305915.881349:0:5497:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6f450 lrc: 3/0,0 mode: PW/PW res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305915.881357:0:5495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3096 00000100:00100000:3.0:1772305915.881363:0:5495:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c60a4162 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+141:2216:x1858396225370240:12345-192.168.203.30@tcp:103:ldlm_bl_05.0 00010000:00010000:0.0:1772305915.881365:0:5497:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6f450 lrc: 1/0,0 mode: --/PW res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305915.881371:0:5495:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1772305915.881372:0:5497:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c6f450 lrc: 0/0,0 mode: --/PW res: [0x1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305915.881377:0:5495:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000295bd7c/0xa5e9c8c58c6f418 lrc: 4/0,0 mode: PR/PR res: [0x1ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eee5 expref: 141 pid: 6307 timeout: 1327 lvb_type: 1 00010000:00010000:3.0:1772305915.881389:0:5495:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000295bd7c/0xa5e9c8c58c6f418 lrc: 3/0,0 mode: PR/PR res: [0x1ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eee5 expref: 141 pid: 6307 timeout: 1327 lvb_type: 1 00010000:00010000:0.0:1772305915.881393:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1772305915.881395:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1772305915.881396:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1772305915.881440:0:5495:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000295bd7c/0xa5e9c8c58c6f418 lrc: 0/0,0 mode: --/PR res: [0x1ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eee5 expref: 141 pid: 6307 timeout: 1327 lvb_type: 1 00010000:00010000:3.0:1772305915.881470:0:5495:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1772305915.881472:0:5495:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1772305915.881475:0:5495:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000004820b6c/0xa5e9c8c58c6f457 lrc: 3/0,1 mode: PW/PW res: [0x1ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305915.881480:0:5495:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004820b6c/0xa5e9c8c58c6f457 lrc: 4/0,1 mode: PW/PW res: [0x1ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305915.881499:0:5495:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1772305915.881526:0:5495:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c60a4162 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+140:2216:x1858396225370240:12345-192.168.203.30@tcp:103:ldlm_bl_05.0 Request processed in 162us (258us total) trans 0 rc 0/0 00010000:00010000:0.0:1772305915.881526:0:6306:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000004820b6c/0xa5e9c8c58c6f457 lrc: 3/0,1 mode: PW/PW res: [0x1ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305915.881540:0:5495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3096 00010000:00010000:0.0:1772305915.881556:0:6306:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004820b6c/0xa5e9c8c58c6f457 lrc: 3/0,1 mode: PW/PW res: [0x1ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305915.881568:0:6306:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004820b6c/0xa5e9c8c58c6f457 lrc: 3/0,1 mode: PW/PW res: [0x1ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305915.881577:0:6306:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004820b6c/0xa5e9c8c58c6f457 lrc: 2/0,0 mode: PW/PW res: [0x1ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305915.881607:0:6306:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1772305915.881678:0:6322:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1772305915.881685:0:6322:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004820b6c/0xa5e9c8c58c6f457 lrc: 2/0,0 mode: PW/PW res: [0x1ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305915.881695:0:6322:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000004820b6c already unused, calling callback (00000000b5e4f3c0) 00010000:00010000:2.0:1772305915.881697:0:6322:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004820b6c/0xa5e9c8c58c6f457 lrc: 2/0,0 mode: PW/PW res: [0x1ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305915.881705:0:6322:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004820b6c/0xa5e9c8c58c6f457 lrc: 3/0,0 mode: PW/PW res: [0x1ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305915.881723:0:6322:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004820b6c/0xa5e9c8c58c6f457 lrc: 1/0,0 mode: --/PW res: [0x1ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305915.881728:0:6322:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004820b6c/0xa5e9c8c58c6f457 lrc: 0/0,0 mode: --/PW res: [0x1ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305915.881746:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1772305915.881749:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1772305915.881751:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772305915.882030:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000027e204b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:2991:x1858396216603264:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3694us (3815us total) trans 4294968306 rc 0/0 00000100:00100000:1.0:1772305915.882043:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5725 00000004:00080000:2.0:1772305915.882057:0:2991:0:(osp_sync.c:563:osp_sync_interpret()) reply req 000000008066f4bf/2, rc 0, transno 1010 00000100:00100000:2.0:1772305915.882070:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008066f4bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216603264:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1772305915.882326:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f9492fe6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:2992:x1858396216603328:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3964us (4084us total) trans 4294968346 rc 0/0 00000100:00100000:0.0:1772305915.882337:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5726 00000004:00080000:2.0:1772305915.882349:0:2992:0:(osp_sync.c:563:osp_sync_interpret()) reply req 000000001770c2e6/2, rc 0, transno 1050 00000100:00100000:2.0:1772305915.882356:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001770c2e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216603328:0@lo:6:osp-syn-1-0.0 00000040:00080000:1.0:1772305915.976769:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305915.976775:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00100000:1.0:1772305915.976814:0:54732:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 26 in log [0xf:0x1:0x0] 00000040:00100000:1.0:1772305915.976917:0:54732:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 27 in log [0xf:0x1:0x0] 00000040:00100000:1.0:1772305915.976940:0:54732:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 28 in log [0xf:0x1:0x0] 00000040:00080000:1.0:1772305915.976964:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 39 count 11 00000040:00080000:1.0:1772305915.976971:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:2.0:1772305916.360826:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003847e69c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216603712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1772305916.360834:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006f4c803f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216603648:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1772305916.360915:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772305916.360957:0:6310:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216603648 00000100:00100000:0.0:1772305916.360966:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305916.361021:0:7591:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216603712 00000100:00100000:2.0:1772305916.361027:0:6310:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453 00000100:00100000:2.0:1772305916.361036:0:6310:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006d6f2aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:2994:x1858396216603648:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1772305916.361057:0:7591:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 454 00000100:00100000:3.0:1772305916.361063:0:7591:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000edb23783 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:2993:x1858396216603712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1772305916.361080:0:6310:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 1703936 granted 742326272 pending 0 free 3829399552 avail 3827302400 00002000:00000024:3.0:1772305916.361088:0:7591:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 693174272 pending 0 free 3606052864 avail 3603955712 00000100:00100000:2.0:1772305916.361136:0:6310:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006d6f2aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:2994:x1858396216603648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305916.361147:0:7591:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000edb23783 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:2993:x1858396216603712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305916.361148:0:6310:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453 00000100:00100000:3.0:1772305916.361157:0:7591:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 454 00000100:00100000:0.0:1772305916.361191:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003847e69c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216603712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1772305916.361194:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006f4c803f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216603648:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1772305916.617720:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1772305916.755319:0:69848:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1772305916.755325:0:69848:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x11:0x1:0x0]:0 at index 1 of catalog [0x6:0xa:0x0] 00000040:00080000:2.0:1772305916.755353:0:69848:0:(llog.c:789:llog_process_thread()) stop processing plain 0x11:1:0 index 13 count 2 00000040:00080000:2.0:1772305916.755358:0:69848:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x6:10:0 index 2 count 2 00000100:00100000:0.0:1772305916.771811:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305916.771862:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225370368 00000100:00100000:3.0:1772305916.771931:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 889 00000100:00100000:3.0:1772305916.771939:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b7808eb8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+64:98006:x1858396225370368:12345-192.168.203.30@tcp:46:lfs.0 00000004:00000080:3.0:1772305916.771993:0:55653:0:(mdt_handler.c:7411:mdt_iocontrol()) handling ioctl cmd 0x424066b3 00000004:00000080:3.0:1772305916.772044:0:55653:0:(mdd_device.c:2125:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=12, endrec=0 00000040:00080000:3.0:1772305916.772135:0:55653:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1772305916.772138:0:55653:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x11:0x1:0x0]:0 at index 1 of catalog [0x6:0xa:0x0] 00000004:00000080:3.0:1772305916.772181:0:55653:0:(mdd_device.c:2095:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl12 endrec = 64 00000040:00080000:3.0:1772305916.772281:0:55653:0:(llog.c:789:llog_process_thread()) stop processing plain 0x11:1:0 index 13 count 2 00000040:00080000:3.0:1772305916.772287:0:55653:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x6:10:0 index 2 count 2 00000004:00000080:3.0:1772305916.772292:0:55653:0:(mdd_device.c:2173:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl12 entries up to 18446744073709551615 00000040:00080000:3.0:1772305916.772323:0:55653:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1772305916.772325:0:55653:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x13:0x1:0x0]:0 at index 1 of catalog [0x5:0xa:0x0] 00000040:00100000:3.0:1772305916.772368:0:55653:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 58 in log [0x13:0x1:0x0] 00000040:00100000:3.0:1772305916.772467:0:55653:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 59 in log [0x13:0x1:0x0] 00000040:00100000:3.0:1772305916.772503:0:55653:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 60 in log [0x13:0x1:0x0] 00000040:00100000:3.0:1772305916.772525:0:55653:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 61 in log [0x13:0x1:0x0] 00000040:00100000:3.0:1772305916.772555:0:55653:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 62 in log [0x13:0x1:0x0] 00000040:00100000:3.0:1772305916.772599:0:55653:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 63 in log [0x13:0x1:0x0] 00000040:00100000:3.0:1772305916.772680:0:55653:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 64 in log [0x13:0x1:0x0] 00000040:00100000:3.0:1772305916.772728:0:55653:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 65 in log [0x13:0x1:0x0] 00000040:00080000:3.0:1772305916.772754:0:55653:0:(llog.c:789:llog_process_thread()) stop processing plain 0x13:1:0 index 65 count 1 00000040:00080000:3.0:1772305916.772758:0:55653:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x5:10:0 index 2 count 2 00000100:00100000:3.0:1772305916.772865:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b7808eb8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+64:98006:x1858396225370368:12345-192.168.203.30@tcp:46:lfs.0 Request processed in 926us (1059us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305916.772873:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 889 00000100:00100000:3.0:1772305916.872831:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000004c96b79 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:2992:1858396216603840:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1772305916.872838:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d8dbdab2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:70aae467-c860-409f-ba1b-742f4d042da6:2991:1858396216603776:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1772305916.872855:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e2fd14bd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:2993:1858396216603904:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1772305916.872864:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004d8ea70d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:2994:1858396216603968:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305916.872927:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305916.872929:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772305916.872974:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216603840 00000100:00100000:2.0:1772305916.872977:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216603776 00000100:00100000:3.0:1772305916.872994:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772305916.873025:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1772305916.873028:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216603904 00000100:00100000:2.0:1772305916.873036:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d086db0d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2991:x1858396216603776:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1772305916.873040:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1772305916.873049:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009531bf01 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:2992:x1858396216603840:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305916.873053:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772305916.873069:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216603968 00000100:00100000:0.0:1772305916.873096:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1772305916.873102:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002982a7a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:2993:x1858396216603904:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1772305916.873107:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009531bf01 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:2992:x1858396216603840:12345-0@lo:400:kworker/u8:0.0 Request processed in 57us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305916.873108:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d086db0d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2991:x1858396216603776:12345-0@lo:400:kworker/u8:0.0 Request processed in 70us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305916.873118:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1772305916.873118:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1772305916.873125:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1772305916.873133:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000100f06cf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:2994:x1858396216603968:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1772305916.873160:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002982a7a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:2993:x1858396216603904:12345-0@lo:400:kworker/u8:0.0 Request processed in 56us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305916.873170:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1772305916.873177:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d8dbdab2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:70aae467-c860-409f-ba1b-742f4d042da6:2991:1858396216603776:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1772305916.873179:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000004c96b79 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:2992:1858396216603840:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305916.873198:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000100f06cf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:2994:x1858396216603968:12345-0@lo:400:kworker/u8:0.0 Request processed in 62us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305916.873208:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1772305916.873230:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e2fd14bd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:2993:1858396216603904:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305916.873265:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004d8ea70d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:2994:1858396216603968:0@lo:400:kworker/u8:0.0 00000020:00000080:3.0:1772305917.057718:0:69896:0:(class_obd.c:302:class_handle_ioctl()) cmd = c008667f 00000020:00000080:3.0:1772305917.057725:0:69896:0:(class_obd.c:126:class_resolve_dev_name()) device name lustre-MDT0000 00000020:00000080:3.0:1772305917.057730:0:69896:0:(class_obd.c:133:class_resolve_dev_name()) device name lustre-MDT0000, dev 5 00000020:00000080:3.0:1772305917.057765:0:69896:0:(class_obd.c:302:class_handle_ioctl()) cmd = 424066b2 00000004:00000080:3.0:1772305917.057770:0:69896:0:(mdt_handler.c:7411:mdt_iocontrol()) handling ioctl cmd 0x424066b2 00000004:00000080:3.0:1772305917.057805:0:69896:0:(mdd_device.c:2125:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=12, endrec=0 00000040:00080000:3.0:1772305917.057863:0:69896:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1772305917.057866:0:69896:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x11:0x1:0x0]:0 at index 1 of catalog [0x6:0xa:0x0] 00000004:00000080:3.0:1772305917.057889:0:69896:0:(mdd_device.c:2095:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl12 endrec = 64 00000040:00080000:3.0:1772305917.057931:0:69896:0:(llog.c:789:llog_process_thread()) stop processing plain 0x11:1:0 index 13 count 2 00000040:00080000:3.0:1772305917.057936:0:69896:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x6:10:0 index 2 count 2 00000004:00000080:3.0:1772305917.057940:0:69896:0:(mdd_device.c:2173:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl12 entries up to 18446744073709551615 00000040:00080000:3.0:1772305917.057958:0:69896:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1772305917.057959:0:69896:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x13:0x1:0x0]:0 at index 1 of catalog [0x5:0xa:0x0] 00000040:00080000:3.0:1772305917.058349:0:69896:0:(llog.c:789:llog_process_thread()) stop processing plain 0x13:1:0 index 64768 count 1 00000040:00080000:3.0:1772305917.058354:0:69896:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x5:10:0 index 2 count 2 00000004:00000080:3.0:1772305917.058360:0:69896:0:(mdd_device.c:1983:mdd_changelog_user_purge()) lustre-MDD0000: Purge request: id=12 00000040:00080000:3.0:1772305917.058390:0:69896:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1772305917.058392:0:69896:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x11:0x1:0x0]:0 at index 1 of catalog [0x6:0xa:0x0] 00000040:00100000:3.0:1772305917.058417:0:69896:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 12 in log [0x11:0x1:0x0] 00000040:00080000:3.0:1772305917.058509:0:69896:0:(llog.c:789:llog_process_thread()) stop processing plain 0x11:1:0 index 12 count 1 00000040:00080000:3.0:1772305917.058513:0:69896:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x6:10:0 index 2 count 2 00000004:00000080:3.0:1772305917.058516:0:69896:0:(mdd_device.c:2005:mdd_changelog_user_purge()) turning off changelogs 00000004:02000000:3.0:1772305917.058517:0:69896:0:(mdd_device.c:483:mdd_changelog_off()) lustre-MDD0000: changelog off 00000004:00000080:3.0:1772305917.058519:0:69896:0:(mdd_device.c:2015:mdd_changelog_user_purge()) lustre-MDD0000: Purge changelog entries for user cl12 record=18446744073709551615 00000040:00080000:3.0:1772305917.058538:0:69896:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1772305917.058539:0:69896:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x13:0x1:0x0]:0 at index 1 of catalog [0x5:0xa:0x0] 00000040:00080000:3.0:1772305917.058995:0:69896:0:(llog.c:789:llog_process_thread()) stop processing plain 0x13:1:0 index 64768 count 1 00000040:00080000:3.0:1772305917.058998:0:69896:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x5:10:0 index 2 count 2 00000040:00080000:3.0:1772305917.059022:0:69896:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1772305917.059028:0:69896:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x11:0x1:0x0]:0 at index 1 of catalog [0x6:0xa:0x0] 00000040:00080000:3.0:1772305917.059383:0:69896:0:(llog.c:789:llog_process_thread()) stop processing plain 0x11:1:0 index 64768 count 1 00000040:00080000:3.0:1772305917.059385:0:69896:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x6:10:0 index 2 count 2 00000040:00080000:1.0:1772305917.353087:0:69944:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1772305917.353093:0:69944:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x11:0x1:0x0]:0 at index 1 of catalog [0x6:0xa:0x0] 00000040:00080000:1.0:1772305917.353471:0:69944:0:(llog.c:789:llog_process_thread()) stop processing plain 0x11:1:0 index 64768 count 1 00000040:00080000:1.0:1772305917.353479:0:69944:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x6:10:0 index 2 count 2 00000100:00100000:2.0:1772305917.384218:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305917.384275:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225370432 00000100:00100000:0.0:1772305917.384334:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 890 00000100:00100000:0.0:1772305917.384341:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e2fd14bd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+64:97453:x1858396225370432:12345-192.168.203.30@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1772305917.384463:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e2fd14bd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+64:97453:x1858396225370432:12345-192.168.203.30@tcp:60:lhsmtool_posix.0 Request processed in 122us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305917.384471:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 890 00010000:00010000:3.0:1772305917.640849:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:0.0:1772305917.928196:0:69992:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1772305917.928204:0:69992:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 227: changelog when explicit setting of HSM flags ========================================================== 14:11:57 (1772305917) 00000100:00100000:2.0:1772305917.955154:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305917.955226:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225370560 00000100:00100000:3.0:1772305917.955295:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 891 00000100:00100000:3.0:1772305917.955306:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d8dbdab2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+64:98181:x1858396225370560:12345-192.168.203.30@tcp:36:mkdir.0 00010000:00010000:3.0:1772305917.955513:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f45e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305917.955540:0:54698:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f307 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee83 expref: 49 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305917.955551:0:54698:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f45e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305917.955595:0:54698:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f307 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee83 expref: 49 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305917.955611:0:54698:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f307 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee83 expref: 49 pid: 54697 timeout: 1329 lvb_type: 0 00000100:00100000:3.0:1772305917.955695:0:54698:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029210a42 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:54698:1858396216604032:192.168.203.30@tcp:104: 00000100:00100000:3.0:1772305917.955783:0:54698:0:(client.c:2500:ptlrpc_set_wait()) set 000000003ad16ec9 going to sleep for 6 seconds 00000100:00100000:3.0:1772305917.956884:0:54698:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029210a42 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:54698:1858396216604032:192.168.203.30@tcp:104: 00010000:00010000:3.0:1772305917.956915:0:54698:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f45e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305917.956969:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305917.957044:0:5494:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225370624 00010000:00010000:3.0:1772305917.957078:0:5494:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f307 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee83 expref: 50 pid: 54697 timeout: 1329 lvb_type: 0 00000100:00100000:3.0:1772305917.957115:0:5494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3097 00000100:00100000:3.0:1772305917.957122:0:5494:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000faca0d01 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+50:2216:x1858396225370624:12345-192.168.203.30@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1772305917.957134:0:5494:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1772305917.957141:0:5494:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f307 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee83 expref: 50 pid: 54697 timeout: 1329 lvb_type: 0 00010000:00010000:3.0:1772305917.957152:0:5494:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f307 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee83 expref: 50 pid: 54697 timeout: 1329 lvb_type: 0 00010000:00010000:3.0:1772305917.957174:0:5494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f307 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ee83 expref: 50 pid: 54697 timeout: 1329 lvb_type: 0 00010000:00010000:3.0:1772305917.957189:0:5494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:3.0:1772305917.957193:0:5494:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f45e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305917.957203:0:5494:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f45e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305917.957211:0:5494:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f45e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305917.957236:0:5494:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1772305917.957271:0:54698:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f45e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305917.957279:0:5494:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000faca0d01 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+49:2216:x1858396225370624:12345-192.168.203.30@tcp:103:ldlm_bl_02.0 Request processed in 154us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305917.957294:0:5494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3097 00010000:00010000:2.0:1772305917.957298:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f45e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305917.957325:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000e44a0294/0xa5e9c8c58c6f465 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xef013f9f bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305917.957334:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e44a0294/0xa5e9c8c58c6f465 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef013f9f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305917.957343:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e44a0294/0xa5e9c8c58c6f465 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef013f9f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1772305917.958286:0:54698:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x329:0x0]: returning size 512 00010000:00010000:2.0:1772305917.958298:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f45e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305917.958308:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f45e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305917.958316:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f45e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305917.958323:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000009fea887 already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305917.958327:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f45e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305917.958334:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f45e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305917.958347:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:2.0:1772305917.958350:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305917.958353:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f45e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305917.958359:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f45e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1772305917.958372:0:54698:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000d8dbdab2 reply state 0000000015e9dc22 transno 8589934863 ns: mdt-lustre-MDT0000_UUID lock: 00000000e44a0294/0xa5e9c8c58c6f465 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef013f9f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305917.958466:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d8dbdab2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+66:98181:x1858396225370560:12345-192.168.203.30@tcp:36:mkdir.0 Request processed in 3161us (3320us total) trans 8589934863 rc 0/0 00000100:00100000:2.0:1772305917.958475:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 891 00010000:00010000:3.0:1772305917.959102:0:2978:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000e44a0294/0xa5e9c8c58c6f465 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef013f9f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305917.959114:0:2978:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e44a0294/0xa5e9c8c58c6f465 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xef013f9f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305917.959122:0:2978:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000e44a0294/0xa5e9c8c58c6f465 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xef013f9f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305917.959129:0:2978:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e44a0294 already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305917.959133:0:2978:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e44a0294/0xa5e9c8c58c6f465 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xef013f9f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305917.959140:0:2978:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e44a0294/0xa5e9c8c58c6f465 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xef013f9f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305917.959151:0:2978:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef013f9f (00000000e64b4432) 00010000:00010000:3.0:1772305917.959153:0:2978:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305917.959156:0:2978:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000e44a0294/0xa5e9c8c58c6f465 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xef013f9f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305917.959163:0:2978:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e44a0294/0xa5e9c8c58c6f465 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xef013f9f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305917.963362:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305917.963419:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225370688 00000100:00100000:2.0:1772305917.963483:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 892 00000100:00100000:2.0:1772305917.963490:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000039584847 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+65:98184:x1858396225370688:12345-192.168.203.30@tcp:101:rm.0 00010000:00010000:2.0:1772305917.963519:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305917.963549:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c6f46c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196eef3 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305917.963612:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000f8380462/0xa5e9c8c58c6f473 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305917.963643:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f8380462/0xa5e9c8c58c6f473 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305917.963655:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f8380462/0xa5e9c8c58c6f473 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305917.963668:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c6f47a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef013f9f bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305917.963674:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c6f47a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef013f9f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305917.963679:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c6f47a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef013f9f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305917.963785:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000dd30caad/0xa5e9c8c58c6f481 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x329:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305917.963794:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000dd30caad/0xa5e9c8c58c6f481 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x329:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305917.963803:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000dd30caad/0xa5e9c8c58c6f481 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x329:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1772305917.963855:0:54698:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x329:0x0]: returning size 512 00000004:00200000:2.0:1772305917.963860:0:54698:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1772305917.963887:0:54698:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000dd30caad/0xa5e9c8c58c6f481 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x329:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305917.963898:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000f8380462/0xa5e9c8c58c6f473 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305917.963904:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f8380462/0xa5e9c8c58c6f473 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305917.963909:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f8380462/0xa5e9c8c58c6f473 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305917.963914:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f8380462 already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305917.963918:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f8380462/0xa5e9c8c58c6f473 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305917.963922:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f8380462/0xa5e9c8c58c6f473 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305917.963930:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:2.0:1772305917.963932:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305917.963934:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f8380462/0xa5e9c8c58c6f473 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305917.963937:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f8380462/0xa5e9c8c58c6f473 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305917.963945:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c6f47a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef013f9f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305917.963949:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c6f47a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef013f9f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305917.963953:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c6f47a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef013f9f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305917.963957:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e5e5320a already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305917.963958:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c6f47a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef013f9f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305917.963962:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c6f47a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef013f9f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305917.963966:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef013f9f (00000000fc961c4f) 00010000:00010000:2.0:1772305917.963969:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305917.963970:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c6f47a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef013f9f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305917.963974:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c6f47a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef013f9f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305917.964003:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c6f46c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eef3 expref: 67 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305917.964014:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000dd30caad/0xa5e9c8c58c6f481 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x329:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eef3 expref: 66 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305917.964018:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x329:0x0].0x0 (000000002ab31ac6) 00010000:00010000:2.0:1772305917.964020:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1772305917.964021:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000dd30caad, rc 0) 00000100:00100000:2.0:1772305917.964073:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000039584847 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+66:98184:x1858396225370688:12345-192.168.203.30@tcp:101:rm.0 Request processed in 583us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305917.964080:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 892 00000100:00100000:2.0:1772305917.965049:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305917.965084:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225370752 00000100:00100000:3.0:1772305917.965113:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 893 00000100:00100000:3.0:1772305917.965118:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000700bb73d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+66:98184:x1858396225370752:12345-192.168.203.30@tcp:101:rm.0 00010000:00010000:3.0:1772305917.965127:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305917.965136:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d6b71f01/0xa5e9c8c58c6f488 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x329:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196eefa expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305917.965184:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f48f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x329:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305917.965192:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f48f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x329:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305917.965200:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f48f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x329:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305917.965210:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f496 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x329:0x0].0x7bb10507 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305917.965215:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f496 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x329:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305917.965220:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f496 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x329:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305917.965252:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f48f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x329:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305917.965257:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f48f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x329:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305917.965261:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f48f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x329:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305917.965265:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000099c1b7e6 already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305917.965267:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f48f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x329:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305917.965277:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f48f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x329:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305917.965292:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x329:0x0].0x0 (000000002ab31ac6) 00010000:00010000:3.0:1772305917.965295:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305917.965297:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f48f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x329:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305917.965302:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f48f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x329:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305917.965312:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f496 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x329:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305917.965316:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f496 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x329:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305917.965320:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f496 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x329:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305917.965323:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000009fea887 already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305917.965325:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f496 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x329:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305917.965331:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f496 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x329:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305917.965335:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x329:0x0].0x7bb10507 (00000000fbf2c1ae) 00010000:00010000:3.0:1772305917.965337:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305917.965343:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f496 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x329:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305917.965348:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f496 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x329:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305917.965367:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000d6b71f01/0xa5e9c8c58c6f488 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x329:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eefa expref: 67 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305917.965372:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d6b71f01/0xa5e9c8c58c6f488 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x329:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eefa expref: 67 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305917.965384:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6b71f01, rc 0) 00000100:00100000:3.0:1772305917.965422:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000700bb73d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+66:98184:x1858396225370752:12345-192.168.203.30@tcp:101:rm.0 Request processed in 302us (374us total) trans 0 rc 301/301 00000100:00100000:3.0:1772305917.965431:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 893 00000100:00100000:3.0:1772305917.966386:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305917.966422:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225370816 00000100:00100000:2.0:1772305917.966460:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 894 00000100:00100000:2.0:1772305917.966465:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000029210a42 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+66:98184:x1858396225370816:12345-192.168.203.30@tcp:101:rm.0 00010000:00010000:2.0:1772305917.966476:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305917.966486:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000fd78dae3/0xa5e9c8c58c6f49d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x329:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ef01 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305917.966509:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c6f4a4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x329:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305917.966517:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c6f4a4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x329:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305917.966523:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c6f4a4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x329:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305917.966533:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c6f4ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0x329:0x0].0x7bb10507 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305917.966538:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c6f4ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x329:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305917.966542:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c6f4ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x329:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305917.966569:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c6f4a4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x329:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305917.966576:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c6f4a4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x329:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305917.966581:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c6f4a4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x329:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305917.966587:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000001967872f already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305917.966590:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c6f4a4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x329:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305917.966598:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c6f4a4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x329:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305917.966608:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x329:0x0].0x0 (000000002ab31ac6) 00010000:00010000:2.0:1772305917.966611:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305917.966614:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c6f4a4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x329:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305917.966620:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c6f4a4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x329:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305917.966662:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c6f4ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x329:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305917.966670:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c6f4ab lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x329:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305917.966678:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c6f4ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x329:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305917.966684:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000007319ba46 already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305917.966687:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c6f4ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x329:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305917.966695:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c6f4ab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x329:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305917.966705:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x329:0x0].0x7bb10507 (000000007f5f418e) 00010000:00010000:2.0:1772305917.966708:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305917.966711:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c6f4ab lrc: 2/0,0 mode: --/PR res: [0x200000402:0x329:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305917.966723:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c6f4ab lrc: 0/0,0 mode: --/PR res: [0x200000402:0x329:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305917.966755:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000fd78dae3/0xa5e9c8c58c6f49d lrc: 1/0,0 mode: --/CR res: [0x200000402:0x329:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef01 expref: 67 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305917.966764:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000fd78dae3/0xa5e9c8c58c6f49d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x329:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef01 expref: 67 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305917.966776:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fd78dae3, rc 0) 00000100:00100000:2.0:1772305917.966827:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000029210a42 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+66:98184:x1858396225370816:12345-192.168.203.30@tcp:101:rm.0 Request processed in 360us (442us total) trans 0 rc 301/301 00000100:00100000:2.0:1772305917.966839:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 894 00000100:00100000:1.0:1772305917.971742:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305917.971801:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225370944 00000100:00100000:3.0:1772305917.971846:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 895 00000100:00100000:3.0:1772305917.971852:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000184f2b0a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+66:98187:x1858396225370944:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:3.0:1772305917.971871:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305917.971889:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d6b71f01/0xa5e9c8c58c6f4b2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x329:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ef08 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305917.972006:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f4b9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x329:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305917.972019:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f4b9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x329:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305917.972038:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f4b9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x329:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305917.972049:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f4c0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x329:0x0].0x7bb10507 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305917.972054:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f4c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x329:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305917.972059:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f4c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x329:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1772305917.972830:0:54698:0:(osp_object.c:1645:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x100010000:0x1af:0x0], index 1: 0 00010000:00010000:3.0:1772305917.973001:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6f4c7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x32a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305917.973008:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6f4c7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x32a:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305917.973013:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6f4c7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x32a:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305917.973043:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f4b9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x329:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305917.973050:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f4b9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x329:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305917.973056:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f4b9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x329:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305917.973066:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000009fea887 already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305917.973070:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f4b9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x329:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305917.973075:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f4b9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x329:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305917.973085:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x329:0x0].0x0 (000000002ab31ac6) 00010000:00010000:3.0:1772305917.973087:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305917.973090:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f4b9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x329:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305917.973096:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f4b9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x329:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1772305917.973105:0:54698:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000184f2b0a reply state 000000005f948913 transno 8589934864 ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f4c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x329:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305917.973129:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d6b71f01/0xa5e9c8c58c6f4b2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x329:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef08 expref: 69 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305917.973139:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000cace9935/0xa5e9c8c58c6f4c7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x32a:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef08 expref: 68 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305917.973143:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32a:0x0].0x0 (0000000058332f7d) 00010000:00010000:3.0:1772305917.973145:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1772305917.973146:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000cace9935, rc 0) 00000100:00100000:3.0:1772305917.973203:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000184f2b0a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98187:x1858396225370944:12345-192.168.203.30@tcp:101:dd.0 Request processed in 1351us (1467us total) trans 8589934864 rc 0/0 00000100:00100000:3.0:1772305917.973215:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 895 00010000:00010000:1.0:1772305917.973936:0:2977:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f4c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x329:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305917.973945:0:2977:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f4c0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x329:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305917.973950:0:2977:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f4c0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x329:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305917.973956:0:2977:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000099c1b7e6 already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305917.973958:0:2977:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f4c0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x329:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305917.973962:0:2977:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f4c0 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x329:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305917.973969:0:2977:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x329:0x0].0x7bb10507 (00000000fbf2c1ae) 00010000:00010000:1.0:1772305917.973971:0:2977:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305917.973973:0:2977:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f4c0 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x329:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305917.973978:0:2977:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f4c0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x329:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305917.974356:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305917.974391:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225371072 00000100:00100000:3.0:1772305917.974424:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 106 00000100:00100000:3.0:1772305917.974428:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fd34557b pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+68:98187:x1858396225371072:12345-192.168.203.30@tcp:35:dd.0 00000100:00100000:3.0:1772305917.974700:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fd34557b pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98187:x1858396225371072:12345-192.168.203.30@tcp:35:dd.0 Request processed in 271us (345us total) trans 8589934865 rc 0/0 00000100:00100000:3.0:1772305917.974707:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 106 00010000:00010000:0.0:1772305918.664723:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1772305918.904190:0:70136:0:(class_obd.c:302:class_handle_ioctl()) cmd = c008667f 00000020:00000080:3.0:1772305918.904199:0:70136:0:(class_obd.c:126:class_resolve_dev_name()) device name lustre-MDT0000 00000020:00000080:3.0:1772305918.904205:0:70136:0:(class_obd.c:133:class_resolve_dev_name()) device name lustre-MDT0000, dev 5 00000020:00000080:3.0:1772305918.904223:0:70136:0:(class_obd.c:302:class_handle_ioctl()) cmd = 424066b1 00000004:00000080:3.0:1772305918.904229:0:70136:0:(mdt_handler.c:7411:mdt_iocontrol()) handling ioctl cmd 0x424066b1 00000040:00080000:3.0:1772305918.904472:0:70136:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x11:0x0].13, 80 off9232 00000004:00000080:3.0:1772305918.904490:0:70136:0:(mdd_device.c:1821:mdd_changelog_user_register()) lustre-MDD0000: registered changelog user 'cl13', mask 0x0 00000004:02000000:3.0:1772305918.904493:0:70136:0:(mdd_device.c:460:mdd_changelog_on()) lustre-MDD0000: changelog on 00000100:00100000:2.0:1772305918.930058:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305918.930144:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225371136 00000100:00100000:3.0:1772305918.930213:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 896 00000100:00100000:3.0:1772305918.930220:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000091b2c0c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+49:98226:x1858396225371136:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1772305918.930252:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305918.930279:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d6b71f01/0xa5e9c8c58c6f4d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ef0f expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305918.930353:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f4dc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305918.930371:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f4dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305918.930398:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f4dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305918.930417:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6f4e3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef013f9f bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305918.930439:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6f4e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef013f9f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305918.930448:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6f4e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef013f9f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305918.930600:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6f4ea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x329:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305918.930611:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6f4ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x329:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305918.930617:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6f4ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x329:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1772305918.930721:0:54698:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x329:0x0]: returning size 512 00000004:00200000:3.0:1772305918.930725:0:54698:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1772305918.930747:0:54698:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6f4ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x329:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305918.930761:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f4dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305918.930768:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f4dc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305918.930784:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f4dc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305918.930792:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000009fea887 already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305918.930797:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f4dc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305918.930805:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f4dc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305918.930821:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:3.0:1772305918.930825:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305918.930830:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f4dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305918.930835:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f4dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305918.930845:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6f4e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef013f9f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305918.930849:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6f4e3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef013f9f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305918.930853:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6f4e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef013f9f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305918.930857:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ca5be8d6 already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305918.930858:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6f4e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef013f9f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305918.930869:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6f4e3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef013f9f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305918.930875:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef013f9f (000000009fad10f9) 00010000:00010000:3.0:1772305918.930877:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305918.930878:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6f4e3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef013f9f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305918.930882:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6f4e3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef013f9f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305918.930916:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d6b71f01/0xa5e9c8c58c6f4d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef0f expref: 51 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305918.930937:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000d90d1abd/0xa5e9c8c58c6f4ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x329:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef0f expref: 50 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305918.930945:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x329:0x0].0x0 (000000002ab31ac6) 00010000:00010000:3.0:1772305918.930947:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1772305918.930950:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d90d1abd, rc 0) 00000100:00100000:3.0:1772305918.931011:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000091b2c0c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+50:98226:x1858396225371136:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 790us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305918.931021:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 896 00000100:00100000:2.0:1772305918.932163:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305918.932196:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225371264 00000100:00100000:3.0:1772305918.932230:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 897 00000100:00100000:3.0:1772305918.932237:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ee92c34a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+50:98226:x1858396225371264:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1772305918.932246:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305918.932260:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d02430e8/0xa5e9c8c58c6f4f1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x329:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ef16 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305918.932299:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f4f8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x329:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305918.932306:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f4f8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x329:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305918.932312:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f4f8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x329:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305918.932321:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f4ff lrc: 3/1,0 mode: --/PR res: [0x200000402:0x329:0x0].0x7bb10507 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305918.932326:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f4ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x329:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305918.932331:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f4ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x329:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305918.932403:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6f506 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x32a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305918.932410:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6f506 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x32a:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305918.932414:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6f506 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x32a:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1772305918.932421:0:54698:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x32a:0x0]: returning size 0 00010000:00010000:3.0:1772305918.932564:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f4f8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x329:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305918.932573:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f4f8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x329:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305918.932589:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f4f8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x329:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305918.932596:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002f753c58 already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305918.932599:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f4f8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x329:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305918.932606:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f4f8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x329:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305918.932616:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x329:0x0].0x0 (000000002ab31ac6) 00010000:00010000:3.0:1772305918.932619:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305918.932622:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f4f8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x329:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305918.932685:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f4f8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x329:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305918.932699:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f4ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x329:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305918.932706:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f4ff lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x329:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305918.932713:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f4ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x329:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305918.932727:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000099c1b7e6 already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305918.932730:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f4ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x329:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305918.932737:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f4ff lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x329:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305918.932747:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x329:0x0].0x7bb10507 (0000000050807621) 00010000:00010000:3.0:1772305918.932750:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305918.932752:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f4ff lrc: 2/0,0 mode: --/PR res: [0x200000402:0x329:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305918.932759:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f4ff lrc: 0/0,0 mode: --/PR res: [0x200000402:0x329:0x0].0x7bb10507 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305918.932789:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d02430e8/0xa5e9c8c58c6f4f1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x329:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef16 expref: 53 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305918.932797:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000f0848df9/0xa5e9c8c58c6f506 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x32a:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef16 expref: 52 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305918.932801:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32a:0x0].0x0 (0000000058332f7d) 00010000:00010000:3.0:1772305918.932803:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1772305918.932805:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f0848df9, rc 0) 00000100:00100000:3.0:1772305918.932833:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ee92c34a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+52:98226:x1858396225371264:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 597us (672us total) trans 8589934866 rc 0/0 00000100:00100000:3.0:1772305918.932838:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 897 00000100:00100000:1.0:1772305918.933752:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305918.933788:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225371392 00000100:00100000:3.0:1772305918.933816:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 898 00000100:00100000:3.0:1772305918.933822:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004486c7f8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+52:98226:x1858396225371392:12345-192.168.203.30@tcp:55:lfs.0 00010000:00010000:3.0:1772305918.933850:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c6f514 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305918.933861:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c6f514 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305918.933870:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c6f514 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1772305918.934113:0:54698:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x13:0x0].66, 168 off19088 00010000:00010000:3.0:1772305918.934183:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c6f514 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305918.934190:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c6f514 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305918.934194:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c6f514 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305918.934198:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000617aea8a already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305918.934200:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c6f514 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305918.934204:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c6f514 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305918.934211:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32a:0x0].0x0 (0000000058332f7d) 00010000:00010000:3.0:1772305918.934218:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1772305918.934221:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c6f514 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305918.934226:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c6f514 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305918.934260:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004486c7f8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+53:98226:x1858396225371392:12345-192.168.203.30@tcp:55:lfs.0 Request processed in 438us (511us total) trans 8589934867 rc 0/0 00000100:00100000:3.0:1772305918.934266:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 898 00000100:00100000:2.0:1772305918.935032:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305918.935069:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225371520 00000100:00100000:3.0:1772305918.935102:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 107 00000100:00100000:3.0:1772305918.935108:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000010b5ceff pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+53:98226:x1858396225371520:12345-192.168.203.30@tcp:35:lfs.0 00000040:00080000:3.0:1772305918.935226:0:57054:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x13:0x0].67, 168 off19256 00000100:00100000:3.0:1772305918.935307:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000010b5ceff pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+54:98226:x1858396225371520:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 199us (279us total) trans 8589934868 rc 0/0 00000100:00100000:3.0:1772305918.935314:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 107 00000100:00100000:2.0:1772305918.956407:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305918.956472:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225371584 00000100:00100000:1.0:1772305918.956543:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 899 00000100:00100000:1.0:1772305918.956554:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e854672f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98235:x1858396225371584:12345-192.168.203.30@tcp:501:chlg_load_threa.0 00000100:00100000:1.0:1772305918.956807:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e854672f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98235:x1858396225371584:12345-192.168.203.30@tcp:501:chlg_load_threa.0 Request processed in 255us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305918.956816:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 899 00000100:00100000:1.0:1772305918.958068:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305918.958105:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225371648 00000100:00100000:1.0:1772305918.958140:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 900 00000100:00100000:1.0:1772305918.958146:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000066c449e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98235:x1858396225371648:12345-192.168.203.30@tcp:503:chlg_load_threa.0 00000100:00100000:1.0:1772305918.958388:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000066c449e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98235:x1858396225371648:12345-192.168.203.30@tcp:503:chlg_load_threa.0 Request processed in 240us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305918.958398:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 900 00000100:00100000:1.0:1772305918.959386:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305918.959424:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225371712 00000100:00100000:2.0:1772305918.959481:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 901 00000100:00100000:2.0:1772305918.959489:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004bdec287 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98235:x1858396225371712:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1772305918.959811:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004bdec287 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98235:x1858396225371712:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 320us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305918.959822:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 901 00000100:00100000:3.0:1772305918.960700:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305918.960735:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225371776 00000100:00100000:1.0:1772305918.960763:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 902 00000100:00100000:1.0:1772305918.960770:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000911e7fcc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98235:x1858396225371776:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1772305918.960903:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000911e7fcc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98235:x1858396225371776:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 133us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305918.960911:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 902 00000100:00100000:3.0:1772305918.961542:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305918.961584:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225371840 00000100:00100000:1.0:1772305918.961612:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 903 00000100:00100000:1.0:1772305918.961616:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000052c29410 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98235:x1858396225371840:12345-192.168.203.30@tcp:501:chlg_load_threa.0 00000100:00100000:1.0:1772305918.961697:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000052c29410 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98235:x1858396225371840:12345-192.168.203.30@tcp:501:chlg_load_threa.0 Request processed in 78us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305918.961708:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 903 00000100:00100000:2.0:1772305918.962259:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305918.962304:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225371904 00000100:00100000:1.0:1772305918.962329:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 904 00000100:00100000:1.0:1772305918.962333:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000082a20edb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98235:x1858396225371904:12345-192.168.203.30@tcp:503:chlg_load_threa.0 00000100:00100000:1.0:1772305918.962406:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000082a20edb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98235:x1858396225371904:12345-192.168.203.30@tcp:503:chlg_load_threa.0 Request processed in 72us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305918.962412:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 904 00000100:00100000:3.0:1772305918.963199:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305918.963249:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225371968 00000100:00100000:1.0:1772305918.963299:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 905 00000100:00100000:1.0:1772305918.963311:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000714df8e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98235:x1858396225371968:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1772305918.963414:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000714df8e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98235:x1858396225371968:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 105us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305918.963420:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 905 00000100:00100000:3.0:1772305918.964266:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305918.964322:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225372032 00000100:00100000:1.0:1772305918.964361:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 906 00000100:00100000:1.0:1772305918.964367:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000aa7d33bd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98235:x1858396225372032:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1772305918.964465:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000aa7d33bd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98235:x1858396225372032:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 97us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305918.964471:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 906 00000100:00100000:2.0:1772305919.009575:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305919.009677:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225372160 00000100:00100000:1.0:1772305919.009739:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 907 00000100:00100000:1.0:1772305919.009746:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000fd7c6d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+54:98245:x1858396225372160:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1772305919.009780:0:55653:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305919.009805:0:55653:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6f51b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x329:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ef1d expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305919.009929:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6f522 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x32a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305919.009943:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6f522 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305919.009953:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6f522 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1772305919.009965:0:55653:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x32a:0x0]: returning size 0 00010000:00010000:1.0:1772305919.010087:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6f51b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x329:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef1d expref: 57 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305919.010103:0:55653:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6f522 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef1d expref: 56 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305919.010109:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32a:0x0].0x0 (0000000058332f7d) 00010000:00010000:1.0:1772305919.010112:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1772305919.010115:0:55653:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000048d87789, rc 0) 00000100:00100000:1.0:1772305919.010174:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000fd7c6d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+56:98245:x1858396225372160:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 428us (612us total) trans 8589934869 rc 0/0 00000100:00100000:1.0:1772305919.010180:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 907 00000100:00100000:3.0:1772305919.011205:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305919.011256:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225372288 00000100:00100000:1.0:1772305919.011301:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 908 00000100:00100000:1.0:1772305919.011307:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000af42919f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+56:98245:x1858396225372288:12345-192.168.203.30@tcp:55:lfs.0 00010000:00010000:1.0:1772305919.011339:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6f530 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305919.011352:0:55653:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6f522 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef1d expref: 56 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305919.011359:0:55653:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6f530 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305919.011397:0:55653:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6f522 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef1d expref: 56 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305919.011411:0:55653:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6f522 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef1d expref: 56 pid: 55653 timeout: 1330 lvb_type: 0 00000100:00100000:1.0:1772305919.011448:0:55653:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002e5d5c7c pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:55653:1858396216604096:192.168.203.30@tcp:104: 00000100:00100000:1.0:1772305919.011511:0:55653:0:(client.c:2500:ptlrpc_set_wait()) set 00000000d7e7fe64 going to sleep for 6 seconds 00000100:00100000:1.0:1772305919.012237:0:55653:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002e5d5c7c pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:55653:1858396216604096:192.168.203.30@tcp:104: 00010000:00010000:1.0:1772305919.012262:0:55653:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6f530 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305919.012481:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305919.012573:0:5494:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225372352 00010000:00010000:0.0:1772305919.012612:0:5494:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6f522 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef1d expref: 57 pid: 55653 timeout: 1330 lvb_type: 0 00000100:00100000:0.0:1772305919.012705:0:5494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3098 00000100:00100000:0.0:1772305919.012714:0:5494:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006dfc40a9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+57:2215:x1858396225372352:12345-192.168.203.30@tcp:103:ldlm_bl_05.0 00010000:00010000:0.0:1772305919.012729:0:5494:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1772305919.012735:0:5494:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6f522 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef1d expref: 57 pid: 55653 timeout: 1330 lvb_type: 0 00010000:00010000:0.0:1772305919.012748:0:5494:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6f522 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef1d expref: 57 pid: 55653 timeout: 1330 lvb_type: 0 00010000:00010000:0.0:1772305919.012769:0:5494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6f522 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef1d expref: 57 pid: 55653 timeout: 1330 lvb_type: 0 00010000:00010000:0.0:1772305919.012785:0:5494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32a:0x0].0x0 (0000000058332f7d) 00010000:00010000:0.0:1772305919.012789:0:5494:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6f530 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305919.012811:0:5494:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6f530 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305919.012819:0:5494:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6f530 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305919.012851:0:5494:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1772305919.012874:0:55653:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6f530 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305919.012886:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6f530 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305919.012905:0:5494:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006dfc40a9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+56:2215:x1858396225372352:12345-192.168.203.30@tcp:103:ldlm_bl_05.0 Request processed in 191us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305919.012916:0:5494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3098 00000040:00080000:1.0:1772305919.013168:0:55653:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x13:0x0].68, 168 off19424 00010000:00010000:1.0:1772305919.013231:0:55653:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6f530 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305919.013240:0:55653:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6f530 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305919.013248:0:55653:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6f530 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305919.013255:0:55653:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000043f9fbca already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305919.013259:0:55653:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6f530 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305919.013267:0:55653:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6f530 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305919.013281:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32a:0x0].0x0 (0000000058332f7d) 00010000:00010000:1.0:1772305919.013284:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1772305919.013288:0:55653:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6f530 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305919.013295:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6f530 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305919.013351:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000af42919f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+56:98245:x1858396225372288:12345-192.168.203.30@tcp:55:lfs.0 Request processed in 2043us (2153us total) trans 8589934870 rc 0/0 00000100:00100000:1.0:1772305919.013361:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 908 00000100:00100000:3.0:1772305919.014185:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.014239:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225372480 00000100:00100000:2.0:1772305919.014271:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 108 00000100:00100000:2.0:1772305919.014274:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004ca53634 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+56:98245:x1858396225372480:12345-192.168.203.30@tcp:35:lfs.0 00000040:00080000:2.0:1772305919.014524:0:57054:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x13:0x0].69, 168 off19592 00000100:00100000:2.0:1772305919.014676:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004ca53634 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+57:98245:x1858396225372480:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 398us (493us total) trans 8589934871 rc 0/0 00000100:00100000:2.0:1772305919.014691:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 108 00000100:00100000:3.0:1772305919.038198:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305919.038312:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225372544 00000100:00100000:1.0:1772305919.038396:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 909 00000100:00100000:1.0:1772305919.038405:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003847e69c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98254:x1858396225372544:12345-192.168.203.30@tcp:501:chlg_load_threa.0 00000100:00100000:1.0:1772305919.038666:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003847e69c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98254:x1858396225372544:12345-192.168.203.30@tcp:501:chlg_load_threa.0 Request processed in 260us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305919.038676:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 909 00000100:00100000:1.0:1772305919.039479:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.039521:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225372608 00000100:00100000:2.0:1772305919.039551:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 910 00000100:00100000:2.0:1772305919.039555:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002e5d5c7c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98254:x1858396225372608:12345-192.168.203.30@tcp:503:chlg_load_threa.0 00000100:00100000:2.0:1772305919.039765:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002e5d5c7c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98254:x1858396225372608:12345-192.168.203.30@tcp:503:chlg_load_threa.0 Request processed in 209us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.039774:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 910 00000100:00100000:3.0:1772305919.040390:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.040436:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225372672 00000100:00100000:2.0:1772305919.040463:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 911 00000100:00100000:2.0:1772305919.040468:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004ca72e12 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98254:x1858396225372672:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1772305919.040567:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004ca72e12 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98254:x1858396225372672:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 98us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.040573:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 911 00000100:00100000:3.0:1772305919.041500:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.041547:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225372736 00000100:00100000:2.0:1772305919.041571:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 912 00000100:00100000:2.0:1772305919.041574:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000597692b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98254:x1858396225372736:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1772305919.041684:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000597692b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98254:x1858396225372736:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 108us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.041691:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 912 00000100:00100000:1.0:1772305919.042416:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.042465:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225372800 00000100:00100000:2.0:1772305919.042489:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 913 00000100:00100000:2.0:1772305919.042493:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ffad9327 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98254:x1858396225372800:12345-192.168.203.30@tcp:501:chlg_load_threa.0 00000100:00100000:2.0:1772305919.042538:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ffad9327 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98254:x1858396225372800:12345-192.168.203.30@tcp:501:chlg_load_threa.0 Request processed in 44us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.042544:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 913 00000100:00100000:3.0:1772305919.043300:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.043345:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225372864 00000100:00100000:3.0:1772305919.043380:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.043386:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 914 00000100:00100000:2.0:1772305919.043393:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000769fc9a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98254:x1858396225372864:12345-192.168.203.30@tcp:503:chlg_load_threa.0 00000100:00100000:3.0:1772305919.043470:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305919.043473:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225372928 00000100:00100000:2.0:1772305919.043528:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000769fc9a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98254:x1858396225372864:12345-192.168.203.30@tcp:503:chlg_load_threa.0 Request processed in 128us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305919.043536:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 144 00000100:00100000:0.0:1772305919.043548:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000389a8545 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2217:x1858396225372928:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1772305919.043559:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 914 00000100:00100000:3.0:1772305919.043596:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225373056 00000100:00100000:1.0:1772305919.043660:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305919.043665:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000389a8545 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2217:x1858396225372928:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 79us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305919.043674:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 144 00000100:00100000:3.0:1772305919.043708:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225373184 00000100:00100000:1.0:1772305919.043723:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1179 00000100:00100000:1.0:1772305919.043733:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000054388a3a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2217:x1858396225373056:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:0.0:1772305919.043760:0:48470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1180 00000100:00100000:0.0:1772305919.043769:0:48470:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e0d19a66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f935b4d0-e17f-49c8-8011-4be99ba75430+140:2217:x1858396225373184:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1772305919.043798:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000054388a3a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2217:x1858396225373056:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 64us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305919.043811:0:48470:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e0d19a66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f935b4d0-e17f-49c8-8011-4be99ba75430+140:2217:x1858396225373184:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 33us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305919.043830:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1179 00000100:00100000:0.0:1772305919.043839:0:48470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1180 00000100:00100000:1.0:1772305919.043881:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305919.043923:0:48470:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225372992 00000100:00100000:0.0:1772305919.043967:0:48470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1181 00000100:00100000:0.0:1772305919.043976:0:48470:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e6635d8a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:370cd859-ca07-4cc9-a865-ed970d9eaddd+224:2218:x1858396225372992:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1772305919.044037:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305919.044038:0:48470:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e6635d8a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:370cd859-ca07-4cc9-a865-ed970d9eaddd+224:2218:x1858396225372992:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 56us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305919.044054:0:48470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1181 00000100:00100000:0.0:1772305919.044088:0:48470:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225373120 00000100:00100000:0.0:1772305919.044132:0:48470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1182 00000100:00100000:0.0:1772305919.044142:0:48470:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000002171660 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f935b4d0-e17f-49c8-8011-4be99ba75430+161:2218:x1858396225373120:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:0.0:1772305919.044178:0:48470:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000002171660 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f935b4d0-e17f-49c8-8011-4be99ba75430+161:2218:x1858396225373120:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 40us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305919.044183:0:48470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1182 00000100:00100000:3.0:1772305919.044318:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.044360:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225373248 00000100:00100000:2.0:1772305919.044396:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 915 00000100:00100000:2.0:1772305919.044402:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e47bd691 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98254:x1858396225373248:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1772305919.044524:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e47bd691 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98254:x1858396225373248:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 120us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.044533:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 915 00000100:00100000:3.0:1772305919.045204:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.045247:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225373312 00000100:00100000:2.0:1772305919.045273:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 916 00000100:00100000:2.0:1772305919.045281:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000094ce544a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98254:x1858396225373312:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1772305919.045385:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000094ce544a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98254:x1858396225373312:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 104us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.045392:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 916 00000100:00100000:3.0:1772305919.097998:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.098092:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225373440 00000100:00100000:2.0:1772305919.098164:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 917 00000100:00100000:2.0:1772305919.098174:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009707a2f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+57:98266:x1858396225373440:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1772305919.098210:0:55653:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305919.098238:0:55653:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000fd78dae3/0xa5e9c8c58c6f537 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x329:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ef24 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.098361:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c6f53e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x32a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.098380:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c6f53e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.098394:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c6f53e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1772305919.098408:0:55653:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x32a:0x0]: returning size 0 00010000:00010000:2.0:1772305919.098579:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000fd78dae3/0xa5e9c8c58c6f537 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x329:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef24 expref: 60 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.098601:0:55653:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c6f53e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef24 expref: 59 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.098611:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32a:0x0].0x0 (0000000058332f7d) 00010000:00010000:2.0:1772305919.098615:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1772305919.098618:0:55653:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007319ba46, rc 0) 00000100:00100000:2.0:1772305919.098711:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009707a2f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+59:98266:x1858396225373440:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 538us (726us total) trans 8589934872 rc 0/0 00000100:00100000:2.0:1772305919.098719:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 917 00000100:00100000:1.0:1772305919.099677:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.099722:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225373568 00000100:00100000:2.0:1772305919.099755:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 918 00000100:00100000:2.0:1772305919.099762:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004c9f0c35 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+59:98266:x1858396225373568:12345-192.168.203.30@tcp:55:lfs.0 00010000:00010000:2.0:1772305919.099794:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c6f54c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.099807:0:55653:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c6f53e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef24 expref: 59 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.099816:0:55653:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c6f54c lrc: 4/0,1 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.099852:0:55653:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c6f53e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef24 expref: 59 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.099865:0:55653:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c6f53e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef24 expref: 59 pid: 55653 timeout: 1330 lvb_type: 0 00000100:00100000:2.0:1772305919.099879:0:55653:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d8f6a4e6 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:55653:1858396216604160:192.168.203.30@tcp:104: 00000100:00100000:2.0:1772305919.099941:0:55653:0:(client.c:2500:ptlrpc_set_wait()) set 00000000d231d7eb going to sleep for 6 seconds 00000100:00100000:2.0:1772305919.100800:0:55653:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d8f6a4e6 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:55653:1858396216604160:192.168.203.30@tcp:104: 00010000:00010000:2.0:1772305919.100817:0:55653:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c6f54c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305919.100959:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305919.101171:0:5494:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225373632 00010000:00010000:0.0:1772305919.101224:0:5494:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c6f53e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef24 expref: 60 pid: 55653 timeout: 1330 lvb_type: 0 00000100:00100000:0.0:1772305919.101275:0:5494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3099 00000100:00100000:0.0:1772305919.101283:0:5494:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a28db514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+60:2216:x1858396225373632:12345-192.168.203.30@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1772305919.101301:0:5494:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1772305919.101308:0:5494:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c6f53e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef24 expref: 60 pid: 55653 timeout: 1330 lvb_type: 0 00010000:00010000:0.0:1772305919.101321:0:5494:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c6f53e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef24 expref: 60 pid: 55653 timeout: 1330 lvb_type: 0 00010000:00010000:0.0:1772305919.101342:0:5494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c6f53e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef24 expref: 60 pid: 55653 timeout: 1330 lvb_type: 0 00010000:00010000:0.0:1772305919.101361:0:5494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32a:0x0].0x0 (0000000058332f7d) 00010000:00010000:0.0:1772305919.101379:0:5494:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c6f54c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305919.101391:0:5494:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c6f54c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305919.101400:0:5494:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c6f54c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305919.101445:0:5494:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1772305919.101464:0:55653:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c6f54c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.101475:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c6f54c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305919.101514:0:5494:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a28db514 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+59:2216:x1858396225373632:12345-192.168.203.30@tcp:103:ldlm_bl_04.0 Request processed in 229us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305919.101526:0:5494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3099 00000040:00080000:2.0:1772305919.101758:0:55653:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x13:0x0].70, 168 off19760 00010000:00010000:2.0:1772305919.101821:0:55653:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c6f54c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.101832:0:55653:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c6f54c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.101840:0:55653:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c6f54c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.101846:0:55653:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000001967872f already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305919.101851:0:55653:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c6f54c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.101858:0:55653:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c6f54c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.101871:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32a:0x0].0x0 (0000000058332f7d) 00010000:00010000:2.0:1772305919.101873:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1772305919.101877:0:55653:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c6f54c lrc: 2/0,0 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.101883:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c6f54c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305919.101935:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004c9f0c35 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+59:98266:x1858396225373568:12345-192.168.203.30@tcp:55:lfs.0 Request processed in 2172us (2258us total) trans 8589934873 rc 0/0 00000100:00100000:2.0:1772305919.101945:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 918 00000100:00100000:1.0:1772305919.102485:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.102524:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225373760 00000100:00100000:2.0:1772305919.102552:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 109 00000100:00100000:2.0:1772305919.102556:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c230ed64 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+59:98266:x1858396225373760:12345-192.168.203.30@tcp:35:lfs.0 00000040:00080000:2.0:1772305919.102678:0:57054:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x13:0x0].71, 168 off19928 00000100:00100000:2.0:1772305919.102739:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c230ed64 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+60:98266:x1858396225373760:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 182us (256us total) trans 8589934874 rc 0/0 00000100:00100000:2.0:1772305919.102748:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 109 00000100:00100000:3.0:1772305919.120721:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.120801:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225373824 00000100:00100000:2.0:1772305919.120871:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 919 00000100:00100000:2.0:1772305919.120878:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001bb6be06 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98275:x1858396225373824:12345-192.168.203.30@tcp:501:chlg_load_threa.0 00000100:00100000:2.0:1772305919.121083:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001bb6be06 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98275:x1858396225373824:12345-192.168.203.30@tcp:501:chlg_load_threa.0 Request processed in 205us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.121091:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 919 00000100:00100000:3.0:1772305919.121956:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.122015:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225373888 00000100:00100000:2.0:1772305919.122046:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 920 00000100:00100000:2.0:1772305919.122052:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002d3be4cb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98275:x1858396225373888:12345-192.168.203.30@tcp:503:chlg_load_threa.0 00000100:00100000:2.0:1772305919.122261:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002d3be4cb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98275:x1858396225373888:12345-192.168.203.30@tcp:503:chlg_load_threa.0 Request processed in 207us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.122270:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 920 00000100:00100000:1.0:1772305919.123074:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.123126:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225373952 00000100:00100000:2.0:1772305919.123155:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 921 00000100:00100000:2.0:1772305919.123160:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000367e8d8d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98275:x1858396225373952:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1772305919.123285:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000367e8d8d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98275:x1858396225373952:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 124us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.123295:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 921 00000100:00100000:3.0:1772305919.123942:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.123972:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225374016 00000100:00100000:2.0:1772305919.123994:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 922 00000100:00100000:2.0:1772305919.123999:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009b7fc1cf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98275:x1858396225374016:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1772305919.124081:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009b7fc1cf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98275:x1858396225374016:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 82us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.124087:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 922 00000100:00100000:3.0:1772305919.124804:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.124842:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225374080 00000100:00100000:2.0:1772305919.124875:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 923 00000100:00100000:2.0:1772305919.124880:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b4a2cd7a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98275:x1858396225374080:12345-192.168.203.30@tcp:501:chlg_load_threa.0 00000100:00100000:2.0:1772305919.124928:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b4a2cd7a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98275:x1858396225374080:12345-192.168.203.30@tcp:501:chlg_load_threa.0 Request processed in 47us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.124938:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 923 00000100:00100000:1.0:1772305919.125483:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.125523:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225374144 00000100:00100000:2.0:1772305919.125550:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 924 00000100:00100000:2.0:1772305919.125555:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e782a30d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98275:x1858396225374144:12345-192.168.203.30@tcp:503:chlg_load_threa.0 00000100:00100000:2.0:1772305919.125653:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e782a30d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98275:x1858396225374144:12345-192.168.203.30@tcp:503:chlg_load_threa.0 Request processed in 97us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.125661:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 924 00000100:00100000:3.0:1772305919.126231:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.126269:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225374208 00000100:00100000:2.0:1772305919.126296:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 925 00000100:00100000:2.0:1772305919.126302:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e634e198 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98275:x1858396225374208:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1772305919.126386:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e634e198 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98275:x1858396225374208:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 84us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.126393:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 925 00000100:00100000:3.0:1772305919.127058:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.127098:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225374272 00000100:00100000:2.0:1772305919.127126:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 926 00000100:00100000:2.0:1772305919.127131:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008d141ae1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98275:x1858396225374272:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1772305919.127225:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008d141ae1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98275:x1858396225374272:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 93us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.127233:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 926 00000100:00100000:1.0:1772305919.193664:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.193753:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225374400 00000100:00100000:2.0:1772305919.193817:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 927 00000100:00100000:2.0:1772305919.193825:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bb059566 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+60:98289:x1858396225374400:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1772305919.193857:0:55653:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305919.193886:0:55653:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c6f553 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x329:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ef2b expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.194016:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000fd78dae3/0xa5e9c8c58c6f55a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x32a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.194036:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000fd78dae3/0xa5e9c8c58c6f55a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.194052:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000fd78dae3/0xa5e9c8c58c6f55a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1772305919.194067:0:55653:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x32a:0x0]: returning size 0 00010000:00010000:2.0:1772305919.194224:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c6f553 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x329:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef2b expref: 63 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.194249:0:55653:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000fd78dae3/0xa5e9c8c58c6f55a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef2b expref: 62 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.194264:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32a:0x0].0x0 (0000000058332f7d) 00010000:00010000:2.0:1772305919.194268:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1772305919.194271:0:55653:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fd78dae3, rc 0) 00000100:00100000:2.0:1772305919.194340:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bb059566 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+62:98289:x1858396225374400:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 514us (722us total) trans 8589934875 rc 0/0 00000100:00100000:2.0:1772305919.194350:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 927 00000100:00100000:3.0:1772305919.195443:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.195484:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225374528 00000100:00100000:2.0:1772305919.195512:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 928 00000100:00100000:2.0:1772305919.195518:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dc9c50ef pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+62:98289:x1858396225374528:12345-192.168.203.30@tcp:55:lfs.0 00010000:00010000:2.0:1772305919.195546:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c6f568 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.195558:0:55653:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000fd78dae3/0xa5e9c8c58c6f55a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef2b expref: 62 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.195565:0:55653:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c6f568 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.195597:0:55653:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000fd78dae3/0xa5e9c8c58c6f55a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef2b expref: 62 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.195606:0:55653:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000fd78dae3/0xa5e9c8c58c6f55a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef2b expref: 62 pid: 55653 timeout: 1331 lvb_type: 0 00000100:00100000:2.0:1772305919.195620:0:55653:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d8f6a4e6 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:55653:1858396216604224:192.168.203.30@tcp:104: 00000100:00100000:2.0:1772305919.195701:0:55653:0:(client.c:2500:ptlrpc_set_wait()) set 000000004d907b76 going to sleep for 6 seconds 00000100:00100000:2.0:1772305919.196546:0:55653:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d8f6a4e6 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:55653:1858396216604224:192.168.203.30@tcp:104: 00010000:00010000:2.0:1772305919.196570:0:55653:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c6f568 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305919.196695:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305919.196780:0:5494:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225374592 00010000:00010000:0.0:1772305919.196806:0:5494:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000fd78dae3/0xa5e9c8c58c6f55a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef2b expref: 63 pid: 55653 timeout: 1331 lvb_type: 0 00000100:00100000:0.0:1772305919.196838:0:5494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3100 00000100:00100000:0.0:1772305919.196843:0:5494:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000084e1bde0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+63:2215:x1858396225374592:12345-192.168.203.30@tcp:103:ldlm_bl_07.0 00010000:00010000:0.0:1772305919.196853:0:5494:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1772305919.196859:0:5494:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000fd78dae3/0xa5e9c8c58c6f55a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef2b expref: 63 pid: 55653 timeout: 1331 lvb_type: 0 00010000:00010000:0.0:1772305919.196868:0:5494:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000fd78dae3/0xa5e9c8c58c6f55a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef2b expref: 63 pid: 55653 timeout: 1331 lvb_type: 0 00010000:00010000:0.0:1772305919.196880:0:5494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000fd78dae3/0xa5e9c8c58c6f55a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef2b expref: 63 pid: 55653 timeout: 1331 lvb_type: 0 00010000:00010000:0.0:1772305919.196911:0:5494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32a:0x0].0x0 (0000000058332f7d) 00010000:00010000:0.0:1772305919.196914:0:5494:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c6f568 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305919.196921:0:5494:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c6f568 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305919.196925:0:5494:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c6f568 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305919.196943:0:5494:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1772305919.196961:0:55653:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c6f568 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.196969:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c6f568 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305919.196970:0:5494:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000084e1bde0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+62:2215:x1858396225374592:12345-192.168.203.30@tcp:103:ldlm_bl_07.0 Request processed in 126us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305919.196986:0:5494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3100 00000040:00080000:2.0:1772305919.197181:0:55653:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x13:0x0].72, 168 off20096 00010000:00010000:2.0:1772305919.197231:0:55653:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c6f568 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.197239:0:55653:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c6f568 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.197247:0:55653:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c6f568 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.197254:0:55653:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000007129515 already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305919.197258:0:55653:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c6f568 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.197266:0:55653:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c6f568 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.197277:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32a:0x0].0x0 (0000000058332f7d) 00010000:00010000:2.0:1772305919.197279:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1772305919.197282:0:55653:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c6f568 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.197289:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c6f568 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305919.197330:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dc9c50ef pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+62:98289:x1858396225374528:12345-192.168.203.30@tcp:55:lfs.0 Request processed in 1811us (1905us total) trans 8589934876 rc 0/0 00000100:00100000:2.0:1772305919.197338:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 928 00000100:00100000:0.0:1772305919.198046:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.198083:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225374720 00000100:00100000:2.0:1772305919.198112:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 110 00000100:00100000:2.0:1772305919.198116:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006f4c803f pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+62:98289:x1858396225374720:12345-192.168.203.30@tcp:35:lfs.0 00000040:00080000:2.0:1772305919.198210:0:57054:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x13:0x0].73, 168 off20264 00000100:00100000:2.0:1772305919.198273:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006f4c803f pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+63:98289:x1858396225374720:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 156us (229us total) trans 8589934877 rc 0/0 00000100:00100000:2.0:1772305919.198279:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 110 00000100:00100000:3.0:1772305919.220257:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.220324:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225374784 00000100:00100000:2.0:1772305919.220382:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 929 00000100:00100000:2.0:1772305919.220389:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008907f4c8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98298:x1858396225374784:12345-192.168.203.30@tcp:501:chlg_load_threa.0 00000100:00100000:2.0:1772305919.220611:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008907f4c8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98298:x1858396225374784:12345-192.168.203.30@tcp:501:chlg_load_threa.0 Request processed in 221us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.220621:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 929 00000100:00100000:1.0:1772305919.221359:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.221394:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225374848 00000100:00100000:2.0:1772305919.221420:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 930 00000100:00100000:2.0:1772305919.221436:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000495c9266 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98298:x1858396225374848:12345-192.168.203.30@tcp:503:chlg_load_threa.0 00000100:00100000:2.0:1772305919.221605:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000495c9266 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98298:x1858396225374848:12345-192.168.203.30@tcp:503:chlg_load_threa.0 Request processed in 180us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.221620:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 930 00000100:00100000:0.0:1772305919.222453:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.222492:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225374912 00000100:00100000:2.0:1772305919.222521:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 931 00000100:00100000:2.0:1772305919.222527:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008d45073f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98298:x1858396225374912:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1772305919.222672:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008d45073f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98298:x1858396225374912:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 145us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.222678:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 931 00000100:00100000:3.0:1772305919.223369:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.223404:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225374976 00000100:00100000:2.0:1772305919.223444:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 932 00000100:00100000:2.0:1772305919.223449:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007ce64e92 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98298:x1858396225374976:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1772305919.223546:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007ce64e92 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98298:x1858396225374976:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 96us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.223552:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 932 00000100:00100000:1.0:1772305919.224362:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.224394:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225375040 00000100:00100000:2.0:1772305919.224419:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 933 00000100:00100000:2.0:1772305919.224423:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000051fd3951 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98298:x1858396225375040:12345-192.168.203.30@tcp:501:chlg_load_threa.0 00000100:00100000:2.0:1772305919.224488:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000051fd3951 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98298:x1858396225375040:12345-192.168.203.30@tcp:501:chlg_load_threa.0 Request processed in 63us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.224497:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 933 00000100:00100000:0.0:1772305919.225129:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.225171:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225375104 00000100:00100000:2.0:1772305919.225202:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 934 00000100:00100000:2.0:1772305919.225208:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cc2949c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98298:x1858396225375104:12345-192.168.203.30@tcp:503:chlg_load_threa.0 00000100:00100000:2.0:1772305919.225298:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cc2949c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98298:x1858396225375104:12345-192.168.203.30@tcp:503:chlg_load_threa.0 Request processed in 88us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.225308:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 934 00000100:00100000:3.0:1772305919.225962:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.226001:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225375168 00000100:00100000:2.0:1772305919.226024:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 935 00000100:00100000:2.0:1772305919.226027:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000068687bb0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98298:x1858396225375168:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1772305919.226105:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000068687bb0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98298:x1858396225375168:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 76us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.226111:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 935 00000100:00100000:1.0:1772305919.226739:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.226796:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225375232 00000100:00100000:2.0:1772305919.226829:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 936 00000100:00100000:2.0:1772305919.226836:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000120e5172 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98298:x1858396225375232:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1772305919.226925:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000120e5172 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98298:x1858396225375232:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 89us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.226932:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 936 00000100:00100000:0.0:1772305919.298775:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.298877:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225375360 00000100:00100000:2.0:1772305919.298939:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 937 00000100:00100000:2.0:1772305919.298950:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fbb012e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+63:98314:x1858396225375360:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1772305919.298985:0:55653:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305919.299015:0:55653:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c6f56f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x329:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ef32 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.299141:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c6f576 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x32a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.299161:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c6f576 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.299182:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c6f576 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1772305919.299195:0:55653:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x32a:0x0]: returning size 0 00010000:00010000:2.0:1772305919.299351:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c6f56f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x329:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef32 expref: 66 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.299374:0:55653:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c6f576 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef32 expref: 65 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.299385:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32a:0x0].0x0 (0000000058332f7d) 00010000:00010000:2.0:1772305919.299389:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1772305919.299393:0:55653:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001967872f, rc 0) 00000100:00100000:2.0:1772305919.299482:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fbb012e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+65:98314:x1858396225375360:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 532us (715us total) trans 8589934878 rc 0/0 00000100:00100000:2.0:1772305919.299494:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 937 00000100:00100000:3.0:1772305919.300497:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.300547:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225375488 00000100:00100000:2.0:1772305919.300582:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 938 00000100:00100000:2.0:1772305919.300589:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d12426c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+65:98314:x1858396225375488:12345-192.168.203.30@tcp:55:lfs.0 00010000:00010000:2.0:1772305919.300623:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c6f584 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.300661:0:55653:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c6f576 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef32 expref: 65 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.300670:0:55653:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c6f584 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.300716:0:55653:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c6f576 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef32 expref: 65 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.300730:0:55653:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c6f576 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef32 expref: 65 pid: 55653 timeout: 1331 lvb_type: 0 00000100:00100000:2.0:1772305919.300747:0:55653:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d8f6a4e6 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:55653:1858396216604288:192.168.203.30@tcp:104: 00000100:00100000:2.0:1772305919.300821:0:55653:0:(client.c:2500:ptlrpc_set_wait()) set 000000000b475975 going to sleep for 6 seconds 00000100:00100000:2.0:1772305919.301586:0:55653:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d8f6a4e6 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:55653:1858396216604288:192.168.203.30@tcp:104: 00010000:00010000:2.0:1772305919.301612:0:55653:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c6f584 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305919.301767:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305919.301824:0:5494:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225375552 00010000:00010000:0.0:1772305919.301849:0:5494:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c6f576 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef32 expref: 66 pid: 55653 timeout: 1331 lvb_type: 0 00000100:00100000:0.0:1772305919.301886:0:5494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3101 00000100:00100000:0.0:1772305919.301892:0:5494:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d6661384 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+66:2216:x1858396225375552:12345-192.168.203.30@tcp:103:ldlm_bl_06.0 00010000:00010000:0.0:1772305919.301906:0:5494:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1772305919.301914:0:5494:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c6f576 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef32 expref: 66 pid: 55653 timeout: 1331 lvb_type: 0 00010000:00010000:0.0:1772305919.301949:0:5494:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c6f576 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef32 expref: 66 pid: 55653 timeout: 1331 lvb_type: 0 00010000:00010000:0.0:1772305919.301967:0:5494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c6f576 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef32 expref: 66 pid: 55653 timeout: 1331 lvb_type: 0 00010000:00010000:0.0:1772305919.301978:0:5494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32a:0x0].0x0 (0000000058332f7d) 00010000:00010000:0.0:1772305919.301981:0:5494:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c6f584 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305919.301987:0:5494:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c6f584 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305919.301991:0:5494:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c6f584 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305919.302012:0:5494:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1772305919.302041:0:55653:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c6f584 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305919.302041:0:5494:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d6661384 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+65:2216:x1858396225375552:12345-192.168.203.30@tcp:103:ldlm_bl_06.0 Request processed in 148us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305919.302056:0:5494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3101 00010000:00010000:2.0:1772305919.302061:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c6f584 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1772305919.302335:0:55653:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x13:0x0].74, 168 off20432 00010000:00010000:2.0:1772305919.302404:0:55653:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c6f584 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.302415:0:55653:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c6f584 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.302438:0:55653:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c6f584 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.302452:0:55653:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e5e5320a already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305919.302457:0:55653:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c6f584 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.302465:0:55653:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c6f584 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.302475:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32a:0x0].0x0 (0000000058332f7d) 00010000:00010000:2.0:1772305919.302478:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1772305919.302482:0:55653:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c6f584 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.302488:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c6f584 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305919.302538:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d12426c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+65:98314:x1858396225375488:12345-192.168.203.30@tcp:55:lfs.0 Request processed in 1949us (2042us total) trans 8589934879 rc 0/0 00000100:00100000:2.0:1772305919.302547:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 938 00000100:00100000:3.0:1772305919.303305:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.303360:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225375680 00000100:00100000:2.0:1772305919.303385:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 111 00000100:00100000:2.0:1772305919.303389:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003397d536 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+65:98314:x1858396225375680:12345-192.168.203.30@tcp:35:lfs.0 00000040:00080000:2.0:1772305919.303515:0:57054:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x13:0x0].75, 168 off20600 00000100:00100000:2.0:1772305919.303596:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003397d536 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+66:98314:x1858396225375680:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 205us (293us total) trans 8589934880 rc 0/0 00000100:00100000:2.0:1772305919.303605:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 111 00000100:00100000:1.0:1772305919.324500:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.324555:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225375744 00000100:00100000:2.0:1772305919.324616:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 939 00000100:00100000:2.0:1772305919.324624:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f1168a53 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98323:x1858396225375744:12345-192.168.203.30@tcp:501:chlg_load_threa.0 00000100:00100000:2.0:1772305919.324840:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f1168a53 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98323:x1858396225375744:12345-192.168.203.30@tcp:501:chlg_load_threa.0 Request processed in 216us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.324847:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 939 00000100:00100000:3.0:1772305919.325754:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.325797:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225375808 00000100:00100000:2.0:1772305919.325832:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 940 00000100:00100000:2.0:1772305919.325839:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b82f8f38 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98323:x1858396225375808:12345-192.168.203.30@tcp:503:chlg_load_threa.0 00000100:00100000:2.0:1772305919.326025:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b82f8f38 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98323:x1858396225375808:12345-192.168.203.30@tcp:503:chlg_load_threa.0 Request processed in 186us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.326035:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 940 00000100:00100000:3.0:1772305919.326791:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.326830:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225375872 00000100:00100000:2.0:1772305919.326855:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 941 00000100:00100000:2.0:1772305919.326859:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000009b41aad pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98323:x1858396225375872:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1772305919.326960:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000009b41aad pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98323:x1858396225375872:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 100us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.326967:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 941 00000100:00100000:1.0:1772305919.327566:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.327599:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225375936 00000100:00100000:2.0:1772305919.327620:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 942 00000100:00100000:2.0:1772305919.327646:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cae996b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98323:x1858396225375936:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1772305919.327764:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cae996b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98323:x1858396225375936:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 138us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.327774:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 942 00000100:00100000:3.0:1772305919.328484:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.328514:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225376000 00000100:00100000:2.0:1772305919.328537:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 943 00000100:00100000:2.0:1772305919.328541:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000036860235 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98323:x1858396225376000:12345-192.168.203.30@tcp:501:chlg_load_threa.0 00000100:00100000:2.0:1772305919.328581:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000036860235 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98323:x1858396225376000:12345-192.168.203.30@tcp:501:chlg_load_threa.0 Request processed in 39us (99us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.328586:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 943 00000100:00100000:3.0:1772305919.329188:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.329218:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225376064 00000100:00100000:2.0:1772305919.329240:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 944 00000100:00100000:2.0:1772305919.329244:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008043af1b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98323:x1858396225376064:12345-192.168.203.30@tcp:503:chlg_load_threa.0 00000100:00100000:2.0:1772305919.329315:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008043af1b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98323:x1858396225376064:12345-192.168.203.30@tcp:503:chlg_load_threa.0 Request processed in 71us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.329321:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 944 00000100:00100000:1.0:1772305919.329966:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.330007:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225376128 00000100:00100000:2.0:1772305919.330035:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 945 00000100:00100000:2.0:1772305919.330040:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d0e10cf7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98323:x1858396225376128:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1772305919.330136:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d0e10cf7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98323:x1858396225376128:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 94us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.330144:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 945 00000100:00100000:3.0:1772305919.330754:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.330800:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225376192 00000100:00100000:2.0:1772305919.330826:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 946 00000100:00100000:2.0:1772305919.330832:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000622dfb8f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98323:x1858396225376192:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1772305919.330919:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000622dfb8f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98323:x1858396225376192:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 85us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.330927:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 946 00000100:00100000:3.0:1772305919.402804:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.402893:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225376320 00000100:00100000:2.0:1772305919.402966:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 947 00000100:00100000:2.0:1772305919.402976:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000763eeae7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+66:98341:x1858396225376320:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1772305919.403010:0:55653:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305919.403038:0:55653:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c6f58b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x329:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ef39 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.403160:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c6f592 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x32a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.403179:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c6f592 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.403192:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c6f592 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1772305919.403206:0:55653:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x32a:0x0]: returning size 0 00010000:00010000:2.0:1772305919.403368:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c6f58b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x329:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef39 expref: 69 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.403388:0:55653:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c6f592 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef39 expref: 68 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.403398:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32a:0x0].0x0 (0000000058332f7d) 00010000:00010000:2.0:1772305919.403401:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1772305919.403405:0:55653:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000007129515, rc 0) 00000100:00100000:2.0:1772305919.403498:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000763eeae7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+68:98341:x1858396225376320:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 522us (703us total) trans 8589934881 rc 0/0 00000100:00100000:2.0:1772305919.403508:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 947 00000100:00100000:1.0:1772305919.404465:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.404511:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225376448 00000100:00100000:2.0:1772305919.404544:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 948 00000100:00100000:2.0:1772305919.404549:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000045e54637 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+68:98341:x1858396225376448:12345-192.168.203.30@tcp:55:lfs.0 00010000:00010000:2.0:1772305919.404580:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f8380462/0xa5e9c8c58c6f5a0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.404591:0:55653:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c6f592 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef39 expref: 68 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.404599:0:55653:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f8380462/0xa5e9c8c58c6f5a0 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.404659:0:55653:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c6f592 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef39 expref: 68 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.404673:0:55653:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c6f592 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef39 expref: 68 pid: 55653 timeout: 1331 lvb_type: 0 00000100:00100000:2.0:1772305919.404687:0:55653:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d8f6a4e6 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:55653:1858396216604352:192.168.203.30@tcp:104: 00000100:00100000:2.0:1772305919.404746:0:55653:0:(client.c:2500:ptlrpc_set_wait()) set 00000000d21c3216 going to sleep for 6 seconds 00000100:00100000:2.0:1772305919.405445:0:55653:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d8f6a4e6 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:55653:1858396216604352:192.168.203.30@tcp:104: 00010000:00010000:2.0:1772305919.405479:0:55653:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 00000000f8380462/0xa5e9c8c58c6f5a0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305919.405726:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305919.405772:0:5494:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225376512 00010000:00010000:0.0:1772305919.405792:0:5494:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c6f592 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef39 expref: 69 pid: 55653 timeout: 1331 lvb_type: 0 00000100:00100000:0.0:1772305919.405821:0:5494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3102 00000100:00100000:0.0:1772305919.405825:0:5494:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006ceb8211 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+69:2215:x1858396225376512:12345-192.168.203.30@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1772305919.405834:0:5494:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1772305919.405854:0:5494:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c6f592 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef39 expref: 69 pid: 55653 timeout: 1331 lvb_type: 0 00010000:00010000:0.0:1772305919.405865:0:5494:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c6f592 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef39 expref: 69 pid: 55653 timeout: 1331 lvb_type: 0 00010000:00010000:0.0:1772305919.405877:0:5494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c6f592 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef39 expref: 69 pid: 55653 timeout: 1331 lvb_type: 0 00010000:00010000:0.0:1772305919.405887:0:5494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32a:0x0].0x0 (0000000058332f7d) 00010000:00010000:0.0:1772305919.405889:0:5494:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: 00000000f8380462/0xa5e9c8c58c6f5a0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305919.405896:0:5494:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000f8380462/0xa5e9c8c58c6f5a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305919.405900:0:5494:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f8380462/0xa5e9c8c58c6f5a0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305919.405924:0:5494:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1772305919.405936:0:55653:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 00000000f8380462/0xa5e9c8c58c6f5a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.405944:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f8380462/0xa5e9c8c58c6f5a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305919.405951:0:5494:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006ceb8211 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+68:2215:x1858396225376512:12345-192.168.203.30@tcp:103:ldlm_bl_03.0 Request processed in 124us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305919.405959:0:5494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3102 00000040:00080000:2.0:1772305919.406168:0:55653:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x13:0x0].76, 168 off20768 00010000:00010000:2.0:1772305919.406211:0:55653:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f8380462/0xa5e9c8c58c6f5a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.406220:0:55653:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f8380462/0xa5e9c8c58c6f5a0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.406228:0:55653:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f8380462/0xa5e9c8c58c6f5a0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.406235:0:55653:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f8380462 already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305919.406238:0:55653:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f8380462/0xa5e9c8c58c6f5a0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.406244:0:55653:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f8380462/0xa5e9c8c58c6f5a0 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.406251:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32a:0x0].0x0 (0000000058332f7d) 00010000:00010000:2.0:1772305919.406252:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1772305919.406254:0:55653:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f8380462/0xa5e9c8c58c6f5a0 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.406258:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f8380462/0xa5e9c8c58c6f5a0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305919.406291:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000045e54637 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+68:98341:x1858396225376448:12345-192.168.203.30@tcp:55:lfs.0 Request processed in 1742us (1827us total) trans 8589934882 rc 0/0 00000100:00100000:2.0:1772305919.406298:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 948 00000100:00100000:1.0:1772305919.406961:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.407010:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225376640 00000100:00100000:2.0:1772305919.407044:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 112 00000100:00100000:2.0:1772305919.407051:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a655c9ec pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+68:98341:x1858396225376640:12345-192.168.203.30@tcp:35:lfs.0 00000040:00080000:2.0:1772305919.407177:0:57054:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x13:0x0].77, 168 off20936 00000100:00100000:2.0:1772305919.407260:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a655c9ec pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+69:98341:x1858396225376640:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 208us (300us total) trans 8589934883 rc 0/0 00000100:00100000:2.0:1772305919.407268:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 112 00000100:00100000:3.0:1772305919.424217:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.424316:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225376704 00000100:00100000:2.0:1772305919.424380:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 949 00000100:00100000:2.0:1772305919.424390:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000276761c7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98350:x1858396225376704:12345-192.168.203.30@tcp:501:chlg_load_threa.0 00000100:00100000:2.0:1772305919.424609:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000276761c7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98350:x1858396225376704:12345-192.168.203.30@tcp:501:chlg_load_threa.0 Request processed in 220us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.424619:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 949 00000100:00100000:3.0:1772305919.425290:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.425341:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225376768 00000100:00100000:2.0:1772305919.425373:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 950 00000100:00100000:2.0:1772305919.425378:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007af842fc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98350:x1858396225376768:12345-192.168.203.30@tcp:503:chlg_load_threa.0 00000100:00100000:2.0:1772305919.425576:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007af842fc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98350:x1858396225376768:12345-192.168.203.30@tcp:503:chlg_load_threa.0 Request processed in 197us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.425586:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 950 00000100:00100000:1.0:1772305919.426283:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.426338:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225376832 00000100:00100000:2.0:1772305919.426367:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 951 00000100:00100000:2.0:1772305919.426372:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001a9ec63b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98350:x1858396225376832:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1772305919.426520:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001a9ec63b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98350:x1858396225376832:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 146us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.426529:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 951 00000100:00100000:3.0:1772305919.427208:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.427260:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225376896 00000100:00100000:2.0:1772305919.427290:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 952 00000100:00100000:2.0:1772305919.427298:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008f2b99af pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98350:x1858396225376896:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1772305919.427420:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008f2b99af pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98350:x1858396225376896:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 122us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.427445:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 952 00000100:00100000:3.0:1772305919.428257:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.428298:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225376960 00000100:00100000:2.0:1772305919.428334:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 953 00000100:00100000:2.0:1772305919.428339:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000028e6916d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98350:x1858396225376960:12345-192.168.203.30@tcp:501:chlg_load_threa.0 00000100:00100000:2.0:1772305919.428387:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000028e6916d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98350:x1858396225376960:12345-192.168.203.30@tcp:501:chlg_load_threa.0 Request processed in 46us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.428395:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 953 00000100:00100000:1.0:1772305919.429225:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.429267:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225377024 00000100:00100000:2.0:1772305919.429293:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 954 00000100:00100000:2.0:1772305919.429296:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001774aae5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98350:x1858396225377024:12345-192.168.203.30@tcp:503:chlg_load_threa.0 00000100:00100000:2.0:1772305919.429370:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001774aae5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98350:x1858396225377024:12345-192.168.203.30@tcp:503:chlg_load_threa.0 Request processed in 71us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.429379:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 954 00000100:00100000:3.0:1772305919.430031:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.430068:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225377088 00000100:00100000:2.0:1772305919.430092:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 955 00000100:00100000:2.0:1772305919.430095:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007de8ec07 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98350:x1858396225377088:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1772305919.430175:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007de8ec07 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98350:x1858396225377088:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 78us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.430181:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 955 00000100:00100000:3.0:1772305919.430809:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.430853:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225377152 00000100:00100000:2.0:1772305919.430878:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 956 00000100:00100000:2.0:1772305919.430882:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000000d187c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98350:x1858396225377152:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1772305919.430951:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000000d187c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98350:x1858396225377152:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 68us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.430957:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 956 00000100:00100000:1.0:1772305919.510897:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.510986:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225377280 00000100:00100000:2.0:1772305919.511046:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 957 00000100:00100000:2.0:1772305919.511053:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009c8771ec pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+69:98370:x1858396225377280:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1772305919.511083:0:55653:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305919.511112:0:55653:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f8380462/0xa5e9c8c58c6f5a7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x329:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ef40 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.511218:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c6f5ae lrc: 3/0,1 mode: --/CW res: [0x200000402:0x32a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.511232:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c6f5ae lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.511242:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c6f5ae lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1772305919.511264:0:55653:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x32a:0x0]: returning size 0 00010000:00010000:2.0:1772305919.511391:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f8380462/0xa5e9c8c58c6f5a7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x329:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef40 expref: 72 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.511407:0:55653:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c6f5ae lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef40 expref: 71 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.511414:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32a:0x0].0x0 (0000000058332f7d) 00010000:00010000:2.0:1772305919.511417:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1772305919.511420:0:55653:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e5e5320a, rc 0) 00000100:00100000:2.0:1772305919.511510:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009c8771ec pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+71:98370:x1858396225377280:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 456us (624us total) trans 8589934884 rc 0/0 00000100:00100000:2.0:1772305919.511516:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 957 00000100:00100000:3.0:1772305919.512695:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.512730:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225377408 00000100:00100000:2.0:1772305919.512754:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 958 00000100:00100000:2.0:1772305919.512757:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000040ceeec7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+71:98370:x1858396225377408:12345-192.168.203.30@tcp:55:lfs.0 00010000:00010000:2.0:1772305919.512783:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c6f5bc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.512792:0:55653:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c6f5ae lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef40 expref: 71 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.512798:0:55653:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c6f5bc lrc: 4/0,1 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.512830:0:55653:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c6f5ae lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef40 expref: 71 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.512840:0:55653:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c6f5ae lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef40 expref: 71 pid: 55653 timeout: 1331 lvb_type: 0 00000100:00100000:2.0:1772305919.512851:0:55653:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000010b5ceff pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:55653:1858396216604416:192.168.203.30@tcp:104: 00000100:00100000:2.0:1772305919.512902:0:55653:0:(client.c:2500:ptlrpc_set_wait()) set 00000000d09bdfa5 going to sleep for 6 seconds 00000100:00100000:2.0:1772305919.513797:0:55653:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000010b5ceff pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:55653:1858396216604416:192.168.203.30@tcp:104: 00010000:00010000:2.0:1772305919.513818:0:55653:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c6f5bc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305919.513905:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305919.513982:0:5494:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225377472 00010000:00010000:0.0:1772305919.514009:0:5494:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c6f5ae lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef40 expref: 72 pid: 55653 timeout: 1331 lvb_type: 0 00000100:00100000:0.0:1772305919.514046:0:5494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3103 00000100:00100000:0.0:1772305919.514052:0:5494:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000282b51c2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+72:2216:x1858396225377472:12345-192.168.203.30@tcp:103:ldlm_bl_08.0 00010000:00010000:0.0:1772305919.514106:0:5494:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1772305919.514113:0:5494:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c6f5ae lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef40 expref: 72 pid: 55653 timeout: 1331 lvb_type: 0 00010000:00010000:0.0:1772305919.514126:0:5494:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c6f5ae lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef40 expref: 72 pid: 55653 timeout: 1331 lvb_type: 0 00010000:00010000:0.0:1772305919.514141:0:5494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c6f5ae lrc: 0/0,0 mode: --/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef40 expref: 72 pid: 55653 timeout: 1331 lvb_type: 0 00010000:00010000:0.0:1772305919.514155:0:5494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32a:0x0].0x0 (0000000058332f7d) 00010000:00010000:0.0:1772305919.514158:0:5494:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c6f5bc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305919.514167:0:5494:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c6f5bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305919.514174:0:5494:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c6f5bc lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305919.514212:0:5494:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1772305919.514222:0:55653:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c6f5bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.514230:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c6f5bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305919.514249:0:5494:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000282b51c2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+71:2216:x1858396225377472:12345-192.168.203.30@tcp:103:ldlm_bl_08.0 Request processed in 196us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305919.514258:0:5494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3103 00000040:00080000:2.0:1772305919.514454:0:55653:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x13:0x0].78, 168 off21104 00010000:00010000:2.0:1772305919.514494:0:55653:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c6f5bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.514500:0:55653:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c6f5bc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.514505:0:55653:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c6f5bc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.514509:0:55653:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000089dbe966 already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305919.514513:0:55653:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c6f5bc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.514518:0:55653:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c6f5bc lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.514524:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32a:0x0].0x0 (0000000058332f7d) 00010000:00010000:2.0:1772305919.514526:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1772305919.514528:0:55653:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c6f5bc lrc: 2/0,0 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.514532:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c6f5bc lrc: 0/0,0 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305919.514565:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000040ceeec7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+71:98370:x1858396225377408:12345-192.168.203.30@tcp:55:lfs.0 Request processed in 1807us (1876us total) trans 8589934885 rc 0/0 00000100:00100000:2.0:1772305919.514572:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 958 00000100:00100000:3.0:1772305919.515264:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.515357:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225377600 00000100:00100000:2.0:1772305919.515393:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 113 00000100:00100000:2.0:1772305919.515397:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b0099b15 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+71:98370:x1858396225377600:12345-192.168.203.30@tcp:35:lfs.0 00000040:00080000:2.0:1772305919.515526:0:57054:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x13:0x0].79, 168 off21272 00000100:00100000:2.0:1772305919.515598:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b0099b15 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+72:98370:x1858396225377600:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 200us (338us total) trans 8589934886 rc 0/0 00000100:00100000:2.0:1772305919.515604:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 113 00000100:00100000:3.0:1772305919.531926:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.532047:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225377664 00000100:00100000:2.0:1772305919.532114:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 959 00000100:00100000:2.0:1772305919.532122:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002294ffc2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98379:x1858396225377664:12345-192.168.203.30@tcp:501:chlg_load_threa.0 00000100:00100000:2.0:1772305919.532314:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002294ffc2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98379:x1858396225377664:12345-192.168.203.30@tcp:501:chlg_load_threa.0 Request processed in 192us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.532321:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 959 00000100:00100000:1.0:1772305919.533106:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.533167:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225377728 00000100:00100000:2.0:1772305919.533195:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 960 00000100:00100000:2.0:1772305919.533199:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000032e68268 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98379:x1858396225377728:12345-192.168.203.30@tcp:503:chlg_load_threa.0 00000100:00100000:2.0:1772305919.533382:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000032e68268 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98379:x1858396225377728:12345-192.168.203.30@tcp:503:chlg_load_threa.0 Request processed in 182us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.533389:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 960 00000100:00100000:3.0:1772305919.534093:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.534174:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225377792 00000100:00100000:2.0:1772305919.534203:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 961 00000100:00100000:2.0:1772305919.534208:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001bcee677 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98379:x1858396225377792:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1772305919.534318:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001bcee677 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98379:x1858396225377792:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 109us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.534324:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 961 00000100:00100000:3.0:1772305919.534986:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.535037:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225377856 00000100:00100000:2.0:1772305919.535066:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 962 00000100:00100000:2.0:1772305919.535071:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000edabdca1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98379:x1858396225377856:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1772305919.535177:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000edabdca1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98379:x1858396225377856:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 104us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.535186:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 962 00000100:00100000:1.0:1772305919.535902:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.535935:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225377920 00000100:00100000:2.0:1772305919.535960:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 963 00000100:00100000:2.0:1772305919.535963:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e43a966f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98379:x1858396225377920:12345-192.168.203.30@tcp:501:chlg_load_threa.0 00000100:00100000:2.0:1772305919.536013:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e43a966f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98379:x1858396225377920:12345-192.168.203.30@tcp:501:chlg_load_threa.0 Request processed in 46us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.536021:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 963 00000100:00100000:3.0:1772305919.536606:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.536694:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225377984 00000100:00100000:2.0:1772305919.536738:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 964 00000100:00100000:2.0:1772305919.536743:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000011976c6e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98379:x1858396225377984:12345-192.168.203.30@tcp:503:chlg_load_threa.0 00000100:00100000:2.0:1772305919.536838:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000011976c6e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98379:x1858396225377984:12345-192.168.203.30@tcp:503:chlg_load_threa.0 Request processed in 94us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.536846:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 964 00000100:00100000:0.0:1772305919.537480:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.537515:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225378048 00000100:00100000:2.0:1772305919.537540:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 965 00000100:00100000:2.0:1772305919.537543:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000026617907 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98379:x1858396225378048:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1772305919.537619:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000026617907 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98379:x1858396225378048:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 74us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.537648:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 965 00000100:00100000:1.0:1772305919.538226:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.538261:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225378112 00000100:00100000:2.0:1772305919.538283:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 966 00000100:00100000:2.0:1772305919.538287:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003bb53c21 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98379:x1858396225378112:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1772305919.538356:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003bb53c21 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98379:x1858396225378112:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 68us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.538362:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 966 00000100:00100000:3.0:1772305919.626945:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.627034:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225378240 00000100:00100000:2.0:1772305919.627107:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 967 00000100:00100000:2.0:1772305919.627114:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008a50b90b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+72:98401:x1858396225378240:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1772305919.627148:0:55653:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305919.627173:0:55653:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c6f5c3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x329:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ef47 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.627303:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f8380462/0xa5e9c8c58c6f5ca lrc: 3/0,1 mode: --/CW res: [0x200000402:0x32a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.627323:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f8380462/0xa5e9c8c58c6f5ca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.627337:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f8380462/0xa5e9c8c58c6f5ca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1772305919.627357:0:55653:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x32a:0x0]: returning size 0 00010000:00010000:2.0:1772305919.627537:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c6f5c3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x329:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef47 expref: 75 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.627555:0:55653:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000f8380462/0xa5e9c8c58c6f5ca lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef47 expref: 74 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.627562:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32a:0x0].0x0 (0000000058332f7d) 00010000:00010000:2.0:1772305919.627564:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1772305919.627566:0:55653:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f8380462, rc 0) 00000100:00100000:2.0:1772305919.627680:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008a50b90b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+74:98401:x1858396225378240:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 566us (742us total) trans 8589934887 rc 0/0 00000100:00100000:2.0:1772305919.627686:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 967 00000100:00100000:0.0:1772305919.629148:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.629197:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225378368 00000100:00100000:2.0:1772305919.629228:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 968 00000100:00100000:2.0:1772305919.629235:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c60a4162 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+74:98401:x1858396225378368:12345-192.168.203.30@tcp:55:lfs.0 00010000:00010000:2.0:1772305919.629269:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6f5d8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.629282:0:55653:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000f8380462/0xa5e9c8c58c6f5ca lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef47 expref: 74 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.629288:0:55653:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6f5d8 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.629319:0:55653:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000f8380462/0xa5e9c8c58c6f5ca lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef47 expref: 74 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.629333:0:55653:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000f8380462/0xa5e9c8c58c6f5ca lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef47 expref: 74 pid: 55653 timeout: 1331 lvb_type: 0 00000100:00100000:2.0:1772305919.629345:0:55653:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000010b5ceff pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:55653:1858396216604480:192.168.203.30@tcp:104: 00000100:00100000:2.0:1772305919.629396:0:55653:0:(client.c:2500:ptlrpc_set_wait()) set 000000008c41a716 going to sleep for 6 seconds 00000100:00100000:2.0:1772305919.630249:0:55653:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000010b5ceff pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:55653:1858396216604480:192.168.203.30@tcp:104: 00010000:00010000:2.0:1772305919.630273:0:55653:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6f5d8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305919.630444:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305919.630561:0:5494:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225378432 00010000:00010000:3.0:1772305919.630595:0:5494:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f8380462/0xa5e9c8c58c6f5ca lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef47 expref: 75 pid: 55653 timeout: 1331 lvb_type: 0 00000100:00100000:3.0:1772305919.630684:0:5494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3104 00000100:00100000:3.0:1772305919.630692:0:5494:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ebc3b500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+75:2215:x1858396225378432:12345-192.168.203.30@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1772305919.630707:0:5494:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1772305919.630713:0:5494:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000f8380462/0xa5e9c8c58c6f5ca lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef47 expref: 75 pid: 55653 timeout: 1331 lvb_type: 0 00010000:00010000:3.0:1772305919.630723:0:5494:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000f8380462/0xa5e9c8c58c6f5ca lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef47 expref: 75 pid: 55653 timeout: 1331 lvb_type: 0 00010000:00010000:3.0:1772305919.630741:0:5494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f8380462/0xa5e9c8c58c6f5ca lrc: 0/0,0 mode: --/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef47 expref: 75 pid: 55653 timeout: 1331 lvb_type: 0 00010000:00010000:3.0:1772305919.630774:0:5494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32a:0x0].0x0 (0000000058332f7d) 00010000:00010000:3.0:1772305919.630777:0:5494:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6f5d8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305919.630786:0:5494:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6f5d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305919.630792:0:5494:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6f5d8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305919.630816:0:5494:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1772305919.630844:0:55653:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6f5d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.630854:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6f5d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305919.630881:0:5494:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ebc3b500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+74:2215:x1858396225378432:12345-192.168.203.30@tcp:103:ldlm_bl_02.0 Request processed in 188us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305919.630888:0:5494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3104 00000040:00080000:2.0:1772305919.631093:0:55653:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x13:0x0].80, 168 off21440 00010000:00010000:2.0:1772305919.631134:0:55653:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6f5d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.631141:0:55653:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6f5d8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.631146:0:55653:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6f5d8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.631151:0:55653:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006c757b88 already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305919.631154:0:55653:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6f5d8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.631161:0:55653:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6f5d8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.631172:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32a:0x0].0x0 (0000000058332f7d) 00010000:00010000:2.0:1772305919.631175:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1772305919.631178:0:55653:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6f5d8 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.631185:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6f5d8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305919.631235:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c60a4162 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+74:98401:x1858396225378368:12345-192.168.203.30@tcp:55:lfs.0 Request processed in 1999us (2087us total) trans 8589934888 rc 0/0 00000100:00100000:2.0:1772305919.631242:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 968 00000100:00100000:0.0:1772305919.631883:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.631923:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225378560 00000100:00100000:2.0:1772305919.631952:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 114 00000100:00100000:2.0:1772305919.631956:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005b0c5d35 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+74:98401:x1858396225378560:12345-192.168.203.30@tcp:35:lfs.0 00000040:00080000:2.0:1772305919.632049:0:57054:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x13:0x0].81, 168 off21608 00000100:00100000:2.0:1772305919.632112:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005b0c5d35 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+75:98401:x1858396225378560:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 155us (232us total) trans 8589934889 rc 0/0 00000100:00100000:2.0:1772305919.632118:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 114 00000100:00100000:1.0:1772305919.648673:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.648779:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225378624 00000100:00100000:2.0:1772305919.648831:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 969 00000100:00100000:2.0:1772305919.648838:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003e88e354 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98410:x1858396225378624:12345-192.168.203.30@tcp:501:chlg_load_threa.0 00000100:00100000:2.0:1772305919.649003:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003e88e354 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98410:x1858396225378624:12345-192.168.203.30@tcp:501:chlg_load_threa.0 Request processed in 165us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.649014:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 969 00000100:00100000:0.0:1772305919.649892:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.649958:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225378688 00000100:00100000:2.0:1772305919.649984:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 970 00000100:00100000:2.0:1772305919.649988:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b04e3f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98410:x1858396225378688:12345-192.168.203.30@tcp:503:chlg_load_threa.0 00000100:00100000:2.0:1772305919.650139:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b04e3f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98410:x1858396225378688:12345-192.168.203.30@tcp:503:chlg_load_threa.0 Request processed in 150us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.650146:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 970 00000100:00100000:0.0:1772305919.650908:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.650957:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225378752 00000100:00100000:2.0:1772305919.650987:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 971 00000100:00100000:2.0:1772305919.650991:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000088035587 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98410:x1858396225378752:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1772305919.651090:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000088035587 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98410:x1858396225378752:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 98us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.651096:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 971 00000100:00100000:1.0:1772305919.651735:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.651779:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225378816 00000100:00100000:2.0:1772305919.651802:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 972 00000100:00100000:2.0:1772305919.651806:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a7458d21 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98410:x1858396225378816:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1772305919.651893:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a7458d21 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98410:x1858396225378816:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 86us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.651899:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 972 00000100:00100000:0.0:1772305919.652601:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.652695:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225378880 00000100:00100000:2.0:1772305919.652726:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 973 00000100:00100000:2.0:1772305919.652731:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e2ba2fc8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98410:x1858396225378880:12345-192.168.203.30@tcp:501:chlg_load_threa.0 00000100:00100000:2.0:1772305919.652789:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e2ba2fc8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98410:x1858396225378880:12345-192.168.203.30@tcp:501:chlg_load_threa.0 Request processed in 57us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.652798:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 973 00000100:00100000:0.0:1772305919.653418:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.653471:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225378944 00000100:00100000:2.0:1772305919.653501:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 974 00000100:00100000:2.0:1772305919.653504:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005114ebc1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98410:x1858396225378944:12345-192.168.203.30@tcp:503:chlg_load_threa.0 00000100:00100000:2.0:1772305919.653580:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005114ebc1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98410:x1858396225378944:12345-192.168.203.30@tcp:503:chlg_load_threa.0 Request processed in 74us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.653587:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 974 00000100:00100000:1.0:1772305919.654226:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.654298:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225379008 00000100:00100000:2.0:1772305919.654329:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 975 00000100:00100000:2.0:1772305919.654334:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d2a6474b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98410:x1858396225379008:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1772305919.654420:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d2a6474b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98410:x1858396225379008:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 85us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.654440:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 975 00000100:00100000:0.0:1772305919.655074:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.655106:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225379072 00000100:00100000:2.0:1772305919.655129:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 976 00000100:00100000:2.0:1772305919.655133:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005e7bbe3c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98410:x1858396225379072:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1772305919.655206:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005e7bbe3c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98410:x1858396225379072:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 72us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.655212:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 976 00010000:00010000:2.0:1772305919.688801:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1772305919.750579:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.750673:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225379200 00000100:00100000:2.0:1772305919.750741:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 977 00000100:00100000:2.0:1772305919.750757:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000774a31b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+75:98434:x1858396225379200:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1772305919.750797:0:55653:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305919.750824:0:55653:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6f5df lrc: 2/0,0 mode: --/CR res: [0x200000402:0x329:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ef4e expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.750932:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c6f5e6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x32a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.750947:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c6f5e6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.750957:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c6f5e6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1772305919.750969:0:55653:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x32a:0x0]: returning size 0 00010000:00010000:2.0:1772305919.751095:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6f5df lrc: 0/0,0 mode: --/CR res: [0x200000402:0x329:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef4e expref: 78 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.751112:0:55653:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c6f5e6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef4e expref: 77 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.751118:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32a:0x0].0x0 (0000000058332f7d) 00010000:00010000:2.0:1772305919.751121:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1772305919.751124:0:55653:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000089dbe966, rc 0) 00000100:00100000:2.0:1772305919.751181:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000774a31b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+77:98434:x1858396225379200:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 432us (612us total) trans 8589934890 rc 0/0 00000100:00100000:2.0:1772305919.751187:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 977 00000100:00100000:1.0:1772305919.752226:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.752270:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225379328 00000100:00100000:2.0:1772305919.752298:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 978 00000100:00100000:2.0:1772305919.752304:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000083531784 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+77:98434:x1858396225379328:12345-192.168.203.30@tcp:55:lfs.0 00010000:00010000:2.0:1772305919.752338:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6f5f4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.752351:0:55653:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c6f5e6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef4e expref: 77 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.752358:0:55653:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6f5f4 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.752388:0:55653:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c6f5e6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef4e expref: 77 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.752398:0:55653:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c6f5e6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef4e expref: 77 pid: 55653 timeout: 1331 lvb_type: 0 00000100:00100000:2.0:1772305919.752410:0:55653:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000010b5ceff pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:55653:1858396216604544:192.168.203.30@tcp:104: 00000100:00100000:2.0:1772305919.752488:0:55653:0:(client.c:2500:ptlrpc_set_wait()) set 00000000295256b0 going to sleep for 6 seconds 00000100:00100000:2.0:1772305919.753273:0:55653:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000010b5ceff pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:55653:1858396216604544:192.168.203.30@tcp:104: 00010000:00010000:2.0:1772305919.753294:0:55653:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6f5f4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305919.753458:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305919.753505:0:5494:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225379392 00010000:00010000:3.0:1772305919.753598:0:5494:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c6f5e6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef4e expref: 78 pid: 55653 timeout: 1331 lvb_type: 0 00000100:00100000:3.0:1772305919.753648:0:5494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3105 00000100:00100000:3.0:1772305919.753655:0:5494:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008e88c1b8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+78:2216:x1858396225379392:12345-192.168.203.30@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1772305919.753665:0:5494:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1772305919.753670:0:5494:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c6f5e6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef4e expref: 78 pid: 55653 timeout: 1331 lvb_type: 0 00010000:00010000:3.0:1772305919.753679:0:5494:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c6f5e6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef4e expref: 78 pid: 55653 timeout: 1331 lvb_type: 0 00010000:00010000:3.0:1772305919.753712:0:5494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c6f5e6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef4e expref: 78 pid: 55653 timeout: 1331 lvb_type: 0 00010000:00010000:3.0:1772305919.753721:0:5494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32a:0x0].0x0 (0000000058332f7d) 00010000:00010000:3.0:1772305919.753724:0:5494:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6f5f4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305919.753730:0:5494:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6f5f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305919.753734:0:5494:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6f5f4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305919.753752:0:5494:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1772305919.753778:0:5494:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008e88c1b8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+77:2216:x1858396225379392:12345-192.168.203.30@tcp:103:ldlm_bl_01.0 Request processed in 125us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305919.753785:0:5494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3105 00010000:00010000:2.0:1772305919.753795:0:55653:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6f5f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.753811:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6f5f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1772305919.754058:0:55653:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x13:0x0].82, 168 off21776 00010000:00010000:2.0:1772305919.754113:0:55653:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6f5f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.754123:0:55653:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6f5f4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.754130:0:55653:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6f5f4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.754137:0:55653:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000010dea6ba already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305919.754141:0:55653:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6f5f4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.754149:0:55653:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6f5f4 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.754159:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32a:0x0].0x0 (0000000058332f7d) 00010000:00010000:2.0:1772305919.754162:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1772305919.754166:0:55653:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6f5f4 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.754172:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6f5f4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305919.754219:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000083531784 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+77:98434:x1858396225379328:12345-192.168.203.30@tcp:55:lfs.0 Request processed in 1913us (1993us total) trans 8589934891 rc 0/0 00000100:00100000:2.0:1772305919.754227:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 978 00000100:00100000:1.0:1772305919.754887:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.754934:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225379520 00000100:00100000:2.0:1772305919.754969:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 115 00000100:00100000:2.0:1772305919.754976:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b29332f6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+77:98434:x1858396225379520:12345-192.168.203.30@tcp:35:lfs.0 00000040:00080000:2.0:1772305919.755099:0:57054:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x13:0x0].83, 168 off21944 00000100:00100000:2.0:1772305919.755182:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b29332f6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+78:98434:x1858396225379520:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 206us (295us total) trans 8589934892 rc 0/0 00000100:00100000:2.0:1772305919.755192:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 115 00000100:00100000:0.0:1772305919.760116:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.760157:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225379648 00000100:00100000:2.0:1772305919.760189:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 979 00000100:00100000:2.0:1772305919.760194:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006755215f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+78:98435:x1858396225379648:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1772305919.760203:0:55653:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305919.760211:0:55653:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6f5fb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x329:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ef55 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.760255:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c937f2b9/0xa5e9c8c58c6f602 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x32a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.760263:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c937f2b9/0xa5e9c8c58c6f602 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.760269:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c937f2b9/0xa5e9c8c58c6f602 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1772305919.760275:0:55653:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x32a:0x0]: returning size 0 00010000:00010000:2.0:1772305919.760338:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6f5fb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x329:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef55 expref: 81 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.760353:0:55653:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000c937f2b9/0xa5e9c8c58c6f602 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef55 expref: 80 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.760361:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32a:0x0].0x0 (0000000058332f7d) 00010000:00010000:2.0:1772305919.760364:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1772305919.760367:0:55653:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c937f2b9, rc 0) 00000100:00100000:2.0:1772305919.760397:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006755215f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+80:98435:x1858396225379648:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 202us (283us total) trans 8589934893 rc 0/0 00000100:00100000:2.0:1772305919.760405:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 979 00000100:00100000:0.0:1772305919.761349:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.761395:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225379776 00000100:00100000:2.0:1772305919.761445:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 980 00000100:00100000:2.0:1772305919.761451:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000035fd0397 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+80:98435:x1858396225379776:12345-192.168.203.30@tcp:55:lfs.0 00010000:00010000:2.0:1772305919.761484:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c6f610 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.761499:0:55653:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000c937f2b9/0xa5e9c8c58c6f602 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef55 expref: 80 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.761506:0:55653:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c6f610 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.761535:0:55653:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000c937f2b9/0xa5e9c8c58c6f602 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef55 expref: 80 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.761548:0:55653:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000c937f2b9/0xa5e9c8c58c6f602 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef55 expref: 80 pid: 55653 timeout: 1331 lvb_type: 0 00000100:00100000:2.0:1772305919.761561:0:55653:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000010b5ceff pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:55653:1858396216604608:192.168.203.30@tcp:104: 00000100:00100000:2.0:1772305919.761611:0:55653:0:(client.c:2500:ptlrpc_set_wait()) set 00000000295256b0 going to sleep for 6 seconds 00000100:00100000:2.0:1772305919.762386:0:55653:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000010b5ceff pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:55653:1858396216604608:192.168.203.30@tcp:104: 00010000:00010000:2.0:1772305919.762408:0:55653:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c6f610 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305919.762516:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305919.762551:0:5494:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225379840 00010000:00010000:3.0:1772305919.762573:0:5494:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c937f2b9/0xa5e9c8c58c6f602 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef55 expref: 81 pid: 55653 timeout: 1331 lvb_type: 0 00000100:00100000:3.0:1772305919.762671:0:5494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3106 00000100:00100000:3.0:1772305919.762676:0:5494:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ab80ba74 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+81:2215:x1858396225379840:12345-192.168.203.30@tcp:103:ldlm_bl_05.0 00010000:00010000:3.0:1772305919.762687:0:5494:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1772305919.762691:0:5494:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000c937f2b9/0xa5e9c8c58c6f602 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef55 expref: 81 pid: 55653 timeout: 1331 lvb_type: 0 00010000:00010000:3.0:1772305919.762722:0:5494:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000c937f2b9/0xa5e9c8c58c6f602 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef55 expref: 81 pid: 55653 timeout: 1331 lvb_type: 0 00010000:00010000:3.0:1772305919.762738:0:5494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c937f2b9/0xa5e9c8c58c6f602 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef55 expref: 81 pid: 55653 timeout: 1331 lvb_type: 0 00010000:00010000:3.0:1772305919.762753:0:5494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32a:0x0].0x0 (0000000058332f7d) 00010000:00010000:3.0:1772305919.762757:0:5494:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c6f610 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305919.762766:0:5494:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c6f610 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305919.762773:0:5494:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c6f610 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305919.762795:0:5494:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1772305919.762821:0:5494:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ab80ba74 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+80:2215:x1858396225379840:12345-192.168.203.30@tcp:103:ldlm_bl_05.0 Request processed in 145us (306us total) trans 0 rc 0/0 00010000:00010000:2.0:1772305919.762826:0:55653:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c6f610 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305919.762830:0:5494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3106 00010000:00010000:2.0:1772305919.762840:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c6f610 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1772305919.763048:0:55653:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x13:0x0].84, 168 off22112 00010000:00010000:2.0:1772305919.763093:0:55653:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c6f610 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.763100:0:55653:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c6f610 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.763109:0:55653:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c6f610 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.763116:0:55653:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000004e3177f5 already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305919.763120:0:55653:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c6f610 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.763128:0:55653:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c6f610 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.763138:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32a:0x0].0x0 (0000000058332f7d) 00010000:00010000:2.0:1772305919.763141:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1772305919.763144:0:55653:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c6f610 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.763150:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c6f610 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305919.763198:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000035fd0397 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+80:98435:x1858396225379776:12345-192.168.203.30@tcp:55:lfs.0 Request processed in 1746us (1851us total) trans 8589934894 rc 0/0 00000100:00100000:2.0:1772305919.763206:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 980 00000100:00100000:0.0:1772305919.763931:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.763969:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225379968 00000100:00100000:2.0:1772305919.763995:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 116 00000100:00100000:2.0:1772305919.763999:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000010235c68 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+80:98435:x1858396225379968:12345-192.168.203.30@tcp:35:lfs.0 00000040:00080000:2.0:1772305919.764086:0:57054:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x13:0x0].85, 168 off22280 00000100:00100000:2.0:1772305919.764145:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000010235c68 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+81:98435:x1858396225379968:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 144us (215us total) trans 8589934895 rc 0/0 00000100:00100000:2.0:1772305919.764150:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 116 00000100:00100000:1.0:1772305919.779720:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.779771:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225380032 00000100:00100000:2.0:1772305919.779819:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 981 00000100:00100000:2.0:1772305919.779825:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009b3b63a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98444:x1858396225380032:12345-192.168.203.30@tcp:501:chlg_load_threa.0 00000100:00100000:2.0:1772305919.779988:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009b3b63a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98444:x1858396225380032:12345-192.168.203.30@tcp:501:chlg_load_threa.0 Request processed in 163us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.779995:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 981 00000100:00100000:0.0:1772305919.780778:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.780815:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225380096 00000100:00100000:2.0:1772305919.780838:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 982 00000100:00100000:2.0:1772305919.780842:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000093f32b77 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98444:x1858396225380096:12345-192.168.203.30@tcp:503:chlg_load_threa.0 00000100:00100000:2.0:1772305919.780994:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000093f32b77 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98444:x1858396225380096:12345-192.168.203.30@tcp:503:chlg_load_threa.0 Request processed in 151us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.781000:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 982 00000100:00100000:0.0:1772305919.781695:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.781725:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225380160 00000100:00100000:2.0:1772305919.781752:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 983 00000100:00100000:2.0:1772305919.781758:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bcaf406f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98444:x1858396225380160:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1772305919.781881:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bcaf406f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98444:x1858396225380160:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 122us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.781890:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 983 00000100:00100000:1.0:1772305919.782467:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.782501:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225380224 00000100:00100000:2.0:1772305919.782523:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 984 00000100:00100000:2.0:1772305919.782527:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bb867392 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98444:x1858396225380224:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1772305919.782651:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bb867392 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98444:x1858396225380224:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 122us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.782658:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 984 00000100:00100000:0.0:1772305919.783273:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.783308:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225380288 00000100:00100000:2.0:1772305919.783333:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 985 00000100:00100000:2.0:1772305919.783336:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000465b750e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98444:x1858396225380288:12345-192.168.203.30@tcp:501:chlg_load_threa.0 00000100:00100000:2.0:1772305919.783376:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000465b750e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98444:x1858396225380288:12345-192.168.203.30@tcp:501:chlg_load_threa.0 Request processed in 38us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.783383:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 985 00000100:00100000:0.0:1772305919.783940:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.783971:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225380352 00000100:00100000:2.0:1772305919.783993:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 986 00000100:00100000:2.0:1772305919.783996:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e5233900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98444:x1858396225380352:12345-192.168.203.30@tcp:503:chlg_load_threa.0 00000100:00100000:2.0:1772305919.784065:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e5233900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98444:x1858396225380352:12345-192.168.203.30@tcp:503:chlg_load_threa.0 Request processed in 67us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.784070:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 986 00000100:00100000:3.0:1772305919.784715:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.784746:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225380416 00000100:00100000:2.0:1772305919.784784:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 987 00000100:00100000:2.0:1772305919.784789:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000282b51c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98444:x1858396225380416:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1772305919.784866:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000282b51c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98444:x1858396225380416:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 77us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.784873:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 987 00000100:00100000:0.0:1772305919.785604:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.785651:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225380480 00000100:00100000:2.0:1772305919.785673:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 988 00000100:00100000:2.0:1772305919.785676:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000018cf3b39 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98444:x1858396225380480:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1772305919.785741:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000018cf3b39 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98444:x1858396225380480:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 64us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.785748:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 988 00000100:00100000:0.0:1772305919.895157:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.895261:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225380608 00000100:00100000:2.0:1772305919.895331:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 989 00000100:00100000:2.0:1772305919.895341:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000021de7235 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+81:98472:x1858396225380608:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1772305919.895376:0:55653:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305919.895403:0:55653:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c6f617 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x329:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ef5c expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.895546:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6f61e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x32a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.895565:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6f61e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.895578:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6f61e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1772305919.895598:0:55653:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x32a:0x0]: returning size 0 00010000:00010000:2.0:1772305919.895829:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c6f617 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x329:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef5c expref: 84 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.895851:0:55653:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6f61e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef5c expref: 83 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.895860:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32a:0x0].0x0 (0000000058332f7d) 00010000:00010000:2.0:1772305919.895863:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1772305919.895868:0:55653:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006c757b88, rc 0) 00000100:00100000:2.0:1772305919.895937:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000021de7235 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+83:98472:x1858396225380608:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 596us (790us total) trans 8589934896 rc 0/0 00000100:00100000:2.0:1772305919.895946:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 989 00000100:00100000:3.0:1772305919.896926:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.896971:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225380736 00000100:00100000:2.0:1772305919.897003:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 990 00000100:00100000:2.0:1772305919.897008:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ebc3b500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+83:98472:x1858396225380736:12345-192.168.203.30@tcp:55:lfs.0 00010000:00010000:2.0:1772305919.897040:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6f62c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.897052:0:55653:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6f61e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef5c expref: 83 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.897061:0:55653:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6f62c lrc: 4/0,1 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.897101:0:55653:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6f61e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef5c expref: 83 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.897121:0:55653:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6f61e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef5c expref: 83 pid: 55653 timeout: 1331 lvb_type: 0 00000100:00100000:2.0:1772305919.897136:0:55653:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000010b5ceff pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:55653:1858396216604672:192.168.203.30@tcp:104: 00000100:00100000:2.0:1772305919.897199:0:55653:0:(client.c:2500:ptlrpc_set_wait()) set 00000000d09bdfa5 going to sleep for 6 seconds 00000100:00100000:2.0:1772305919.898041:0:55653:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000010b5ceff pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:55653:1858396216604672:192.168.203.30@tcp:104: 00010000:00010000:2.0:1772305919.898063:0:55653:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6f62c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305919.898243:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305919.898299:0:5494:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225380800 00010000:00010000:0.0:1772305919.898321:0:5494:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6f61e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef5c expref: 84 pid: 55653 timeout: 1331 lvb_type: 0 00000100:00100000:0.0:1772305919.898352:0:5494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3107 00000100:00100000:0.0:1772305919.898358:0:5494:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000830ec897 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+84:2216:x1858396225380800:12345-192.168.203.30@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1772305919.898372:0:5494:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1772305919.898379:0:5494:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6f61e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef5c expref: 84 pid: 55653 timeout: 1331 lvb_type: 0 00010000:00010000:0.0:1772305919.898392:0:5494:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6f61e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef5c expref: 84 pid: 55653 timeout: 1331 lvb_type: 0 00010000:00010000:0.0:1772305919.898440:0:5494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6f61e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x32a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef5c expref: 84 pid: 55653 timeout: 1331 lvb_type: 0 00010000:00010000:0.0:1772305919.898454:0:5494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32a:0x0].0x0 (0000000058332f7d) 00010000:00010000:0.0:1772305919.898457:0:5494:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6f62c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305919.898466:0:5494:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6f62c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305919.898473:0:5494:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6f62c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305919.898497:0:5494:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1772305919.898525:0:55653:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6f62c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305919.898533:0:5494:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000830ec897 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+83:2216:x1858396225380800:12345-192.168.203.30@tcp:103:ldlm_bl_04.0 Request processed in 172us (286us total) trans 0 rc 0/0 00010000:00010000:2.0:1772305919.898548:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6f62c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305919.898553:0:5494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3107 00000040:00080000:2.0:1772305919.898819:0:55653:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x13:0x0].86, 168 off22448 00010000:00010000:2.0:1772305919.898878:0:55653:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6f62c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.898888:0:55653:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6f62c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.898896:0:55653:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6f62c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.898903:0:55653:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000010dea6ba already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305919.898907:0:55653:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6f62c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.898915:0:55653:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6f62c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.898925:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32a:0x0].0x0 (0000000058332f7d) 00010000:00010000:2.0:1772305919.898928:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1772305919.898931:0:55653:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6f62c lrc: 2/0,0 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305919.898937:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6f62c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x32a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305919.898981:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ebc3b500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+83:98472:x1858396225380736:12345-192.168.203.30@tcp:55:lfs.0 Request processed in 1971us (2057us total) trans 8589934897 rc 0/0 00000100:00100000:2.0:1772305919.898990:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 990 00000100:00100000:3.0:1772305919.899677:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.899720:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225380928 00000100:00100000:2.0:1772305919.899757:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 117 00000100:00100000:2.0:1772305919.899763:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006408bd99 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+83:98472:x1858396225380928:12345-192.168.203.30@tcp:35:lfs.0 00000040:00080000:2.0:1772305919.899891:0:57054:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x13:0x0].87, 168 off22616 00000100:00100000:2.0:1772305919.899976:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006408bd99 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+84:98472:x1858396225380928:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 212us (299us total) trans 8589934898 rc 0/0 00000100:00100000:2.0:1772305919.899984:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 117 00000100:00100000:0.0:1772305919.921051:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.921130:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225380992 00000100:00100000:2.0:1772305919.921199:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 991 00000100:00100000:2.0:1772305919.921208:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cb35ac6f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98481:x1858396225380992:12345-192.168.203.30@tcp:501:chlg_load_threa.0 00000100:00100000:2.0:1772305919.921453:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cb35ac6f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98481:x1858396225380992:12345-192.168.203.30@tcp:501:chlg_load_threa.0 Request processed in 244us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.921468:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 991 00000100:00100000:3.0:1772305919.922321:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.922365:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225381056 00000100:00100000:2.0:1772305919.922398:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 992 00000100:00100000:2.0:1772305919.922403:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000011939cae pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98481:x1858396225381056:12345-192.168.203.30@tcp:503:chlg_load_threa.0 00000100:00100000:2.0:1772305919.922656:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000011939cae pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98481:x1858396225381056:12345-192.168.203.30@tcp:503:chlg_load_threa.0 Request processed in 250us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.922664:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 992 00000100:00100000:3.0:1772305919.923336:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.923386:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225381120 00000100:00100000:2.0:1772305919.923417:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 993 00000100:00100000:2.0:1772305919.923437:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d4d8044c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98481:x1858396225381120:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1772305919.923572:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d4d8044c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98481:x1858396225381120:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 134us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.923581:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 993 00000100:00100000:0.0:1772305919.924240:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.924286:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225381184 00000100:00100000:2.0:1772305919.924316:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 994 00000100:00100000:2.0:1772305919.924321:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000de20b528 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98481:x1858396225381184:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1772305919.924464:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000de20b528 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98481:x1858396225381184:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 142us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.924473:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 994 00000100:00100000:3.0:1772305919.925204:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.925256:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225381248 00000100:00100000:2.0:1772305919.925287:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 995 00000100:00100000:2.0:1772305919.925292:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000039b4b25e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98481:x1858396225381248:12345-192.168.203.30@tcp:501:chlg_load_threa.0 00000100:00100000:2.0:1772305919.925343:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000039b4b25e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98481:x1858396225381248:12345-192.168.203.30@tcp:501:chlg_load_threa.0 Request processed in 50us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.925352:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 995 00000100:00100000:3.0:1772305919.925941:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.925982:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225381312 00000100:00100000:2.0:1772305919.926013:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 996 00000100:00100000:2.0:1772305919.926018:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000af091ea6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98481:x1858396225381312:12345-192.168.203.30@tcp:503:chlg_load_threa.0 00000100:00100000:2.0:1772305919.926107:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000af091ea6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98481:x1858396225381312:12345-192.168.203.30@tcp:503:chlg_load_threa.0 Request processed in 88us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.926117:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 996 00000100:00100000:0.0:1772305919.926766:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305919.926806:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225381376 00000100:00100000:2.0:1772305919.926836:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 997 00000100:00100000:2.0:1772305919.926842:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000099e4fbd0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98481:x1858396225381376:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1772305919.926938:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000099e4fbd0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98481:x1858396225381376:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 95us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305919.926947:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 997 00000100:00100000:3.0:1772305919.927669:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305919.927738:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225381440 00000100:00100000:1.0:1772305919.927775:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 998 00000100:00100000:1.0:1772305919.927781:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000084809c1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98481:x1858396225381440:12345-192.168.203.30@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1772305919.927899:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000084809c1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:98481:x1858396225381440:12345-192.168.203.30@tcp:502:chlg_load_threa.0 Request processed in 117us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305919.927908:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 998 00010000:00010000:1.0:1772305920.712771:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1772305920.985709:0:6332:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-OST0000: transno 4294968306 is committed 00000001:00080000:0.0:1772305920.986809:0:54724:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934870 is committed 00000001:00080000:0.0:1772305920.986834:0:54724:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934898 is committed 00000001:00080000:0.0:1772305920.986891:0:54724:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934863 is committed 00000001:00080000:0.0:1772305920.986906:0:54724:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934865 is committed 00000001:00080000:2.0:1772305920.987214:0:7114:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-OST0001: transno 4294968346 is committed 00000100:00100000:1.0:1772305921.480798:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007a587e26 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216604736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1772305921.480891:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305921.480939:0:2991:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1772305921.480946:0:7591:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216604736 00000100:00100000:1.0:1772305921.480951:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae5186f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216604800:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1772305921.480997:0:7591:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 455 00000100:00100000:1.0:1772305921.480998:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305921.481006:0:7591:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006ceb8211 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216604736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1772305921.481040:0:7591:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 693174272 pending 0 free 3606052864 avail 3603955712 00000100:00100000:1.0:1772305921.481058:0:6309:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216604800 00000100:00100000:3.0:1772305921.481091:0:7591:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006ceb8211 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216604736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305921.481099:0:7591:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 455 00000100:00100000:1.0:1772305921.481107:0:6309:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 456 00000100:00100000:1.0:1772305921.481116:0:6309:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000924e9251 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216604800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1772305921.481151:0:6309:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 1703936 granted 742326272 pending 0 free 3829399552 avail 3827302400 00000100:00100000:1.0:1772305921.481201:0:6309:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000924e9251 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216604800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305921.481208:0:6309:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 456 00000100:00100000:1.0:1772305921.481248:0:2991:0:(client.c:2868:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968306 gen 2 00000004:00080000:1.0:1772305921.481256:0:2991:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 000000008066f4bf, transno 4294968306 00000100:00100000:1.0:1772305921.481270:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae5186f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216604800:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1772305921.481283:0:2991:0:(client.c:2868:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968346 gen 2 00000004:00080000:1.0:1772305921.481287:0:2991:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 000000001770c2e6, transno 4294968346 00000040:00100000:3.0:1772305921.481293:0:54719:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 9 in log [0xb:0x1:0x0] 00000100:00100000:1.0:1772305921.481299:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007a587e26 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216604736:0@lo:13:osp-pre-1-0.0 00000040:00100000:0.0:1772305921.481309:0:54721:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 11 in log [0xd:0x1:0x0] 00010000:00010000:3.0:1772305921.736729:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1772305921.964759:0:70338:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1772305921.964763:0:70338:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x11:0x1:0x0]:0 at index 1 of catalog [0x6:0xa:0x0] 00000040:00080000:1.0:1772305921.964787:0:70338:0:(llog.c:789:llog_process_thread()) stop processing plain 0x11:1:0 index 14 count 2 00000040:00080000:1.0:1772305921.964792:0:70338:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x6:10:0 index 2 count 2 00000100:00100000:3.0:1772305921.983862:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305921.983935:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225381504 00000100:00100000:1.0:1772305921.984009:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 999 00000100:00100000:1.0:1772305921.984020:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b36dba7e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+66:98937:x1858396225381504:12345-192.168.203.30@tcp:46:lfs.0 00000004:00000080:1.0:1772305921.984062:0:55653:0:(mdt_handler.c:7411:mdt_iocontrol()) handling ioctl cmd 0x424066b3 00000004:00000080:1.0:1772305921.984100:0:55653:0:(mdd_device.c:2125:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=13, endrec=0 00000040:00080000:1.0:1772305921.984189:0:55653:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1772305921.984194:0:55653:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x11:0x1:0x0]:0 at index 1 of catalog [0x6:0xa:0x0] 00000004:00000080:1.0:1772305921.984226:0:55653:0:(mdd_device.c:2095:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl13 endrec = 86 00000040:00080000:1.0:1772305921.984314:0:55653:0:(llog.c:789:llog_process_thread()) stop processing plain 0x11:1:0 index 14 count 2 00000040:00080000:1.0:1772305921.984322:0:55653:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x6:10:0 index 2 count 2 00000004:00000080:1.0:1772305921.984330:0:55653:0:(mdd_device.c:2173:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl13 entries up to 18446744073709551615 00000040:00080000:1.0:1772305921.984357:0:55653:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1772305921.984358:0:55653:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x13:0x1:0x0]:0 at index 1 of catalog [0x5:0xa:0x0] 00000040:00100000:1.0:1772305921.984383:0:55653:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 66 in log [0x13:0x1:0x0] 00000040:00100000:1.0:1772305921.984488:0:55653:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 67 in log [0x13:0x1:0x0] 00000040:00100000:1.0:1772305921.984518:0:55653:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 68 in log [0x13:0x1:0x0] 00000040:00100000:1.0:1772305921.984549:0:55653:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 69 in log [0x13:0x1:0x0] 00000040:00100000:1.0:1772305921.984601:0:55653:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 70 in log [0x13:0x1:0x0] 00000040:00100000:1.0:1772305921.984696:0:55653:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 71 in log [0x13:0x1:0x0] 00000040:00100000:1.0:1772305921.984722:0:55653:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 72 in log [0x13:0x1:0x0] 00000040:00100000:1.0:1772305921.984746:0:55653:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 73 in log [0x13:0x1:0x0] 00000040:00100000:1.0:1772305921.984771:0:55653:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 74 in log [0x13:0x1:0x0] 00000040:00100000:1.0:1772305921.984801:0:55653:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 75 in log [0x13:0x1:0x0] 00000040:00100000:1.0:1772305921.984829:0:55653:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 76 in log [0x13:0x1:0x0] 00000040:00100000:1.0:1772305921.984858:0:55653:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 77 in log [0x13:0x1:0x0] 00000040:00100000:1.0:1772305921.984880:0:55653:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 78 in log [0x13:0x1:0x0] 00000040:00100000:1.0:1772305921.984911:0:55653:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 79 in log [0x13:0x1:0x0] 00000040:00100000:1.0:1772305921.984933:0:55653:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 80 in log [0x13:0x1:0x0] 00000040:00100000:1.0:1772305921.984988:0:55653:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 81 in log [0x13:0x1:0x0] 00000040:00100000:1.0:1772305921.985035:0:55653:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 82 in log [0x13:0x1:0x0] 00000040:00100000:1.0:1772305921.985064:0:55653:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 83 in log [0x13:0x1:0x0] 00000040:00100000:1.0:1772305921.985094:0:55653:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 84 in log [0x13:0x1:0x0] 00000040:00100000:1.0:1772305921.985121:0:55653:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 85 in log [0x13:0x1:0x0] 00000040:00100000:1.0:1772305921.985149:0:55653:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 86 in log [0x13:0x1:0x0] 00000040:00100000:1.0:1772305921.985187:0:55653:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 87 in log [0x13:0x1:0x0] 00000040:00080000:1.0:1772305921.985209:0:55653:0:(llog.c:789:llog_process_thread()) stop processing plain 0x13:1:0 index 87 count 1 00000040:00080000:1.0:1772305921.985213:0:55653:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x5:10:0 index 2 count 2 00000100:00100000:1.0:1772305921.985292:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b36dba7e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+66:98937:x1858396225381504:12345-192.168.203.30@tcp:46:lfs.0 Request processed in 1276us (1512us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305921.985302:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 999 00000100:00100000:3.0:1772305921.993819:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000010b5ceff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:70aae467-c860-409f-ba1b-742f4d042da6:2993:1858396216604864:0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772305921.993838:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d8f6a4e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:2994:1858396216604928:0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772305921.993891:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002a43cdb5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:2991:1858396216604992:0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772305921.993910:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305921.993930:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772305921.993963:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000faca0d01 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:2992:1858396216605056:0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772305921.993980:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216604864 00000100:00100000:2.0:1772305921.994025:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305921.994046:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216604928 00000100:00100000:3.0:1772305921.994072:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1772305921.994087:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dcbe432d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2993:x1858396216604864:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772305921.994101:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305921.994114:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216605056 00000100:00100000:2.0:1772305921.994144:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216604992 00000100:00100000:3.0:1772305921.994172:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dcbe432d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2993:x1858396216604864:12345-0@lo:400:kworker/u8:4.0 Request processed in 88us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305921.994179:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1772305921.994192:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000952d665f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:2994:x1858396216604928:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772305921.994203:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1772305921.994203:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1772305921.994212:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004d8ea70d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:2992:x1858396216605056:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772305921.994287:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1772305921.994293:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000952d665f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:2994:x1858396216604928:12345-0@lo:400:kworker/u8:4.0 Request processed in 102us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305921.994302:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000004c96b79 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:2991:x1858396216604992:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772305921.994306:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004d8ea70d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:2992:x1858396216605056:12345-0@lo:400:kworker/u8:4.0 Request processed in 88us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305921.994328:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1772305921.994344:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1772305921.994389:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000004c96b79 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:2991:x1858396216604992:12345-0@lo:400:kworker/u8:4.0 Request processed in 96us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305921.994404:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1772305921.994459:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002a43cdb5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:2991:1858396216604992:0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772305921.994465:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d8f6a4e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:2994:1858396216604928:0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772305921.994486:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000010b5ceff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:70aae467-c860-409f-ba1b-742f4d042da6:2993:1858396216604864:0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772305921.994535:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000faca0d01 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:2992:1858396216605056:0@lo:400:kworker/u8:4.0 00000020:00000080:3.0:1772305922.286175:0:70386:0:(class_obd.c:302:class_handle_ioctl()) cmd = c008667f 00000020:00000080:3.0:1772305922.286182:0:70386:0:(class_obd.c:126:class_resolve_dev_name()) device name lustre-MDT0000 00000020:00000080:3.0:1772305922.286187:0:70386:0:(class_obd.c:133:class_resolve_dev_name()) device name lustre-MDT0000, dev 5 00000020:00000080:3.0:1772305922.286215:0:70386:0:(class_obd.c:302:class_handle_ioctl()) cmd = 424066b2 00000004:00000080:3.0:1772305922.286220:0:70386:0:(mdt_handler.c:7411:mdt_iocontrol()) handling ioctl cmd 0x424066b2 00000004:00000080:3.0:1772305922.286253:0:70386:0:(mdd_device.c:2125:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=13, endrec=0 00000040:00080000:3.0:1772305922.286330:0:70386:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1772305922.286333:0:70386:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x11:0x1:0x0]:0 at index 1 of catalog [0x6:0xa:0x0] 00000004:00000080:3.0:1772305922.286356:0:70386:0:(mdd_device.c:2095:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl13 endrec = 86 00000040:00080000:3.0:1772305922.286399:0:70386:0:(llog.c:789:llog_process_thread()) stop processing plain 0x11:1:0 index 14 count 2 00000040:00080000:3.0:1772305922.286416:0:70386:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x6:10:0 index 2 count 2 00000004:00000080:3.0:1772305922.286420:0:70386:0:(mdd_device.c:2173:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl13 entries up to 18446744073709551615 00000040:00080000:3.0:1772305922.286443:0:70386:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1772305922.286445:0:70386:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x13:0x1:0x0]:0 at index 1 of catalog [0x5:0xa:0x0] 00000040:00080000:3.0:1772305922.286912:0:70386:0:(llog.c:789:llog_process_thread()) stop processing plain 0x13:1:0 index 64768 count 1 00000040:00080000:3.0:1772305922.286919:0:70386:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x5:10:0 index 2 count 2 00000004:00000080:3.0:1772305922.286926:0:70386:0:(mdd_device.c:1983:mdd_changelog_user_purge()) lustre-MDD0000: Purge request: id=13 00000040:00080000:3.0:1772305922.286959:0:70386:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1772305922.286961:0:70386:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x11:0x1:0x0]:0 at index 1 of catalog [0x6:0xa:0x0] 00000040:00100000:3.0:1772305922.286982:0:70386:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 13 in log [0x11:0x1:0x0] 00000040:00080000:3.0:1772305922.287055:0:70386:0:(llog.c:789:llog_process_thread()) stop processing plain 0x11:1:0 index 13 count 1 00000040:00080000:3.0:1772305922.287060:0:70386:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x6:10:0 index 2 count 2 00000004:00000080:3.0:1772305922.287065:0:70386:0:(mdd_device.c:2005:mdd_changelog_user_purge()) turning off changelogs 00000004:02000000:3.0:1772305922.287066:0:70386:0:(mdd_device.c:483:mdd_changelog_off()) lustre-MDD0000: changelog off 00000004:00000080:3.0:1772305922.289449:0:70386:0:(mdd_device.c:2015:mdd_changelog_user_purge()) lustre-MDD0000: Purge changelog entries for user cl13 record=18446744073709551615 00000040:00080000:3.0:1772305922.289483:0:70386:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1772305922.289485:0:70386:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x13:0x1:0x0]:0 at index 1 of catalog [0x5:0xa:0x0] 00000040:00080000:3.0:1772305922.289933:0:70386:0:(llog.c:789:llog_process_thread()) stop processing plain 0x13:1:0 index 64768 count 1 00000040:00080000:3.0:1772305922.289938:0:70386:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x5:10:0 index 2 count 2 00000040:00080000:3.0:1772305922.289962:0:70386:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1772305922.289970:0:70386:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x11:0x1:0x0]:0 at index 1 of catalog [0x6:0xa:0x0] 00000040:00080000:3.0:1772305922.290325:0:70386:0:(llog.c:789:llog_process_thread()) stop processing plain 0x11:1:0 index 64768 count 1 00000040:00080000:3.0:1772305922.290327:0:70386:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x6:10:0 index 2 count 2 00000040:00080000:0.0:1772305922.571878:0:70434:0:(llog.c:731:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1772305922.571882:0:70434:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0x11:0x1:0x0]:0 at index 1 of catalog [0x6:0xa:0x0] 00000040:00080000:0.0:1772305922.572275:0:70434:0:(llog.c:789:llog_process_thread()) stop processing plain 0x11:1:0 index 64768 count 1 00000040:00080000:0.0:1772305922.572284:0:70434:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x6:10:0 index 2 count 2 00010000:00010000:0.0:1772305922.760740:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:0.0:1772305923.079603:0:70482:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1772305923.079606:0:70482:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 228: On released file, return extend to FIEMAP. For [cp,tar] --sparse ========================================================== 14:12:02 (1772305922) 00000100:00100000:0.0:1772305923.185872:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305923.185927:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225381568 00000100:00100000:3.0:1772305923.185971:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1000 00000100:00100000:3.0:1772305923.185976:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000239dd968 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+66:99131:x1858396225381568:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1772305923.185995:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305923.186012:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c6f633 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ef63 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.186058:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6f63a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.186069:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6f63a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.186079:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6f63a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1772305923.186133:0:54698:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:3.0:1772305923.186136:0:54698:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 108 stripe count 1 MDT count 1 00000004:00010000:3.0:1772305923.186154:0:54698:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6f63a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.186178:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c6f633 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef63 expref: 68 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.186196:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6f63a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef63 expref: 67 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.186222:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:3.0:1772305923.186224:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1772305923.186227:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c6c2d285, rc 0) 00000100:00100000:3.0:1772305923.186274:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000239dd968 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+67:99131:x1858396225381568:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 297us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305923.186280:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1000 00000100:00100000:0.0:1772305923.188822:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305923.188855:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225381696 00000100:00100000:3.0:1772305923.188881:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1001 00000100:00100000:3.0:1772305923.188885:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b4d59b97 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+67:99132:x1858396225381696:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1772305923.188892:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305923.188899:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a5c1895c/0xa5e9c8c58c6f641 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ef6a expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.188933:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6f648 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.188940:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6f648 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.188945:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6f648 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.188954:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000094970864/0xa5e9c8c58c6f64f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.188958:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000094970864/0xa5e9c8c58c6f64f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.188972:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000094970864/0xa5e9c8c58c6f64f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1772305923.190136:0:54698:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 10752 00010000:00010000:3.0:1772305923.190234:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6f648 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.190241:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6f648 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.190246:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6f648 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.190250:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000403929b5 already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305923.190253:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6f648 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.190257:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6f648 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.190264:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (000000006b52a2ed) 00010000:00010000:3.0:1772305923.190266:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305923.190268:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6f648 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.190271:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6f648 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.190278:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000094970864/0xa5e9c8c58c6f64f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.190288:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000094970864/0xa5e9c8c58c6f64f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.190292:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000094970864/0xa5e9c8c58c6f64f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.190295:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000094970864 already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305923.190296:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000094970864/0xa5e9c8c58c6f64f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.190300:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000094970864/0xa5e9c8c58c6f64f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.190304:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (00000000a8b16304) 00010000:00010000:3.0:1772305923.190306:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305923.190307:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000094970864/0xa5e9c8c58c6f64f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.190310:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000094970864/0xa5e9c8c58c6f64f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.190330:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000a5c1895c/0xa5e9c8c58c6f641 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef6a expref: 69 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.190335:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a5c1895c/0xa5e9c8c58c6f641 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef6a expref: 69 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.190343:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5c1895c, rc 0) 00000100:00100000:3.0:1772305923.190387:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b4d59b97 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+68:99132:x1858396225381696:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 1500us (1567us total) trans 8589934899 rc 301/301 00000100:00100000:3.0:1772305923.190392:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1001 00000100:00100000:1.0:1772305923.191293:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305923.191341:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225381824 00000100:00100000:2.0:1772305923.191371:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 118 00000100:00100000:2.0:1772305923.191377:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000049d9912e pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+68:99132:x1858396225381824:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1772305923.191549:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000049d9912e pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:99132:x1858396225381824:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 171us (256us total) trans 8589934900 rc 0/0 00000100:00100000:2.0:1772305923.191557:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 118 00000100:00100000:0.0:1772305923.192363:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305923.192396:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225381888 00000100:00100000:3.0:1772305923.192440:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1002 00000100:00100000:3.0:1772305923.192445:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001c27fa0f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:99132:x1858396225381888:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1772305923.192504:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001c27fa0f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:99132:x1858396225381888:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 Request processed in 58us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305923.192509:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1002 00000100:00100000:0.0:1772305923.197415:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305923.197459:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225381952 00000100:00100000:3.0:1772305923.197489:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1003 00000100:00100000:3.0:1772305923.197493:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000326ce08d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+51:99133:x1858396225381952:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1772305923.197508:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305923.197521:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a5c1895c/0xa5e9c8c58c6f65d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ef71 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.197560:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000094970864/0xa5e9c8c58c6f664 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.197573:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000094970864/0xa5e9c8c58c6f664 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.197585:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000094970864/0xa5e9c8c58c6f664 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.197600:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6f66b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.197622:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6f66b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.197644:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6f66b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.197693:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000094970864/0xa5e9c8c58c6f664 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.197697:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000094970864/0xa5e9c8c58c6f664 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.197702:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000094970864/0xa5e9c8c58c6f664 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.197705:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000094970864 already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305923.197707:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000094970864/0xa5e9c8c58c6f664 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.197712:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000094970864/0xa5e9c8c58c6f664 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.197719:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:3.0:1772305923.197721:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305923.197724:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000094970864/0xa5e9c8c58c6f664 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.197728:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000094970864/0xa5e9c8c58c6f664 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.197743:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6f66b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.197748:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6f66b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.197751:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6f66b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.197755:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000403929b5 already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305923.197756:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6f66b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.197759:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6f66b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.197763:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3f22ae9b (00000000a8b16304) 00010000:00010000:3.0:1772305923.197764:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305923.197766:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6f66b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.197769:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6f66b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.197787:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000a5c1895c/0xa5e9c8c58c6f65d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef71 expref: 52 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.197791:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a5c1895c/0xa5e9c8c58c6f65d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef71 expref: 52 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.197804:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5c1895c, rc 0) 00000100:00100000:3.0:1772305923.197833:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000326ce08d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+51:99133:x1858396225381952:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 339us (438us total) trans 0 rc 301/301 00000100:00100000:3.0:1772305923.197838:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1003 00000100:00100000:1.0:1772305923.198685:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305923.198720:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225382016 00000100:00100000:3.0:1772305923.198743:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1004 00000100:00100000:3.0:1772305923.198747:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008d0e9397 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+51:99133:x1858396225382016:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1772305923.198755:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305923.198763:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c6f672 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ef78 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.198783:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6f679 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.198790:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6f679 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.198795:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6f679 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.198802:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c6f680 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.198807:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c6f680 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.198810:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c6f680 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.198839:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6f679 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.198844:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6f679 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.198847:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6f679 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.198851:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000051c27e8b already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305923.198852:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6f679 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.198856:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6f679 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.198861:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:3.0:1772305923.198863:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305923.198865:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6f679 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.198868:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6f679 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.198874:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c6f680 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.198877:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c6f680 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.198897:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c6f680 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.198903:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a0648135 already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305923.198905:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c6f680 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.198909:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c6f680 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.198913:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3f22ae9b (000000009fad10f9) 00010000:00010000:3.0:1772305923.198915:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305923.198916:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c6f680 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.198920:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c6f680 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.198935:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c6f672 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef78 expref: 52 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.198940:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c6f672 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef78 expref: 52 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.198944:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000617aea8a, rc 0) 00000100:00100000:3.0:1772305923.198968:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008d0e9397 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+51:99133:x1858396225382016:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 221us (286us total) trans 0 rc 301/301 00000100:00100000:3.0:1772305923.198973:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1004 00000100:00100000:0.0:1772305923.199661:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305923.199691:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225382080 00000100:00100000:3.0:1772305923.199713:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1005 00000100:00100000:3.0:1772305923.199717:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f8c4abc3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+51:99133:x1858396225382080:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1772305923.199723:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305923.199731:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d02430e8/0xa5e9c8c58c6f687 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ef7f expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.199751:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f68e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.199757:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f68e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.199763:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f68e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1772305923.199790:0:54698:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:3.0:1772305923.199792:0:54698:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 108 stripe count 1 MDT count 1 00000004:00010000:3.0:1772305923.199806:0:54698:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f68e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.199817:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d02430e8/0xa5e9c8c58c6f687 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef7f expref: 53 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.199826:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f68e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef7f expref: 52 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.199830:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:3.0:1772305923.199832:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1772305923.199833:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000099c1b7e6, rc 0) 00000100:00100000:3.0:1772305923.199864:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f8c4abc3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+52:99133:x1858396225382080:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 146us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305923.199869:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1005 00000100:00100000:0.0:1772305923.201189:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305923.201217:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225382208 00000100:00100000:3.0:1772305923.201244:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1006 00000100:00100000:3.0:1772305923.201248:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d82ebea7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+52:99133:x1858396225382208:12345-192.168.203.30@tcp:36:lfs.0 00010000:00010000:3.0:1772305923.201268:0:54698:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1772305923.201278:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f68e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef7f expref: 52 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.201286:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:3.0:1772305923.201288:0:54698:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1772305923.201315:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f695 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.201322:0:54698:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6f63a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef63 expref: 68 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.201327:0:54698:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f695 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.201348:0:54698:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6f63a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef63 expref: 68 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.201356:0:54698:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6f63a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef63 expref: 68 pid: 54698 timeout: 1335 lvb_type: 0 00000100:00100000:3.0:1772305923.201365:0:54698:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cfcd4c56 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:54698:1858396216605120:192.168.203.30@tcp:104: 00000100:00100000:3.0:1772305923.201424:0:54698:0:(client.c:2500:ptlrpc_set_wait()) set 0000000002fec8e4 going to sleep for 6 seconds 00000100:00100000:3.0:1772305923.202057:0:54698:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cfcd4c56 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:54698:1858396216605120:192.168.203.30@tcp:104: 00010000:00010000:3.0:1772305923.202070:0:54698:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f695 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305923.202322:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305923.202348:0:5494:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225382272 00010000:00010000:3.0:1772305923.202362:0:5494:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6f63a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef63 expref: 69 pid: 54698 timeout: 1335 lvb_type: 0 00000100:00100000:3.0:1772305923.202381:0:5494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3108 00000100:00100000:3.0:1772305923.202385:0:5494:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003c5a199e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:2215:x1858396225382272:12345-192.168.203.30@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1772305923.202391:0:5494:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1772305923.202395:0:5494:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6f63a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef63 expref: 69 pid: 54698 timeout: 1335 lvb_type: 0 00010000:00010000:3.0:1772305923.202431:0:5494:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6f63a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef63 expref: 69 pid: 54698 timeout: 1335 lvb_type: 0 00010000:00010000:3.0:1772305923.202440:0:5494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6f63a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef63 expref: 69 pid: 54698 timeout: 1335 lvb_type: 0 00010000:00010000:3.0:1772305923.202449:0:5494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:3.0:1772305923.202451:0:5494:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f695 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.202456:0:5494:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f695 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.202469:0:5494:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f695 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.202485:0:5494:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1772305923.202509:0:5494:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003c5a199e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+68:2215:x1858396225382272:12345-192.168.203.30@tcp:103:ldlm_bl_02.0 Request processed in 123us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305923.202516:0:5494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3108 00010000:00010000:0.0:1772305923.202518:0:54698:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f695 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305923.202530:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f695 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305923.202550:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f69c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305923.202560:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f69c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305923.202569:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f69c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305923.203199:0:54698:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000408:0x8d:0x0]: returning size 512 00010000:00010000:0.0:1772305923.203206:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f695 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305923.203220:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f695 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305923.203226:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f695 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305923.203232:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002f753c58 already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305923.203235:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f695 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305923.203242:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f695 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305923.203251:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:0.0:1772305923.203254:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305923.203256:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f695 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305923.203263:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f695 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1772305923.203273:0:54698:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000d82ebea7 reply state 0000000045596fea transno 8589934901 ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f69c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305923.203326:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d82ebea7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+53:99133:x1858396225382208:12345-192.168.203.30@tcp:36:lfs.0 Request processed in 2076us (2136us total) trans 8589934901 rc 0/0 00000100:00100000:0.0:1772305923.203335:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1006 00010000:00010000:3.0:1772305923.203833:0:2978:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f69c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.203839:0:2978:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f69c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.203843:0:2978:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f69c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.203847:0:2978:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a7782eea already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305923.203848:0:2978:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f69c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.203852:0:2978:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f69c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.203857:0:2978:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3f22ae9b (00000000955bccbc) 00010000:00010000:3.0:1772305923.203859:0:2978:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305923.203860:0:2978:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f69c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.203863:0:2978:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f69c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305923.216173:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305923.216228:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225382336 00000100:00100000:0.0:1772305923.216290:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1007 00000100:00100000:0.0:1772305923.216298:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002d74ee2c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+68:99137:x1858396225382336:12345-192.168.203.30@tcp:101:mkdir.0 00010000:00010000:0.0:1772305923.216318:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305923.216336:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f6a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ef86 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305923.216388:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f6aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305923.216417:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f6aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305923.216429:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f6aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305923.216482:0:54698:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:0.0:1772305923.216486:0:54698:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 109 stripe count 1 MDT count 1 00000004:00010000:0.0:1772305923.216509:0:54698:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f6aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305923.216540:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f6a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef86 expref: 70 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305923.216556:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f6aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef86 expref: 69 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305923.216564:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:0.0:1772305923.216567:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1772305923.216570:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000082c88ffe, rc 0) 00000100:00100000:0.0:1772305923.216619:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002d74ee2c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:99137:x1858396225382336:12345-192.168.203.30@tcp:101:mkdir.0 Request processed in 321us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305923.216659:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1007 00000100:00100000:0.0:1772305923.220020:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305923.220060:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225382400 00000100:00100000:3.0:1772305923.220089:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1008 00000100:00100000:3.0:1772305923.220093:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004dac6711 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:99138:x1858396225382400:12345-192.168.203.30@tcp:101:rm.0 00010000:00010000:3.0:1772305923.220101:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305923.220110:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f6b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ef8d expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.220134:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000d02430e8/0xa5e9c8c58c6f6b8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.220142:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d02430e8/0xa5e9c8c58c6f6b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.220151:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d02430e8/0xa5e9c8c58c6f6b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.220164:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000d6b71f01/0xa5e9c8c58c6f6bf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.220171:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d6b71f01/0xa5e9c8c58c6f6bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.220194:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d6b71f01/0xa5e9c8c58c6f6bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.220235:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000d02430e8/0xa5e9c8c58c6f6b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.220241:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d02430e8/0xa5e9c8c58c6f6b8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.220251:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d02430e8/0xa5e9c8c58c6f6b8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.220255:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d02430e8 already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305923.220257:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d02430e8/0xa5e9c8c58c6f6b8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.220262:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d02430e8/0xa5e9c8c58c6f6b8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.220270:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:3.0:1772305923.220271:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305923.220273:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d02430e8/0xa5e9c8c58c6f6b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.220277:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d02430e8/0xa5e9c8c58c6f6b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.220283:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000d6b71f01/0xa5e9c8c58c6f6bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.220287:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d6b71f01/0xa5e9c8c58c6f6bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.220291:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d6b71f01/0xa5e9c8c58c6f6bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.220294:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d6b71f01 already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305923.220296:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d6b71f01/0xa5e9c8c58c6f6bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.220307:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d6b71f01/0xa5e9c8c58c6f6bf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.220315:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6325532c (000000009fad10f9) 00010000:00010000:3.0:1772305923.220318:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305923.220322:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d6b71f01/0xa5e9c8c58c6f6bf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.220326:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d6b71f01/0xa5e9c8c58c6f6bf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.220349:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f6b1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef8d expref: 70 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.220356:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000099c1b7e6/0xa5e9c8c58c6f6b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef8d expref: 70 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.220364:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000099c1b7e6, rc 0) 00000100:00100000:3.0:1772305923.220412:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004dac6711 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:99138:x1858396225382400:12345-192.168.203.30@tcp:101:rm.0 Request processed in 302us (379us total) trans 0 rc 301/301 00000100:00100000:3.0:1772305923.220421:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1008 00000100:00100000:1.0:1772305923.224417:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305923.224453:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225382528 00000100:00100000:3.0:1772305923.224489:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1009 00000100:00100000:3.0:1772305923.224493:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008b3e380d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:99139:x1858396225382528:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:3.0:1772305923.224504:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305923.224506:0:54698:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1772305923.224520:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f6aa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef86 expref: 69 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.224539:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:3.0:1772305923.224542:0:54698:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1772305923.224549:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6f6c6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ef94 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.224609:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f6cd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.224617:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f6cd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.224623:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f6cd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.224650:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f6d4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6325532c bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.224655:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f6d4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.224659:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f6d4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1772305923.225059:0:54698:0:(osp_object.c:1645:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x100000000:0x1af:0x0], index 0: 0 00010000:00010000:3.0:1772305923.225181:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6f6db lrc: 3/1,0 mode: --/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.225191:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6f6db lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.225214:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6f6db lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.225242:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f6cd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.225247:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f6cd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.225251:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f6cd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.225255:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000009fea887 already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305923.225256:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f6cd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.225260:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f6cd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.225265:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:3.0:1772305923.225267:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305923.225268:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f6cd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.225272:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000009fea887/0xa5e9c8c58c6f6cd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1772305923.225279:0:54698:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000008b3e380d reply state 00000000a3db9136 transno 8589934902 ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f6d4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.225303:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ca5be8d6/0xa5e9c8c58c6f6c6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef94 expref: 71 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.225311:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6f6db lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef94 expref: 70 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305923.225315:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32b:0x0].0x0 (00000000fbf2c1ae) 00010000:00010000:3.0:1772305923.225317:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1772305923.225318:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c6c2d285, rc 0) 00000100:00100000:3.0:1772305923.225352:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008b3e380d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+71:99139:x1858396225382528:12345-192.168.203.30@tcp:101:dd.0 Request processed in 858us (938us total) trans 8589934902 rc 0/0 00000100:00100000:3.0:1772305923.225357:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1009 00010000:00010000:2.0:1772305923.225910:0:2977:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f6d4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305923.225919:0:2977:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f6d4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305923.225924:0:2977:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f6d4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305923.225928:0:2977:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002f753c58 already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305923.225929:0:2977:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f6d4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305923.225933:0:2977:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f6d4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305923.225940:0:2977:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6325532c (00000000a8b16304) 00010000:00010000:2.0:1772305923.225943:0:2977:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305923.225944:0:2977:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f6d4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305923.225948:0:2977:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002f753c58/0xa5e9c8c58c6f6d4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305923.237426:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305923.237487:0:48470:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225382592 00000100:00100000:0.0:1772305923.237534:0:48470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5727 00000100:00100000:0.0:1772305923.237539:0:48470:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d72a5614 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:370cd859-ca07-4cc9-a865-ed970d9eaddd+224:99139:x1858396225382592:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:0.0:1772305923.237555:0:48470:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305923.237573:0:48470:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f6e9 lrc: 2/0,0 mode: --/PW res: [0x1af:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196ef9b expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1772305923.237594:0:48470:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x1af:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1772305923.237609:0:48470:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305923.237610:0:48470:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305923.237618:0:48470:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f6e9 lrc: 3/0,0 mode: PW/PW res: [0x1af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef9b expref: 225 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305923.237651:0:48470:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f6e9 lrc: 3/0,0 mode: PW/PW res: [0x1af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef9b expref: 225 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305923.237660:0:48470:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079ce3603, rc 0) 00000100:00100000:0.0:1772305923.237700:0:48470:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d72a5614 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:370cd859-ca07-4cc9-a865-ed970d9eaddd+225:99139:x1858396225382592:12345-192.168.203.30@tcp:101:dd.0 Request processed in 160us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305923.237706:0:48470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5727 00000100:00100000:1.0:1772305923.244670:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305923.244735:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225382784 00000100:00100000:2.0:1772305923.244776:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 119 00000100:00100000:2.0:1772305923.244782:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d225f1a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+70:99139:x1858396225382784:12345-192.168.203.30@tcp:35:dd.0 00000100:00100000:1.0:1772305923.244965:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305923.245023:0:21399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225382848 00000100:00100000:2.0:1772305923.245041:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d225f1a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+71:99139:x1858396225382784:12345-192.168.203.30@tcp:35:dd.0 Request processed in 257us (417us total) trans 8589934903 rc 0/0 00000100:00100000:2.0:1772305923.245050:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 119 00002000:00100000:0.0:1772305923.245051:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1af:0x0] (0->1048575) req@000000008d9162a6 x1858396225382848/t0(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:54/0 lens 488/0 e 0 to 0 dl 1772305929 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1772305923.245061:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 000000008d9162a6 with x1858396225382848 ext(0->1048575) 00002000:00010000:0.0:1772305923.245086:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000008d9162a6 00000100:00100000:0.0:1772305923.245110:0:21399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2043 00000100:00100000:0.0:1772305923.245115:0:21399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008d9162a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+225:2216:x1858396225382848:12345-192.168.203.30@tcp:4:dd.0 00000100:00100000:0.0:1772305923.252165:0:21399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008d9162a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2216:x1858396225382848:12345-192.168.203.30@tcp:4:dd.0 Request processed in 7044us (7197us total) trans 4294968307 rc 0/0 00000100:00100000:0.0:1772305923.252175:0:21399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2043 00002000:00100000:0.0:1772305923.252186:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1af:0x0] (0->1048575) req@000000008d9162a6 x1858396225382848/t4294968307(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:54/0 lens 488/448 e 0 to 0 dl 1772305929 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1772305923.252194:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 000000008d9162a6 with x1858396225382848 ext(0->1048575) 00002000:00010000:0.0:1772305923.252199:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000008d9162a6 00000100:00100000:3.0:1772305923.262493:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305923.262585:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225382912 00000100:00100000:0.0:1772305923.262668:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1010 00000100:00100000:0.0:1772305923.262677:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cfcd4c56 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+52:99142:x1858396225382912:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1772305923.262704:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305923.262726:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6f6f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196efa2 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305923.262781:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f6f7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305923.262796:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f6f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305923.262808:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f6f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305923.262824:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f6fe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305923.262846:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f6fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305923.262854:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f6fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305923.262982:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f705 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305923.262993:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f705 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305923.263001:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f705 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305923.263033:0:54698:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x32b:0x0]: returning size 1048576 00000004:00200000:0.0:1772305923.263037:0:54698:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1772305923.263055:0:54698:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f705 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305923.263066:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f705 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305923.263075:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f6f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305923.263081:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f6f7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305923.263088:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f6f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305923.263103:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c7dfb548 already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305923.263106:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f6f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305923.263114:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f6f7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305923.263126:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:0.0:1772305923.263129:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305923.263133:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f6f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305923.263140:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f6f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305923.263152:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f6fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305923.263159:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f6fe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305923.263165:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f6fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305923.263171:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000fd93d0b1 already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305923.263173:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f6fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305923.263178:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f6fe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305923.263195:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6325532c (000000000c14a94e) 00010000:00010000:0.0:1772305923.263198:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305923.263200:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f6fe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305923.263206:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f6fe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305923.263235:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6f6f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efa2 expref: 54 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305923.263249:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f705 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efa2 expref: 53 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305923.263256:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32b:0x0].0x0 (00000000fbf2c1ae) 00010000:00010000:0.0:1772305923.263258:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1772305923.263261:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000082c88ffe, rc 0) 00000100:00100000:0.0:1772305923.263314:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cfcd4c56 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+53:99142:x1858396225382912:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 637us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305923.263322:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1010 00000100:00100000:1.0:1772305923.264606:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305923.264671:0:48470:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225382976 00000100:00100000:0.0:1772305923.264699:0:48470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5728 00000100:00100000:0.0:1772305923.264705:0:48470:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fd983d06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f935b4d0-e17f-49c8-8011-4be99ba75430+161:2215:x1858396225382976:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1772305923.264716:0:48470:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305923.264729:0:48470:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f70c lrc: 2/0,0 mode: --/PR res: [0x1af:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196efa9 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305923.264788:0:48470:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006f23ed77 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:48470:1858396216605184:192.168.203.30@tcp:106: 00000100:00100000:0.0:1772305923.264830:0:48470:0:(client.c:2500:ptlrpc_set_wait()) set 00000000753d9c27 going to sleep for 6 seconds 00002000:00010000:0.0:1772305923.265599:0:48470:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x1af:0x0:0x0] updating lvb size: 0 -> 1048576 00002000:00010000:0.0:1772305923.265602:0:48470:0:(ofd_lvb.c:284:ofd_lvbo_update()) res: [0x1af:0x0:0x0] updating lvb mtime: 0 -> 1772305923 00002000:00010000:0.0:1772305923.265604:0:48470:0:(ofd_lvb.c:290:ofd_lvbo_update()) res: [0x1af:0x0:0x0] updating lvb atime: 0 -> 1772305923 00002000:00010000:0.0:1772305923.265605:0:48470:0:(ofd_lvb.c:296:ofd_lvbo_update()) res: [0x1af:0x0:0x0] updating lvb ctime: 0 -> 1772305923 00000100:00100000:0.0:1772305923.265616:0:48470:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006f23ed77 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:48470:1858396216605184:192.168.203.30@tcp:106: 00010000:00010000:0.0:1772305923.265653:0:48470:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f70c lrc: 1/0,0 mode: --/PR res: [0x1af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efa9 expref: 162 pid: 48470 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1772305923.265662:0:48470:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f70c lrc: 0/0,0 mode: --/PR res: [0x1af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efa9 expref: 162 pid: 48470 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1772305923.265671:0:48470:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a7782eea, rc 0) 00000100:00100000:0.0:1772305923.265699:0:48470:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fd983d06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f935b4d0-e17f-49c8-8011-4be99ba75430+161:2215:x1858396225382976:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 993us (1093us total) trans 0 rc 301/301 00000100:00100000:0.0:1772305923.265707:0:48470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5728 00000100:00100000:3.0:1772305923.266612:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305923.266668:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225383040 00000100:00100000:0.0:1772305923.266703:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1011 00000100:00100000:0.0:1772305923.266709:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f7fa0064 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+53:99142:x1858396225383040:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1772305923.266720:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305923.266728:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f713 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196efb0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305923.266758:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c6f71a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305923.266776:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c6f71a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305923.266785:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c6f71a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305923.266821:0:54698:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:0.0:1772305923.266824:0:54698:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 110 stripe count 1 MDT count 1 00000004:00010000:0.0:1772305923.266843:0:54698:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c6f71a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305923.266862:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f713 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efb0 expref: 55 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305923.266876:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c6f71a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efb0 expref: 54 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305923.266883:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:0.0:1772305923.266885:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1772305923.266888:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000004820b6c, rc 0) 00000100:00100000:0.0:1772305923.266922:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f7fa0064 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+54:99142:x1858396225383040:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 213us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305923.266930:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1011 00000100:00100000:1.0:1772305923.267751:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305923.267785:0:48470:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225383104 00000100:00100000:0.0:1772305923.267809:0:48470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5729 00000100:00100000:0.0:1772305923.267812:0:48470:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003bb94cec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f935b4d0-e17f-49c8-8011-4be99ba75430+161:2216:x1858396225383104:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1772305923.267818:0:48470:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305923.267830:0:48470:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6f721 lrc: 2/0,0 mode: --/PR res: [0x1af:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196efb7 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305923.267855:0:48470:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006f23ed77 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:48470:1858396216605248:192.168.203.30@tcp:106: 00000100:00100000:0.0:1772305923.267884:0:48470:0:(client.c:2500:ptlrpc_set_wait()) set 00000000753d9c27 going to sleep for 6 seconds 00000100:00100000:0.0:1772305923.268560:0:48470:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006f23ed77 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:48470:1858396216605248:192.168.203.30@tcp:106: 00010000:00010000:0.0:1772305923.268575:0:48470:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6f721 lrc: 1/0,0 mode: --/PR res: [0x1af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efb7 expref: 162 pid: 48470 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1772305923.268584:0:48470:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6f721 lrc: 0/0,0 mode: --/PR res: [0x1af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efb7 expref: 162 pid: 48470 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1772305923.268591:0:48470:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000870ce7f2, rc 0) 00000100:00100000:0.0:1772305923.268620:0:48470:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003bb94cec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f935b4d0-e17f-49c8-8011-4be99ba75430+161:2216:x1858396225383104:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 807us (871us total) trans 0 rc 301/301 00000100:00100000:0.0:1772305923.268643:0:48470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5729 00000100:00100000:3.0:1772305923.270129:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305923.270176:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225383232 00000100:00100000:0.0:1772305923.270212:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1012 00000100:00100000:0.0:1772305923.270218:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000004f8c4bb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+54:99142:x1858396225383232:12345-192.168.203.30@tcp:58:lfs.0 00000040:00080000:0.0:1772305923.270448:0:54698:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xf:0x0].39, 136 off13496 00000100:00100000:0.0:1772305923.270506:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000004f8c4bb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+54:99142:x1858396225383232:12345-192.168.203.30@tcp:58:lfs.0 Request processed in 287us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305923.270515:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1012 00000040:00080000:3.0:1772305923.547424:0:70531:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305923.547430:0:70531:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305923.547516:0:70531:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 40 count 12 00000040:00080000:3.0:1772305923.547522:0:70531:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:2.0:1772305923.784787:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772305924.163785:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305924.163837:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305924.163859:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305924.163894:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305924.163910:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225383360 00000100:00100000:3.0:1772305924.163913:0:54689:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225383296 00000100:00100000:1.0:1772305924.163933:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305924.163937:0:48470:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225383488 00000100:00100000:1.0:1772305924.163979:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225383424 00000100:00100000:3.0:1772305924.163995:0:54689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 146 00000100:00100000:3.0:1772305924.164004:0:54689:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c5abcfd8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2218:x1858396225383296:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1772305924.164006:0:48470:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225383552 00000100:00100000:1.0:1772305924.164023:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1183 00000100:00100000:0.0:1772305924.164023:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 154 00000100:00100000:1.0:1772305924.164030:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d6935757 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2217:x1858396225383488:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:0.0:1772305924.164041:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ecbbf8d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+71:2217:x1858396225383360:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1772305924.164055:0:48470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1184 00000100:00100000:2.0:1772305924.164062:0:48470:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000133430f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2218:x1858396225383424:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:3.0:1772305924.164107:0:54689:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c5abcfd8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2218:x1858396225383296:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 95us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305924.164107:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d6935757 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2217:x1858396225383488:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 69us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305924.164133:0:54689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 146 00000100:00100000:1.0:1772305924.164136:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1183 00000100:00100000:2.0:1772305924.164138:0:48470:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000133430f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2218:x1858396225383424:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 70us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305924.164138:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ecbbf8d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+71:2217:x1858396225383360:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 99us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305924.164152:0:48470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1184 00000100:00100000:0.0:1772305924.164152:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 154 00000100:00100000:1.0:1772305924.164175:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1185 00000100:00100000:1.0:1772305924.164186:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004db6797f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f935b4d0-e17f-49c8-8011-4be99ba75430+140:2217:x1858396225383552:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1772305924.164226:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004db6797f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f935b4d0-e17f-49c8-8011-4be99ba75430+140:2217:x1858396225383552:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 42us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305924.164235:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1185 00000040:00080000:0.0:1772305924.168769:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772305924.168773:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772305924.168806:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 40 count 12 00000040:00080000:0.0:1772305924.168811:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:0.0:1772305924.168996:0:54732:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006f23ed77 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:54732:1858396216605312:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1772305924.169047:0:54732:0:(client.c:2500:ptlrpc_set_wait()) set 00000000753d9c27 going to sleep for 6 seconds 00000100:00100000:0.0:1772305924.169934:0:54732:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006f23ed77 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:54732:1858396216605312:192.168.203.30@tcp:107:hsm_cdtr.0 00000040:00080000:0.0:1772305924.169981:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772305924.169983:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772305924.170024:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 40 count 12 00000040:00080000:0.0:1772305924.170027:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:3.0:1772305924.170411:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305924.170478:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225383616 00000100:00100000:0.0:1772305924.170528:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1013 00000100:00100000:0.0:1772305924.170534:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e20b2bbf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+71:99153:x1858396225383616:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1772305924.170553:0:54697:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x32b:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1772305924.170607:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e20b2bbf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+71:99153:x1858396225383616:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 73us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305924.170613:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1013 00000100:00100000:1.0:1772305924.172497:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305924.172553:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225383744 00000100:00100000:0.0:1772305924.172582:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1014 00000100:00100000:0.0:1772305924.172587:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000eeae7eda pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+71:99153:x1858396225383744:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1772305924.172597:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305924.172647:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6f728 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196efbe expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.172697:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f72f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.172709:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f72f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.172718:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f72f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.172728:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f736 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x773d4bf9 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.172732:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f736 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x773d4bf9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.172736:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f736 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x773d4bf9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.172770:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6f73d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.172776:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6f73d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.172780:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6f73d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305924.172785:0:54697:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x32b:0x0]: returning size 1048576 00010000:00010000:0.0:1772305924.173953:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f72f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.173967:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f72f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.173971:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f72f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.173975:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000f7a426e already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305924.173978:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f72f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.173983:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f72f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.173994:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (00000000c78481f6) 00010000:00010000:0.0:1772305924.173997:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305924.174002:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f72f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.174007:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f72f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.174020:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f736 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x773d4bf9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.174027:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f736 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x773d4bf9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.174033:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f736 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x773d4bf9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.174048:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a7782eea already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305924.174050:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f736 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x773d4bf9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.174054:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f736 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x773d4bf9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.174060:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x773d4bf9 (000000000c14a94e) 00010000:00010000:0.0:1772305924.174061:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305924.174063:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f736 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x773d4bf9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.174066:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f736 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x773d4bf9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.174090:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6f728 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efbe expref: 74 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.174098:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6f73d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efbe expref: 73 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.174102:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32b:0x0].0x0 (00000000fbf2c1ae) 00010000:00010000:0.0:1772305924.174104:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1772305924.174106:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001e903b7f, rc 0) 00000100:00100000:0.0:1772305924.174149:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000eeae7eda pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+73:99153:x1858396225383744:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 1562us (1658us total) trans 8589934904 rc 0/0 00000100:00100000:0.0:1772305924.174154:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1014 00000100:00100000:1.0:1772305924.175425:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305924.175479:0:5494:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225383808 00000100:00100000:1.0:1772305924.175515:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305924.175528:0:5494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1048 00000100:00100000:3.0:1772305924.175537:0:5494:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c8b2fa89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+73:2216:x1858396225383808:12345-192.168.203.30@tcp:103:ldlm_bl_05.0 00000100:00100000:0.0:1772305924.175569:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225383872 00010000:00010000:3.0:1772305924.175596:0:5494:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1772305924.175609:0:5494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6f73d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efbe expref: 73 pid: 54697 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305924.175613:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5730 00000100:00100000:0.0:1772305924.175624:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000094f3bd7e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2215:x1858396225383872:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1772305924.175653:0:5494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32b:0x0].0x0 (00000000fbf2c1ae) 00010000:00010000:3.0:1772305924.175657:0:5494:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1772305924.175679:0:21400:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f74b lrc: 3/1,0 mode: --/PR res: [0x1af:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305924.175689:0:5494:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c8b2fa89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+72:2216:x1858396225383808:12345-192.168.203.30@tcp:103:ldlm_bl_05.0 Request processed in 151us (266us total) trans 0 rc 0/0 00010000:00010000:0.0:1772305924.175699:0:21400:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f6e9 lrc: 2/0,0 mode: PW/PW res: [0x1af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef9b expref: 227 pid: 48470 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305924.175700:0:5494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1048 00010000:00010000:0.0:1772305924.175709:0:21400:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1772305924.175712:0:21400:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1772305924.175714:0:21400:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f74b lrc: 4/1,0 mode: --/PR res: [0x1af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.175739:0:21400:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f6e9 lrc: 3/0,0 mode: PW/PW res: [0x1af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef9b expref: 227 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.175750:0:21400:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f6e9 lrc: 4/0,0 mode: PW/PW res: [0x1af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef9b expref: 227 pid: 48470 timeout: 1336 lvb_type: 0 00000100:00100000:0.0:1772305924.175760:0:21400:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006f23ed77 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:21400:1858396216605376:192.168.203.30@tcp:104: 00000100:00100000:0.0:1772305924.175811:0:21400:0:(client.c:2500:ptlrpc_set_wait()) set 000000007630f830 going to sleep for 6 seconds 00000100:00100000:0.0:1772305924.176728:0:21400:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006f23ed77 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:21400:1858396216605376:192.168.203.30@tcp:104: 00010000:00010000:0.0:1772305924.176749:0:21400:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f74b lrc: 3/1,0 mode: --/PR res: [0x1af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305924.177652:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305924.177675:0:5494:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225383936 00010000:00010000:3.0:1772305924.177726:0:5494:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f6e9 lrc: 4/0,0 mode: PW/PW res: [0x1af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef9b expref: 228 pid: 48470 timeout: 1336 lvb_type: 0 00000100:00100000:3.0:1772305924.177749:0:5494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3109 00000100:00100000:3.0:1772305924.177752:0:5494:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c30d8750 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+228:2215:x1858396225383936:12345-192.168.203.30@tcp:103:ldlm_bl_04.0 00010000:00010000:3.0:1772305924.177759:0:5494:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1772305924.177775:0:5494:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f6e9 lrc: 4/0,0 mode: PW/PW res: [0x1af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef9b expref: 228 pid: 48470 timeout: 1336 lvb_type: 0 00010000:00010000:3.0:1772305924.177785:0:5494:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f6e9 lrc: 3/0,0 mode: PW/PW res: [0x1af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef9b expref: 228 pid: 48470 timeout: 1336 lvb_type: 0 00010000:00010000:3.0:1772305924.177800:0:5494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f6e9 lrc: 0/0,0 mode: --/PW res: [0x1af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef9b expref: 228 pid: 48470 timeout: 1336 lvb_type: 0 00010000:00010000:3.0:1772305924.177815:0:5494:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1772305924.177817:0:5494:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1772305924.177819:0:5494:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f74b lrc: 3/1,0 mode: PR/PR res: [0x1af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305924.177824:0:5494:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f74b lrc: 4/1,0 mode: PR/PR res: [0x1af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305924.177840:0:5494:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1772305924.177858:0:21400:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f74b lrc: 3/1,0 mode: PR/PR res: [0x1af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305924.177866:0:5494:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c30d8750 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2215:x1858396225383936:12345-192.168.203.30@tcp:103:ldlm_bl_04.0 Request processed in 112us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305924.177882:0:5494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3109 00010000:00010000:0.0:1772305924.177884:0:21400:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f74b lrc: 3/1,0 mode: PR/PR res: [0x1af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.177904:0:21400:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f74b lrc: 3/1,0 mode: PR/PR res: [0x1af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.177909:0:21400:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f74b lrc: 2/0,0 mode: PR/PR res: [0x1af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.177930:0:21400:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1772305924.177965:0:5496:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1772305924.177965:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000094f3bd7e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+226:2215:x1858396225383872:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 Request processed in 2342us (2451us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305924.177973:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5730 00010000:00010000:2.0:1772305924.177974:0:5496:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f74b lrc: 2/0,0 mode: PR/PR res: [0x1af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305924.177995:0:5496:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000fd93d0b1 already unused, calling callback (00000000b5e4f3c0) 00010000:00010000:2.0:1772305924.177998:0:5496:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f74b lrc: 2/0,0 mode: PR/PR res: [0x1af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305924.178009:0:5496:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f74b lrc: 3/0,0 mode: PR/PR res: [0x1af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305924.178026:0:5496:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f74b lrc: 1/0,0 mode: --/PR res: [0x1af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305924.178034:0:5496:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f74b lrc: 0/0,0 mode: --/PR res: [0x1af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305924.178052:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1772305924.178054:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1772305924.178057:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772305924.178607:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305924.178664:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225384064 00000100:00100000:0.0:1772305924.178694:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1015 00000100:00100000:0.0:1772305924.178697:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000022a16ea pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+72:99153:x1858396225384064:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1772305924.178747:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000022a16ea pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+72:99153:x1858396225384064:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 49us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305924.178752:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1015 00000100:00100000:1.0:1772305924.179777:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305924.179817:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225384128 00000100:00100000:0.0:1772305924.179844:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1016 00000100:00100000:0.0:1772305924.179848:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b515ed90 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+72:99153:x1858396225384128:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1772305924.179857:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305924.179868:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6f752 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196efc5 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.179907:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f759 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.179916:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f759 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.179922:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f759 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305924.179945:0:54697:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x32b:0x0]: returning size 1048576 00000004:00200000:0.0:1772305924.179948:0:54697:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1772305924.179958:0:54697:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f759 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.179964:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f759 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.179975:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6f752 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efc5 expref: 74 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.179984:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f759 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efc5 expref: 73 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.179989:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32b:0x0].0x0 (00000000fbf2c1ae) 00010000:00010000:0.0:1772305924.179990:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1772305924.179992:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a7782eea, rc 0) 00000100:00100000:0.0:1772305924.180018:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b515ed90 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+73:99153:x1858396225384128:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 169us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305924.180031:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1016 00000100:00100000:1.0:1772305924.180851:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305924.180882:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225384192 00000100:00100000:0.0:1772305924.180905:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5731 00000100:00100000:0.0:1772305924.180908:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000e418178 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+226:2216:x1858396225384192:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1772305924.180915:0:21400:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305924.180924:0:21400:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f760 lrc: 2/0,0 mode: --/PR res: [0x1af:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196efcc expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1772305924.180934:0:21400:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x1af:0x0] initial LVB size: 1048576, mtime: 0x69a33e03, atime: 0x0, ctime: 0x69a33e03, blocks: 0x1 00010000:00010000:0.0:1772305924.180942:0:21400:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305924.180943:0:21400:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305924.180946:0:21400:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f760 lrc: 3/0,0 mode: PR/PR res: [0x1af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efcc expref: 227 pid: 21400 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1772305924.180953:0:21400:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f760 lrc: 3/0,0 mode: PR/PR res: [0x1af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efcc expref: 227 pid: 21400 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1772305924.180961:0:21400:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000f7a426e, rc 0) 00000100:00100000:0.0:1772305924.180984:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000e418178 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2216:x1858396225384192:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 75us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305924.180989:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5731 00000100:00100000:1.0:1772305924.181745:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305924.181791:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225384320 00000100:00100000:0.0:1772305924.181818:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1017 00000100:00100000:0.0:1772305924.181823:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004ca67c10 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+73:99153:x1858396225384320:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1772305924.181861:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004ca67c10 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+73:99153:x1858396225384320:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 37us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305924.181874:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1017 00000100:00100000:1.0:1772305924.184864:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305924.184914:0:21399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225384448 00002000:00100000:0.0:1772305924.184943:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1af:0x0] (0->1048575) req@0000000057172e16 x1858396225384448/t0(0) o3->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:55/0 lens 488/0 e 0 to 0 dl 1772305930 ref 1 fl New:/0/ffffffff rc 0/-1 job:'lhsmtool_posix.0' 00002000:00100000:0.0:1772305924.184954:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 0000000057172e16 with x1858396225384448 ext(0->1048575) 00002000:00010000:0.0:1772305924.184957:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000057172e16 00000100:00100000:0.0:1772305924.184982:0:21399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2044 00000100:00100000:0.0:1772305924.184989:0:21399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000057172e16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2215:x1858396225384448:12345-192.168.203.30@tcp:3:lhsmtool_posix.0 00000100:00100000:0.0:1772305924.189219:0:21399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000057172e16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2215:x1858396225384448:12345-192.168.203.30@tcp:3:lhsmtool_posix.0 Request processed in 4228us (4354us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1772305924.189228:0:21399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2044 00002000:00100000:0.0:1772305924.189237:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1af:0x0] (0->1048575) req@0000000057172e16 x1858396225384448/t0(0) o3->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:55/0 lens 488/440 e 0 to 0 dl 1772305930 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'lhsmtool_posix.0' 00002000:00100000:0.0:1772305924.189247:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 0000000057172e16 with x1858396225384448 ext(0->1048575) 00002000:00010000:0.0:1772305924.189251:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000057172e16 00000100:00100000:1.0:1772305924.196794:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305924.196850:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225384512 00000100:00100000:0.0:1772305924.196887:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1018 00000100:00100000:0.0:1772305924.196892:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ca616e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+73:99153:x1858396225384512:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1772305924.196902:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305924.196913:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6f767 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196efd3 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.196934:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f76e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.196954:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f76e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.196962:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f76e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.197019:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6f767 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efd3 expref: 75 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.197031:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f76e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efd3 expref: 74 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.197036:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32b:0x0].0x0 (00000000fbf2c1ae) 00010000:00010000:0.0:1772305924.197038:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1772305924.197040:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c7dfb548, rc 0) 00000100:00100000:0.0:1772305924.197067:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ca616e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+74:99153:x1858396225384512:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 175us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305924.197072:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1018 00000100:00100000:1.0:1772305924.198456:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305924.198494:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225384576 00000100:00100000:0.0:1772305924.198520:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1019 00000100:00100000:0.0:1772305924.198523:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d8679794 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+74:99153:x1858396225384576:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1772305924.198535:0:54697:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x32b:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1772305924.198576:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d8679794 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+74:99153:x1858396225384576:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 52us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305924.198583:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1019 00000100:00100000:1.0:1772305924.199362:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305924.199415:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225384640 00000100:00100000:0.0:1772305924.199459:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5732 00000100:00100000:0.0:1772305924.199464:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a41f6911 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2216:x1858396225384640:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1772305924.199487:0:21400:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f775 lrc: 3/1,0 mode: --/PR res: [0x1af:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.199497:0:21400:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305924.199499:0:21400:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305924.199503:0:21400:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f775 lrc: 3/1,0 mode: PR/PR res: [0x1af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.199510:0:21400:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f775 lrc: 3/1,0 mode: PR/PR res: [0x1af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.199524:0:21400:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f775 lrc: 3/1,0 mode: PR/PR res: [0x1af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.199529:0:21400:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f775 lrc: 2/0,0 mode: PR/PR res: [0x1af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.199546:0:21400:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1772305924.199573:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a41f6911 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2216:x1858396225384640:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 Request processed in 108us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305924.199578:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5732 00010000:00010000:3.0:1772305924.199582:0:38581:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1772305924.199588:0:38581:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f775 lrc: 2/0,0 mode: PR/PR res: [0x1af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305924.199596:0:38581:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006e08f961 already unused, calling callback (00000000b5e4f3c0) 00010000:00010000:3.0:1772305924.199599:0:38581:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f775 lrc: 2/0,0 mode: PR/PR res: [0x1af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305924.199605:0:38581:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f775 lrc: 3/0,0 mode: PR/PR res: [0x1af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305924.199615:0:38581:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f775 lrc: 1/0,0 mode: --/PR res: [0x1af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305924.199619:0:38581:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f775 lrc: 0/0,0 mode: --/PR res: [0x1af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305924.199668:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1772305924.199669:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1772305924.199671:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772305924.200261:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305924.200298:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225384768 00000100:00100000:0.0:1772305924.200322:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1020 00000100:00100000:0.0:1772305924.200325:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006483edc6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+74:99153:x1858396225384768:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000040:00080000:0.0:1772305924.200543:0:54697:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772305924.200546:0:54697:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772305924.200670:0:54697:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 40 count 12 00000040:00080000:0.0:1772305924.200676:0:54697:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:0.0:1772305924.200726:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006483edc6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+75:99153:x1858396225384768:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 399us (466us total) trans 8589934905 rc 0/0 00000100:00100000:0.0:1772305924.200732:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1020 00000040:00080000:3.0:1772305924.200776:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305924.200780:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305924.201253:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 12 00000040:00080000:3.0:1772305924.201259:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:1.0:1772305924.201489:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305924.201531:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225384896 00000100:00100000:2.0:1772305924.201559:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 120 00000100:00100000:2.0:1772305924.201563:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003b46920d pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+75:99153:x1858396225384896:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1772305924.201700:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003b46920d pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+76:99153:x1858396225384896:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 135us (211us total) trans 8589934906 rc 0/0 00000100:00100000:2.0:1772305924.201710:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 120 00010000:00010000:0.0:1772305924.808724:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1772305924.834043:0:70582:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305924.834049:0:70582:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305924.834145:0:70582:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 40 count 12 00000040:00080000:1.0:1772305924.834154:0:70582:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:0.0:1772305924.849810:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305924.849862:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225384960 00000100:00100000:1.0:1772305924.849909:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5733 00000100:00100000:1.0:1772305924.849916:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006f23ed77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f935b4d0-e17f-49c8-8011-4be99ba75430+161:2216:x1858396225384960:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1772305924.849931:0:21400:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305924.849950:0:21400:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6f77c lrc: 2/0,0 mode: --/PR res: [0x1af:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196efda expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305924.849969:0:21400:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305924.849971:0:21400:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305924.849987:0:21400:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6f77c lrc: 3/0,0 mode: PR/PR res: [0x1af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efda expref: 162 pid: 21400 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1772305924.849999:0:21400:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6f77c lrc: 3/0,0 mode: PR/PR res: [0x1af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efda expref: 162 pid: 21400 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1772305924.850010:0:21400:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043f9fbca, rc 0) 00000100:00100000:1.0:1772305924.850057:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006f23ed77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f935b4d0-e17f-49c8-8011-4be99ba75430+162:2216:x1858396225384960:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 140us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305924.850065:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5733 00000100:00100000:1.0:1772305924.852233:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305924.852278:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225385088 00000100:00100000:0.0:1772305924.852319:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1021 00000100:00100000:0.0:1772305924.852326:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000091689862 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+54:99161:x1858396225385088:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1772305924.852337:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305924.852350:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6f783 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196efe1 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.852595:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6f78a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.852613:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6f78a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.852621:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6f78a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305924.853851:0:54697:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x32b:0x0]: returning size 1048576 00010000:00010000:0.0:1772305924.853970:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6f783 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efe1 expref: 57 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.853987:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6f78a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x32b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efe1 expref: 56 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.854010:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32b:0x0].0x0 (00000000fbf2c1ae) 00010000:00010000:0.0:1772305924.854013:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1772305924.854016:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000034fec1fd, rc 0) 00000100:00100000:0.0:1772305924.854069:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000091689862 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+56:99161:x1858396225385088:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 1742us (1838us total) trans 8589934907 rc 0/0 00000100:00100000:0.0:1772305924.854079:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1021 00000100:00100000:0.0:1772305924.855119:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305924.855170:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225385152 00000100:00100000:1.0:1772305924.855207:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5734 00000100:00100000:1.0:1772305924.855213:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000848c45a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f935b4d0-e17f-49c8-8011-4be99ba75430+162:2215:x1858396225385152:12345-192.168.203.30@tcp:1:lfs.0 00010000:00010000:1.0:1772305924.855245:0:21400:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6f798 lrc: 3/0,1 mode: --/PW res: [0x1af:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305924.855263:0:21400:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f760 lrc: 2/0,0 mode: PR/PR res: [0x1af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efcc expref: 226 pid: 21400 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1772305924.855272:0:21400:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6f77c lrc: 2/0,0 mode: PR/PR res: [0x1af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efda expref: 162 pid: 21400 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1772305924.855281:0:21400:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305924.855283:0:21400:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305924.855285:0:21400:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6f798 lrc: 5/0,1 mode: --/PW res: [0x1af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305924.855317:0:21400:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6f77c lrc: 3/0,0 mode: PR/PR res: [0x1af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efda expref: 162 pid: 21400 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1772305924.855329:0:21400:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6f77c lrc: 4/0,0 mode: PR/PR res: [0x1af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efda expref: 162 pid: 21400 timeout: 1336 lvb_type: 1 00000100:00100000:1.0:1772305924.855344:0:21400:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000870e476c pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:21400:1858396216605440:192.168.203.30@tcp:104: 00010000:00010000:1.0:1772305924.855418:0:21400:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f760 lrc: 3/0,0 mode: PR/PR res: [0x1af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efcc expref: 226 pid: 21400 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1772305924.855430:0:21400:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f760 lrc: 4/0,0 mode: PR/PR res: [0x1af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efcc expref: 226 pid: 21400 timeout: 1336 lvb_type: 1 00000100:00100000:1.0:1772305924.855453:0:21400:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003bce9793 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:21400:1858396216605504:192.168.203.30@tcp:104: 00000100:00100000:1.0:1772305924.855480:0:21400:0:(client.c:2500:ptlrpc_set_wait()) set 00000000862e75a1 going to sleep for 6 seconds 00000100:00100000:0.0:1772305924.856465:0:21400:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000870e476c pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:21400:1858396216605440:192.168.203.30@tcp:104: 00000100:00100000:0.0:1772305924.856485:0:21400:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003bce9793 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:21400:1858396216605504:192.168.203.30@tcp:104: 00010000:00010000:0.0:1772305924.856507:0:21400:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6f798 lrc: 3/0,1 mode: --/PW res: [0x1af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305924.856655:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305924.856685:0:5494:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225385216 00010000:00010000:1.0:1772305924.856705:0:5494:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6f77c lrc: 4/0,0 mode: PR/PR res: [0x1af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efda expref: 163 pid: 21400 timeout: 1336 lvb_type: 1 00000100:00100000:1.0:1772305924.856735:0:5494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3110 00000100:00100000:1.0:1772305924.856740:0:5494:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d0ab861f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+163:2215:x1858396225385216:12345-192.168.203.30@tcp:103:ldlm_bl_07.0 00010000:00010000:1.0:1772305924.856749:0:5494:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1772305924.856765:0:5494:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6f77c lrc: 4/0,0 mode: PR/PR res: [0x1af:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efda expref: 163 pid: 21400 timeout: 1336 lvb_type: 1 00010000:00010000:1.0:1772305924.856774:0:5494:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6f77c lrc: 3/0,0 mode: PR/PR res: [0x1af:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efda expref: 163 pid: 21400 timeout: 1336 lvb_type: 1 00010000:00010000:1.0:1772305924.856786:0:5494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6f77c lrc: 0/0,0 mode: --/PR res: [0x1af:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efda expref: 163 pid: 21400 timeout: 1336 lvb_type: 1 00010000:00010000:1.0:1772305924.856801:0:5494:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1772305924.856828:0:5494:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d0ab861f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+162:2215:x1858396225385216:12345-192.168.203.30@tcp:103:ldlm_bl_07.0 Request processed in 88us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305924.856839:0:5494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3110 00000100:00100000:1.0:1772305924.858043:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305924.858075:0:5494:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225385280 00010000:00010000:3.0:1772305924.858091:0:5494:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f760 lrc: 4/0,0 mode: PR/PR res: [0x1af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efcc expref: 227 pid: 21400 timeout: 1336 lvb_type: 1 00000100:00100000:3.0:1772305924.858112:0:5494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3111 00000100:00100000:3.0:1772305924.858115:0:5494:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dacbed4c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2217:x1858396225385280:12345-192.168.203.30@tcp:103:ldlm_bl_06.0 00010000:00010000:3.0:1772305924.858122:0:5494:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1772305924.858131:0:5494:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f760 lrc: 4/0,0 mode: PR/PR res: [0x1af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efcc expref: 227 pid: 21400 timeout: 1336 lvb_type: 1 00010000:00010000:3.0:1772305924.858137:0:5494:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f760 lrc: 3/0,0 mode: PR/PR res: [0x1af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efcc expref: 227 pid: 21400 timeout: 1336 lvb_type: 1 00010000:00010000:3.0:1772305924.858152:0:5494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f760 lrc: 0/0,0 mode: --/PR res: [0x1af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efcc expref: 227 pid: 21400 timeout: 1336 lvb_type: 1 00010000:00010000:3.0:1772305924.858160:0:5494:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1772305924.858162:0:5494:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1772305924.858164:0:5494:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6f798 lrc: 3/0,1 mode: PW/PW res: [0x1af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305924.858177:0:5494:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6f798 lrc: 4/0,1 mode: PW/PW res: [0x1af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305924.858195:0:5494:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1772305924.858218:0:21400:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6f798 lrc: 3/0,1 mode: PW/PW res: [0x1af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305924.858223:0:5494:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dacbed4c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+226:2217:x1858396225385280:12345-192.168.203.30@tcp:103:ldlm_bl_06.0 Request processed in 105us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305924.858238:0:5494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3111 00010000:00010000:0.0:1772305924.858240:0:21400:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6f798 lrc: 3/0,1 mode: PW/PW res: [0x1af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.858265:0:21400:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6f798 lrc: 3/0,1 mode: PW/PW res: [0x1af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.858274:0:21400:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6f798 lrc: 2/0,0 mode: PW/PW res: [0x1af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.858309:0:21400:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1772305924.858318:0:6322:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1772305924.858322:0:6322:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6f798 lrc: 2/0,0 mode: PW/PW res: [0x1af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305924.858358:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000848c45a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f935b4d0-e17f-49c8-8011-4be99ba75430+161:2215:x1858396225385152:12345-192.168.203.30@tcp:1:lfs.0 Request processed in 3143us (3240us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305924.858368:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5734 00010000:00010000:3.0:1772305924.858400:0:6322:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a84c62ba already unused, calling callback (00000000b5e4f3c0) 00010000:00010000:3.0:1772305924.858405:0:6322:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6f798 lrc: 2/0,0 mode: PW/PW res: [0x1af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305924.858413:0:6322:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6f798 lrc: 3/0,0 mode: PW/PW res: [0x1af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305924.858429:0:6322:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6f798 lrc: 1/0,0 mode: --/PW res: [0x1af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305924.858436:0:6322:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6f798 lrc: 0/0,0 mode: --/PW res: [0x1af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305924.858451:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1772305924.858453:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1772305924.858455:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772305924.859156:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305924.859194:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225385408 00000100:00100000:3.0:1772305924.859226:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 121 00000100:00100000:3.0:1772305924.859231:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000873b4f3c pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+56:99161:x1858396225385408:12345-192.168.203.30@tcp:35:lfs.0 00000004:00010000:3.0:1772305924.859266:0:57054:0:(mdt_open.c:1862:mdt_hsm_release()) ### [0x200000402:0x32b:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6f78a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x32b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efe1 expref: 56 pid: 54697 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1772305924.859432:0:57054:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934908 00000001:00080000:3.0:1772305924.859996:0:57054:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934908 00010000:00010000:3.0:1772305924.860040:0:57054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c6f79f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305924.860050:0:57054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6f6db lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef94 expref: 75 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305924.860056:0:57054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f705 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efa2 expref: 57 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305924.860060:0:57054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f759 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efc5 expref: 75 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305924.860065:0:57054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f76e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efd3 expref: 75 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305924.860069:0:57054:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c6f79f lrc: 7/0,1 mode: --/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305924.860086:0:57054:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f76e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efd3 expref: 75 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305924.860094:0:57054:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f76e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efd3 expref: 75 pid: 54697 timeout: 1336 lvb_type: 0 00000100:00100000:3.0:1772305924.860109:0:57054:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000830ec897 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:57054:1858396216605568:192.168.203.30@tcp:104: 00010000:00010000:3.0:1772305924.860153:0:57054:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f759 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efc5 expref: 75 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305924.860159:0:57054:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f759 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efc5 expref: 75 pid: 54697 timeout: 1336 lvb_type: 0 00000100:00100000:3.0:1772305924.860166:0:57054:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f842a169 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:57054:1858396216605632:192.168.203.30@tcp:104: 00010000:00010000:3.0:1772305924.860189:0:57054:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f705 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efa2 expref: 57 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305924.860196:0:57054:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f705 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efa2 expref: 57 pid: 54698 timeout: 1336 lvb_type: 0 00000100:00100000:3.0:1772305924.860203:0:57054:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c84b7376 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:57054:1858396216605696:192.168.203.30@tcp:104: 00010000:00010000:3.0:1772305924.860224:0:57054:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6f6db lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef94 expref: 75 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305924.860229:0:57054:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6f6db lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef94 expref: 75 pid: 54698 timeout: 1336 lvb_type: 0 00000100:00100000:3.0:1772305924.860236:0:57054:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000453faf57 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:57054:1858396216605760:192.168.203.30@tcp:104: 00000100:00100000:3.0:1772305924.860255:0:57054:0:(client.c:2500:ptlrpc_set_wait()) set 00000000ed250a64 going to sleep for 6 seconds 00000100:00100000:2.0:1772305924.861797:0:57054:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000830ec897 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:57054:1858396216605568:192.168.203.30@tcp:104: 00000100:00100000:2.0:1772305924.861812:0:57054:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f842a169 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:57054:1858396216605632:192.168.203.30@tcp:104: 00000100:00100000:1.0:1772305924.861819:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305924.861822:0:57054:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c84b7376 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:57054:1858396216605696:192.168.203.30@tcp:104: 00000100:00100000:2.0:1772305924.861836:0:57054:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000453faf57 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:57054:1858396216605760:192.168.203.30@tcp:104: 00000100:00100000:1.0:1772305924.861853:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00010000:2.0:1772305924.861866:0:57054:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c6f79f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305924.861868:0:5494:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225385472 00000100:00100000:1.0:1772305924.861882:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00010000:0.0:1772305924.861888:0:5494:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f76e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efd3 expref: 76 pid: 54697 timeout: 1336 lvb_type: 0 00000100:00100000:0.0:1772305924.861922:0:5494:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225385536 00000100:00100000:2.0:1772305924.861925:0:5495:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225385600 00000100:00100000:1.0:1772305924.861929:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00010000:0.0:1772305924.861933:0:5494:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f759 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efc5 expref: 78 pid: 54697 timeout: 1336 lvb_type: 0 00010000:00010000:2.0:1772305924.861946:0:5495:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6f6db lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef94 expref: 78 pid: 54698 timeout: 1336 lvb_type: 0 00000100:00100000:0.0:1772305924.861954:0:5494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3112 00000100:00100000:0.0:1772305924.861963:0:5494:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c30d8750 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+78:2216:x1858396225385472:12345-192.168.203.30@tcp:103:ldlm_bl_08.0 00000100:00100000:1.0:1772305924.861967:0:16126:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225385664 00010000:00010000:0.0:1772305924.861971:0:5494:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1772305924.861977:0:5494:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f76e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efd3 expref: 78 pid: 54697 timeout: 1336 lvb_type: 0 00000100:00100000:2.0:1772305924.861982:0:5495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3113 00010000:00010000:1.0:1772305924.861986:0:16126:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f705 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efa2 expref: 58 pid: 54698 timeout: 1336 lvb_type: 0 00010000:00010000:0.0:1772305924.861995:0:5494:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f76e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x20/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efd3 expref: 78 pid: 54697 timeout: 1336 lvb_type: 0 00000100:00100000:2.0:1772305924.861997:0:5495:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003bce9793 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+78:2215:x1858396225385536:12345-192.168.203.30@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1772305924.862014:0:5495:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1772305924.862017:0:16126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3114 00010000:00010000:0.0:1772305924.862018:0:5494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f76e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efd3 expref: 78 pid: 54697 timeout: 1336 lvb_type: 0 00010000:00010000:2.0:1772305924.862027:0:5495:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f759 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efc5 expref: 77 pid: 54697 timeout: 1336 lvb_type: 0 00000100:00100000:1.0:1772305924.862028:0:16126:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000870e476c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+77:2218:x1858396225385600:12345-192.168.203.30@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1772305924.862030:0:5494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32b:0x0].0x0 (00000000fbf2c1ae) 00010000:00010000:0.0:1772305924.862037:0:5494:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c6f79f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x28/0x0 rrc: 9 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305924.862046:0:16126:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1772305924.862053:0:5494:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c6f79f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x28/0x0 rrc: 10 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305924.862054:0:16126:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6f6db lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x9/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef94 expref: 77 pid: 54698 timeout: 1336 lvb_type: 0 00010000:00010000:0.0:1772305924.862070:0:5494:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1772305924.862074:0:5495:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f759 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efc5 expref: 77 pid: 54697 timeout: 1336 lvb_type: 0 00010000:00010000:1.0:1772305924.862086:0:16126:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6f6db lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef94 expref: 77 pid: 54698 timeout: 1336 lvb_type: 0 00000100:00100000:0.0:1772305924.862098:0:5494:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c30d8750 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+77:2216:x1858396225385472:12345-192.168.203.30@tcp:103:ldlm_bl_08.0 Request processed in 136us (281us total) trans 0 rc 0/0 00010000:00010000:2.0:1772305924.862103:0:5495:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f759 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efc5 expref: 77 pid: 54697 timeout: 1336 lvb_type: 0 00000100:00100000:0.0:1772305924.862110:0:5494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3112 00010000:00010000:1.0:1772305924.862112:0:16126:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c6f6db lrc: 0/0,0 mode: --/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x9/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196ef94 expref: 77 pid: 54698 timeout: 1336 lvb_type: 0 00010000:00010000:2.0:1772305924.862123:0:5495:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32b:0x0].0x0 (00000000fbf2c1ae) 00010000:00010000:2.0:1772305924.862130:0:5495:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c6f79f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305924.862131:0:5494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3115 00000100:00100000:0.0:1772305924.862139:0:5494:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000043720844 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+58:2218:x1858396225385664:12345-192.168.203.30@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1772305924.862140:0:5495:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c6f79f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.862146:0:5494:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1772305924.862147:0:16126:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32b:0x0].0x0 (00000000fbf2c1ae) 00010000:00010000:2.0:1772305924.862148:0:5495:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1772305924.862152:0:16126:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c6f79f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.862153:0:5494:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f705 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efa2 expref: 58 pid: 54698 timeout: 1336 lvb_type: 0 00000100:00100000:2.0:1772305924.862172:0:5495:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003bce9793 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+74:2215:x1858396225385536:12345-192.168.203.30@tcp:103:ldlm_bl_03.0 Request processed in 178us (321us total) trans 0 rc 0/0 00010000:00010000:1.0:1772305924.862174:0:16126:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c6f79f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305924.862185:0:16126:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1772305924.862188:0:5495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3113 00010000:00010000:0.0:1772305924.862189:0:5494:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f705 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efa2 expref: 58 pid: 54698 timeout: 1336 lvb_type: 0 00010000:00010000:0.0:1772305924.862203:0:5494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f705 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efa2 expref: 58 pid: 54698 timeout: 1336 lvb_type: 0 00000100:00100000:1.0:1772305924.862210:0:16126:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000870e476c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+73:2218:x1858396225385600:12345-192.168.203.30@tcp:103:ldlm_bl_02.0 Request processed in 183us (329us total) trans 0 rc 0/0 00010000:00010000:0.0:1772305924.862214:0:5494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32b:0x0].0x0 (00000000fbf2c1ae) 00010000:00010000:0.0:1772305924.862218:0:5494:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c6f79f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305924.862220:0:16126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3114 00010000:00010000:0.0:1772305924.862228:0:5494:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c6f79f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.862234:0:5494:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c6f79f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.862257:0:5494:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1772305924.862280:0:5494:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000043720844 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+57:2218:x1858396225385664:12345-192.168.203.30@tcp:103:ldlm_bl_01.0 Request processed in 141us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305924.862287:0:5494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3115 00010000:00010000:2.0:1772305924.862352:0:57054:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c6f79f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305924.862361:0:57054:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c6f79f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1772305924.862438:0:57054:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934908 00000001:00080000:2.0:1772305924.862659:0:57054:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934908 00000100:00100000:2.0:1772305924.862766:0:57054:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000faca0d01 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:57054:1858396216605824:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1772305924.862808:0:57054:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772305924.862831:0:57054:0:(client.c:2500:ptlrpc_set_wait()) set 00000000c2b45813 going to sleep for 6 seconds 00000100:00100000:0.0:1772305924.862853:0:57220:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216605824 00000100:00100000:0.0:1772305924.862900:0:57220:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1772305924.862909:0:57220:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002a43cdb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:57054:x1858396216605824:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1772305924.862983:0:57220:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002a43cdb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:57054:x1858396216605824:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 75us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305924.862992:0:57220:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1772305924.862999:0:57054:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000faca0d01 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:57054:1858396216605824:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1772305924.863321:0:57054:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934908 00000100:00100000:2.0:1772305924.863361:0:57054:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000faca0d01 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:57054:1858396216605888:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1772305924.863409:0:57054:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772305924.863427:0:57054:0:(client.c:2500:ptlrpc_set_wait()) set 000000007aaf16a4 going to sleep for 6 seconds 00000100:00100000:0.0:1772305924.863454:0:57220:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216605888 00000100:00100000:0.0:1772305924.863485:0:57220:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1772305924.863491:0:57220:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000010b5ceff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:57054:x1858396216605888:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1772305924.863700:0:57220:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000010b5ceff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:57054:x1858396216605888:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 206us (289us total) trans 4294968308 rc 0/0 00000100:00100000:0.0:1772305924.863709:0:57220:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1772305924.863824:0:57054:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000faca0d01 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:57054:1858396216605888:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1772305924.863857:0:57054:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934908 00010000:00010000:2.0:1772305924.863871:0:57054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c6f79f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305924.863877:0:57054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c6f79f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305924.863883:0:57054:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c6f79f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305924.863887:0:57054:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000617aea8a already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305924.863889:0:57054:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c6f79f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305924.863894:0:57054:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c6f79f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305924.863901:0:57054:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32b:0x0].0x0 (00000000fbf2c1ae) 00010000:00010000:2.0:1772305924.863903:0:57054:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1772305924.863905:0:57054:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c6f79f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305924.863909:0:57054:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c6f79f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1772305924.864052:0:57054:0:(mdd_object.c:3529:mdd_close()) Object [0x200000408:0x8e:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1772305924.864115:0:57054:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xb:0x0].10, 64 off8904 00000004:00080000:2.0:1772305924.864121:0:57054:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1236758493618ns, next at 1237758491700ns, rc = 0 00000001:00080000:2.0:1772305924.864126:0:57054:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934908 00010000:00010000:2.0:1772305924.864175:0:57054:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32b:0x0].0x0 (00000000fbf2c1ae) 00010000:00010000:2.0:1772305924.864178:0:57054:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1772305924.864181:0:57054:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6f78a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x32b:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efe1 expref: 56 pid: 54697 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305924.864237:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000873b4f3c pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+55:99161:x1858396225385408:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 5006us (5084us total) trans 8589934908 rc 0/0 00000100:00100000:2.0:1772305924.864243:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 121 00000100:00100000:1.0:1772305924.874148:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305924.874189:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225385792 00000100:00100000:0.0:1772305924.874238:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1022 00000100:00100000:0.0:1772305924.874244:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cba49044 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+55:99164:x1858396225385792:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1772305924.874264:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305924.874281:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f7a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196efe8 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.874334:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f7ad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.874355:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f7ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.874364:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f7ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.874376:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6f7b4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.874381:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6f7b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.874398:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6f7b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.874516:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6f7bb lrc: 3/1,0 mode: --/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.874523:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6f7bb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.874528:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6f7bb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305924.874535:0:54697:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x32b:0x0]: returning size 1048576 00010000:00010000:0.0:1772305924.874667:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f7ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.874676:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f7ad lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.874696:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f7ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.874702:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c7dfb548 already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305924.874706:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f7ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.874715:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f7ad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.874727:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:0.0:1772305924.874731:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305924.874735:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f7ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.874741:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f7ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.874752:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6f7b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.874756:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6f7b4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.874760:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6f7b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.874764:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000870ce7f2 already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305924.874765:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6f7b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.874776:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6f7b4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.874782:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6325532c (000000003892ce01) 00010000:00010000:0.0:1772305924.874783:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305924.874785:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6f7b4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.874788:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6f7b4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.874814:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f7a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efe8 expref: 58 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.874823:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6f7bb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efe8 expref: 57 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.874828:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32b:0x0].0x0 (000000000c14a94e) 00010000:00010000:0.0:1772305924.874829:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1772305924.874830:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000034fec1fd, rc 0) 00000100:00100000:0.0:1772305924.874875:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cba49044 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+57:99164:x1858396225385792:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 630us (731us total) trans 8589934909 rc 0/0 00000100:00100000:0.0:1772305924.874880:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1022 00000100:00100000:1.0:1772305924.875965:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305924.876000:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225385856 00000100:00100000:0.0:1772305924.876029:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1023 00000100:00100000:0.0:1772305924.876034:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c221b79d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+57:99164:x1858396225385856:12345-192.168.203.30@tcp:54:lfs.0 00010000:00010000:0.0:1772305924.876056:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f7c9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.876069:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f7c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.876075:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f7c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.876085:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f7c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.876089:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f7c9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.876093:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f7c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.876096:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a7782eea already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305924.876098:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f7c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.876101:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f7c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.876124:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32b:0x0].0x0 (000000000c14a94e) 00010000:00010000:0.0:1772305924.876126:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1772305924.876128:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f7c9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.876132:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f7c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305924.876179:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c221b79d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+57:99164:x1858396225385856:12345-192.168.203.30@tcp:54:lfs.0 Request processed in 145us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305924.876185:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1023 00000100:00100000:2.0:1772305924.876867:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305924.876911:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225385984 00000100:00100000:0.0:1772305924.876945:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 122 00000100:00100000:0.0:1772305924.876949:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d8f6a4e6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+57:99164:x1858396225385984:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:0.0:1772305924.877049:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d8f6a4e6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+58:99164:x1858396225385984:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 99us (185us total) trans 8589934910 rc 0/0 00000100:00100000:0.0:1772305924.877056:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 122 00000100:00100000:2.0:1772305924.894516:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305924.894570:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225386112 00000100:00100000:0.0:1772305924.894615:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1024 00000100:00100000:0.0:1772305924.894622:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b0099b15 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+58:99169:x1858396225386112:12345-192.168.203.30@tcp:101:filefrag.0 00010000:00010000:0.0:1772305924.894700:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305924.894721:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f7d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196efef expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.894807:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f7d7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.894819:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f7d7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.894829:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f7d7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305924.894837:0:54697:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x32b:0x0]: returning size 1048576 00010000:00010000:0.0:1772305924.894934:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f7d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efef expref: 61 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.894950:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f7d7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efef expref: 60 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.894956:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32b:0x0].0x0 (000000000c14a94e) 00010000:00010000:0.0:1772305924.894958:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1772305924.894961:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000082c88ffe, rc 0) 00000100:00100000:0.0:1772305924.895015:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b0099b15 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+60:99169:x1858396225386112:12345-192.168.203.30@tcp:101:filefrag.0 Request processed in 391us (501us total) trans 8589934911 rc 0/0 00000100:00100000:0.0:1772305924.895023:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1024 00000100:00100000:1.0:1772305924.895919:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305924.895979:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225386176 00000100:00100000:0.0:1772305924.896015:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1025 00000100:00100000:0.0:1772305924.896021:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000166181f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+60:99169:x1858396225386176:12345-192.168.203.30@tcp:101:filefrag.0 00010000:00010000:0.0:1772305924.896034:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305924.896044:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6f7e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196eff6 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.896078:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f7ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.896089:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f7ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.896096:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f7ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305924.896117:0:54697:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x32b:0x0]: returning size 1048576 00000004:00200000:0.0:1772305924.896121:0:54697:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1772305924.896146:0:54697:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f7ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.896155:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f7ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.896172:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6f7e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eff6 expref: 62 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.896183:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f7ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eff6 expref: 61 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.896190:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32b:0x0].0x0 (000000000c14a94e) 00010000:00010000:0.0:1772305924.896192:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1772305924.896193:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c7dfb548, rc 0) 00000100:00100000:0.0:1772305924.896231:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000166181f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+61:99169:x1858396225386176:12345-192.168.203.30@tcp:101:filefrag.0 Request processed in 210us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305924.896238:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1025 00000100:00100000:2.0:1772305924.896915:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305924.896945:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225386240 00000100:00100000:0.0:1772305924.896969:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1026 00000100:00100000:0.0:1772305924.896972:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000890ea8c8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+61:99169:x1858396225386240:12345-192.168.203.30@tcp:41:filefrag.0 00000004:00000024:0.0:1772305924.897003:0:54697:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 7435452416 avail 7429160960 00000100:00100000:0.0:1772305924.897043:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000890ea8c8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+61:99169:x1858396225386240:12345-192.168.203.30@tcp:41:filefrag.0 Request processed in 69us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305924.897048:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1026 00000100:00100000:2.0:1772305924.902929:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305924.902975:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225386304 00000100:00100000:0.0:1772305924.903007:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1027 00000100:00100000:0.0:1772305924.903012:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001f9afe5d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+61:99171:x1858396225386304:12345-192.168.203.30@tcp:101:cp.0 00010000:00010000:0.0:1772305924.903024:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305924.903036:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f7f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196effd expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.903077:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f7fa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.903085:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f7fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.903092:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f7fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.903101:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f801 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.903106:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f801 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.903110:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f801 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.903156:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f7fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.903160:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f7fa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.903164:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f7fa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.903169:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000f7a426e already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305924.903172:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f7fa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.903176:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f7fa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.903182:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:0.0:1772305924.903184:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305924.903187:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f7fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.903190:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f7fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.903196:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f801 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.903200:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f801 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.903204:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f801 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.903207:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006e08f961 already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305924.903208:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f801 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.903212:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f801 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.903216:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb9a0e35e (000000003892ce01) 00010000:00010000:0.0:1772305924.903218:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305924.903219:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f801 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.903222:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f801 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.903239:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f7f3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196effd expref: 62 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.903243:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f7f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196effd expref: 62 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.903247:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a7782eea, rc 0) 00000100:00100000:0.0:1772305924.903280:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001f9afe5d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+61:99171:x1858396225386304:12345-192.168.203.30@tcp:101:cp.0 Request processed in 268us (358us total) trans 0 rc 301/301 00000100:00100000:0.0:1772305924.903286:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1027 00000100:00100000:1.0:1772305924.904585:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305924.904657:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225386432 00000100:00100000:0.0:1772305924.904691:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1028 00000100:00100000:0.0:1772305924.904698:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000032bc5322 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+61:99171:x1858396225386432:12345-192.168.203.30@tcp:101:cp.0 00010000:00010000:0.0:1772305924.904709:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305924.904711:0:54697:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1772305924.904725:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c6f71a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efb0 expref: 61 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.904738:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:0.0:1772305924.904742:0:54697:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1772305924.904750:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f808 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f004 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.904810:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f80f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.904820:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f80f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.904828:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f80f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.904839:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6f816 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.904846:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6f816 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.904852:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6f816 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1772305924.905171:0:54697:0:(osp_object.c:1645:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x100010000:0x1b0:0x0], index 1: 0 00010000:00010000:0.0:1772305924.905308:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000eca741a1/0xa5e9c8c58c6f81d lrc: 3/1,0 mode: --/CR res: [0x200000408:0x8f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.905318:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000eca741a1/0xa5e9c8c58c6f81d lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8f:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.905325:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000eca741a1/0xa5e9c8c58c6f81d lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8f:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.905357:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f80f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.905364:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f80f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.905370:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f80f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.905376:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000079ce3603 already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305924.905379:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f80f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.905402:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f80f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.905412:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:0.0:1772305924.905415:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305924.905417:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f80f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.905423:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f80f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1772305924.905432:0:54697:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000032bc5322 reply state 000000004892c8b7 transno 8589934912 ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6f816 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.905453:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f808 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f004 expref: 63 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.905470:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000eca741a1/0xa5e9c8c58c6f81d lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x8f:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f004 expref: 62 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.905476:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8f:0x0].0x0 (00000000955bccbc) 00010000:00010000:0.0:1772305924.905479:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1772305924.905480:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000eca741a1, rc 0) 00000100:00100000:0.0:1772305924.905517:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000032bc5322 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+63:99171:x1858396225386432:12345-192.168.203.30@tcp:101:cp.0 Request processed in 819us (934us total) trans 8589934912 rc 0/0 00000100:00100000:0.0:1772305924.905522:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1028 00010000:00010000:3.0:1772305924.906113:0:2978:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6f816 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305924.906143:0:2978:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6f816 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305924.906150:0:2978:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6f816 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305924.906156:0:2978:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000001e903b7f already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305924.906159:0:2978:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6f816 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305924.906166:0:2978:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6f816 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305924.906176:0:2978:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb9a0e35e (000000005046deb8) 00010000:00010000:3.0:1772305924.906179:0:2978:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305924.906181:0:2978:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6f816 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305924.906187:0:2978:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6f816 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305924.906805:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305924.906845:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225386496 00000100:00100000:0.0:1772305924.906881:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1029 00000100:00100000:0.0:1772305924.906888:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000451e9247 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+62:99171:x1858396225386496:12345-192.168.203.30@tcp:101:cp.0 00010000:00010000:0.0:1772305924.906902:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305924.906913:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007c4795ba/0xa5e9c8c58c6f82b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f00b expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.906946:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000020fba8b5/0xa5e9c8c58c6f832 lrc: 3/1,0 mode: --/PR res: [0x200000408:0x8f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.906957:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000020fba8b5/0xa5e9c8c58c6f832 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.906965:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000020fba8b5/0xa5e9c8c58c6f832 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305924.906985:0:54697:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1772305924.906996:0:54697:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 0000000020fba8b5/0xa5e9c8c58c6f832 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.907006:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000020fba8b5/0xa5e9c8c58c6f832 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.907022:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007c4795ba/0xa5e9c8c58c6f82b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f00b expref: 64 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.907035:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000020fba8b5/0xa5e9c8c58c6f832 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f00b expref: 63 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.907042:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8f:0x0].0x0 (00000000955bccbc) 00010000:00010000:0.0:1772305924.907045:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1772305924.907047:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000020fba8b5, rc 0) 00000100:00100000:0.0:1772305924.907080:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000451e9247 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+63:99171:x1858396225386496:12345-192.168.203.30@tcp:101:cp.0 Request processed in 192us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305924.907087:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1029 00000100:00100000:2.0:1772305924.907943:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305924.907985:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225386560 00000100:00100000:0.0:1772305924.908017:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5735 00000100:00100000:0.0:1772305924.908023:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006e7b3ee8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f935b4d0-e17f-49c8-8011-4be99ba75430+140:2215:x1858396225386560:12345-192.168.203.30@tcp:101:cp.0 00010000:00010000:0.0:1772305924.908030:0:21400:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305924.908041:0:21400:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027bbef42/0xa5e9c8c58c6f839 lrc: 2/0,0 mode: --/PR res: [0x1b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f012 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1772305924.908056:0:21400:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x1b0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1772305924.908066:0:21400:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305924.908067:0:21400:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305924.908072:0:21400:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027bbef42/0xa5e9c8c58c6f839 lrc: 3/0,0 mode: PR/PR res: [0x1b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f012 expref: 141 pid: 21400 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1772305924.908084:0:21400:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000027bbef42/0xa5e9c8c58c6f839 lrc: 3/0,0 mode: PR/PR res: [0x1b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f012 expref: 141 pid: 21400 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1772305924.908092:0:21400:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027bbef42, rc 0) 00000100:00100000:0.0:1772305924.908116:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006e7b3ee8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f935b4d0-e17f-49c8-8011-4be99ba75430+141:2215:x1858396225386560:12345-192.168.203.30@tcp:101:cp.0 Request processed in 94us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305924.908121:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5735 00000100:00100000:2.0:1772305924.909098:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305924.909146:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225386688 00000100:00100000:0.0:1772305924.909180:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1030 00000100:00100000:0.0:1772305924.909185:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000af22ffe1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+63:99171:x1858396225386688:12345-192.168.203.30@tcp:58:cp.0 00010000:00010000:0.0:1772305924.909229:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000003bb10b1c/0xa5e9c8c58c6f840 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.909241:0:54697:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6f7bb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efe8 expref: 63 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.909249:0:54697:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f7d7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efef expref: 63 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.909256:0:54697:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f7ec lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eff6 expref: 63 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.909262:0:54697:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 000000003bb10b1c/0xa5e9c8c58c6f840 lrc: 6/0,1 mode: --/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.909291:0:54697:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f7ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eff6 expref: 63 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.909304:0:54697:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f7ec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eff6 expref: 63 pid: 54697 timeout: 1336 lvb_type: 0 00000100:00100000:0.0:1772305924.909316:0:54697:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000774de3b7 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:54697:1858396216605952:192.168.203.30@tcp:104: 00010000:00010000:0.0:1772305924.909373:0:54697:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f7d7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efef expref: 63 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.909382:0:54697:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f7d7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efef expref: 63 pid: 54697 timeout: 1336 lvb_type: 0 00000100:00100000:0.0:1772305924.909407:0:54697:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000756cf3a5 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:54697:1858396216606016:192.168.203.30@tcp:104: 00010000:00010000:0.0:1772305924.909444:0:54697:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6f7bb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efe8 expref: 63 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.909453:0:54697:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6f7bb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efe8 expref: 63 pid: 54697 timeout: 1336 lvb_type: 0 00000100:00100000:0.0:1772305924.909461:0:54697:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003084e0c8 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:54697:1858396216606080:192.168.203.30@tcp:104: 00000100:00100000:0.0:1772305924.909490:0:54697:0:(client.c:2500:ptlrpc_set_wait()) set 000000003d646da2 going to sleep for 6 seconds 00000100:00100000:0.0:1772305924.910280:0:54697:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000774de3b7 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:54697:1858396216605952:192.168.203.30@tcp:104: 00000100:00100000:0.0:1772305924.910294:0:54697:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000756cf3a5 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:54697:1858396216606016:192.168.203.30@tcp:104: 00000100:00100000:0.0:1772305924.910302:0:54697:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003084e0c8 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:54697:1858396216606080:192.168.203.30@tcp:104: 00010000:00010000:0.0:1772305924.910326:0:54697:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 000000003bb10b1c/0xa5e9c8c58c6f840 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305924.910513:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305924.910547:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305924.910565:0:5494:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225386752 00000100:00100000:1.0:1772305924.910588:0:5493:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225386816 00010000:00010000:0.0:1772305924.910591:0:5494:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f7d7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efef expref: 64 pid: 54697 timeout: 1336 lvb_type: 0 00010000:00010000:1.0:1772305924.910605:0:5493:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f7ec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eff6 expref: 65 pid: 54697 timeout: 1336 lvb_type: 0 00000100:00100000:2.0:1772305924.910618:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305924.910681:0:5494:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225386880 00000100:00100000:1.0:1772305924.910690:0:5493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3116 00010000:00010000:0.0:1772305924.910698:0:5494:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6f7bb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efe8 expref: 66 pid: 54697 timeout: 1336 lvb_type: 0 00000100:00100000:1.0:1772305924.910702:0:5493:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001571dacd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+66:2216:x1858396225386752:12345-192.168.203.30@tcp:103:ldlm_bl_05.0 00000100:00100000:2.0:1772305924.910711:0:6323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3117 00010000:00010000:1.0:1772305924.910717:0:5493:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1772305924.910722:0:6323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ea1c5fa0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+66:2216:x1858396225386816:12345-192.168.203.30@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1772305924.910724:0:5493:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f7d7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efef expref: 66 pid: 54697 timeout: 1336 lvb_type: 0 00000100:00100000:3.0:1772305924.910732:0:7104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3118 00010000:00010000:2.0:1772305924.910741:0:6323:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1772305924.910752:0:6323:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f7ec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eff6 expref: 66 pid: 54697 timeout: 1336 lvb_type: 0 00010000:00010000:1.0:1772305924.910752:0:5493:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f7d7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efef expref: 66 pid: 54697 timeout: 1336 lvb_type: 0 00000100:00100000:3.0:1772305924.910753:0:7104:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000061fb05d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+66:2218:x1858396225386880:12345-192.168.203.30@tcp:103:ldlm_bl_07.0 00010000:00010000:3.0:1772305924.910770:0:7104:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1772305924.910777:0:5493:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f7d7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x32b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efef expref: 66 pid: 54697 timeout: 1336 lvb_type: 0 00010000:00010000:3.0:1772305924.910778:0:7104:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6f7bb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x9/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efe8 expref: 66 pid: 54697 timeout: 1336 lvb_type: 0 00010000:00010000:2.0:1772305924.910792:0:6323:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f7ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eff6 expref: 66 pid: 54697 timeout: 1336 lvb_type: 0 00010000:00010000:3.0:1772305924.910811:0:7104:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6f7bb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efe8 expref: 65 pid: 54697 timeout: 1336 lvb_type: 0 00010000:00010000:1.0:1772305924.910825:0:5493:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32b:0x0].0x0 (000000000c14a94e) 00010000:00010000:1.0:1772305924.910830:0:5493:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: 000000003bb10b1c/0xa5e9c8c58c6f840 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305924.910840:0:5493:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1772305924.910851:0:6323:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f7ec lrc: 0/0,0 mode: --/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196eff6 expref: 65 pid: 54697 timeout: 1336 lvb_type: 0 00010000:00010000:3.0:1772305924.910856:0:7104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6f7bb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196efe8 expref: 65 pid: 54697 timeout: 1336 lvb_type: 0 00010000:00010000:2.0:1772305924.910871:0:6323:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32b:0x0].0x0 (000000000c14a94e) 00010000:00010000:2.0:1772305924.910877:0:6323:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: 000000003bb10b1c/0xa5e9c8c58c6f840 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305924.910878:0:5493:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001571dacd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+63:2216:x1858396225386752:12345-192.168.203.30@tcp:103:ldlm_bl_05.0 Request processed in 178us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305924.910895:0:5493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3116 00010000:00010000:2.0:1772305924.910896:0:6323:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 000000003bb10b1c/0xa5e9c8c58c6f840 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305924.910905:0:6323:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000003bb10b1c/0xa5e9c8c58c6f840 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305924.910914:0:7104:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32b:0x0].0x0 (000000000c14a94e) 00010000:00010000:3.0:1772305924.910919:0:7104:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1772305924.910931:0:6323:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1772305924.910946:0:7104:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000061fb05d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+62:2218:x1858396225386880:12345-192.168.203.30@tcp:103:ldlm_bl_07.0 Request processed in 204us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305924.910955:0:7104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3118 00000100:00100000:2.0:1772305924.910962:0:6323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ea1c5fa0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+62:2216:x1858396225386816:12345-192.168.203.30@tcp:103:ldlm_bl_04.0 Request processed in 241us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305924.910972:0:6323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3117 00010000:00010000:0.0:1772305924.911012:0:54697:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 000000003bb10b1c/0xa5e9c8c58c6f840 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.911020:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000003bb10b1c/0xa5e9c8c58c6f840 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1772305924.911121:0:54697:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xf:0x0].40, 136 off13632 00000100:00100000:0.0:1772305924.911161:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000af22ffe1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+60:99171:x1858396225386688:12345-192.168.203.30@tcp:58:cp.0 Request processed in 1976us (2063us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305924.911167:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1030 00000100:00100000:2.0:1772305924.911860:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305924.911890:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225386944 00000100:00100000:0.0:1772305924.911914:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1031 00000100:00100000:0.0:1772305924.911917:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001571dacd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+60:99171:x1858396225386944:12345-192.168.203.30@tcp:101:cp.0 00010000:00010000:0.0:1772305924.911925:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305924.911935:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c90074c9/0xa5e9c8c58c6f847 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f019 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.911962:0:54697:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 000000003bb10b1c/0xa5e9c8c58c6f840 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.911977:0:54697:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c90074c9/0xa5e9c8c58c6f847 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f019 expref: 61 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.911989:0:54697:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: 000000003bb10b1c/0xa5e9c8c58c6f840 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.912000:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000c90074c9/0xa5e9c8c58c6f847 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f019 expref: 61 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.912008:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32b:0x0].0x0 (000000000c14a94e) 00010000:00010000:0.0:1772305924.912010:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1772305924.912012:0:54697:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: 00000000c90074c9/0xa5e9c8c58c6f847 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f019 expref: 61 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305924.912016:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c90074c9, rc 0) 00000100:00100000:0.0:1772305924.912041:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001571dacd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+61:99171:x1858396225386944:12345-192.168.203.30@tcp:101:cp.0 Request processed in 123us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305924.912045:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1031 00000040:00080000:3.0:1772305925.256793:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305925.256800:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305925.256849:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 41 count 13 00000040:00080000:3.0:1772305925.256856:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:3.0:1772305925.256926:0:54732:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000004a705af pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:54732:1858396216606144:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1772305925.256995:0:54732:0:(client.c:2500:ptlrpc_set_wait()) set 0000000006410720 going to sleep for 6 seconds 00000100:00100000:3.0:1772305925.258173:0:54732:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000004a705af pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:54732:1858396216606144:192.168.203.30@tcp:107:hsm_cdtr.0 00000040:00080000:3.0:1772305925.258229:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305925.258232:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305925.258287:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 41 count 13 00000040:00080000:3.0:1772305925.258291:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:1.0:1772305925.258648:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305925.258705:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225387008 00000100:00100000:0.0:1772305925.258752:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1032 00000100:00100000:0.0:1772305925.258758:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d831f9af pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+73:99172:x1858396225387008:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1772305925.258787:0:54697:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x32b:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1772305925.258862:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d831f9af pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+73:99172:x1858396225387008:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 103us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305925.258870:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1032 00000100:00100000:2.0:1772305925.260001:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305925.260054:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225387072 00000100:00100000:0.0:1772305925.260088:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1033 00000100:00100000:0.0:1772305925.260094:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ea1c5fa0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+73:99172:x1858396225387072:12345-192.168.203.30@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1772305925.260141:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000007c4795ba/0xa5e9c8c58c6f84e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.260158:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007c4795ba/0xa5e9c8c58c6f84e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.260172:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007c4795ba/0xa5e9c8c58c6f84e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.260187:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000073b42f2f/0xa5e9c8c58c6f855 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x773d4bf9 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.260194:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000073b42f2f/0xa5e9c8c58c6f855 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x773d4bf9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.260200:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000073b42f2f/0xa5e9c8c58c6f855 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x773d4bf9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.260218:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000878a11a2/0xa5e9c8c58c6f85c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.260225:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000878a11a2/0xa5e9c8c58c6f85c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.260231:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000878a11a2/0xa5e9c8c58c6f85c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305925.260252:0:54697:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x32b:0x0]: returning size 1048576 00000004:00200000:0.0:1772305925.260256:0:54697:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1772305925.260266:0:54697:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000878a11a2/0xa5e9c8c58c6f85c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.260275:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000007c4795ba/0xa5e9c8c58c6f84e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.260281:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000007c4795ba/0xa5e9c8c58c6f84e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.260288:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000007c4795ba/0xa5e9c8c58c6f84e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.260294:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000007c4795ba already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305925.260297:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007c4795ba/0xa5e9c8c58c6f84e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.260304:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007c4795ba/0xa5e9c8c58c6f84e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.260315:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (00000000c78481f6) 00010000:00010000:0.0:1772305925.260318:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305925.260321:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000007c4795ba/0xa5e9c8c58c6f84e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.260327:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007c4795ba/0xa5e9c8c58c6f84e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.260339:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000073b42f2f/0xa5e9c8c58c6f855 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x773d4bf9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.260345:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000073b42f2f/0xa5e9c8c58c6f855 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x773d4bf9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.260351:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000073b42f2f/0xa5e9c8c58c6f855 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x773d4bf9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.260356:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000073b42f2f already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305925.260357:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000073b42f2f/0xa5e9c8c58c6f855 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x773d4bf9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.260363:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000073b42f2f/0xa5e9c8c58c6f855 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x773d4bf9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.260369:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x773d4bf9 (000000003892ce01) 00010000:00010000:0.0:1772305925.260371:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305925.260372:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000073b42f2f/0xa5e9c8c58c6f855 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x773d4bf9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.260377:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000073b42f2f/0xa5e9c8c58c6f855 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x773d4bf9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.260409:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000878a11a2/0xa5e9c8c58c6f85c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.260415:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000878a11a2/0xa5e9c8c58c6f85c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.260421:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000878a11a2/0xa5e9c8c58c6f85c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.260426:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000878a11a2 already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305925.260427:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000878a11a2/0xa5e9c8c58c6f85c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.260434:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000878a11a2/0xa5e9c8c58c6f85c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.260441:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32b:0x0].0x0 (000000000c14a94e) 00010000:00010000:0.0:1772305925.260444:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305925.260446:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000878a11a2/0xa5e9c8c58c6f85c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.260452:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000878a11a2/0xa5e9c8c58c6f85c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305925.260497:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ea1c5fa0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+73:99172:x1858396225387072:12345-192.168.203.30@tcp:34:lhsmtool_posix.0 Request processed in 402us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305925.260505:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1033 00000100:00100000:1.0:1772305925.261159:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305925.261203:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225387136 00000100:00100000:0.0:1772305925.261234:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1034 00000100:00100000:0.0:1772305925.261241:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e3d2d7c7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+73:99172:x1858396225387136:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1772305925.261257:0:54697:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x32b:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1772305925.261308:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e3d2d7c7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+73:99172:x1858396225387136:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 66us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305925.261315:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1034 00000100:00100000:1.0:1772305925.262398:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305925.262449:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225387264 00000100:00100000:0.0:1772305925.262495:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1035 00000100:00100000:0.0:1772305925.262501:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000db51b4fe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+73:99172:x1858396225387264:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1772305925.262511:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305925.262525:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f863 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f020 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.262890:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6f86a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x32c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.262899:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6f86a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x32c:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.262904:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6f86a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x32c:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305925.262910:0:54697:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x32c:0x0]: returning size 0 00010000:00010000:0.0:1772305925.262939:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f863 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f020 expref: 76 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.262950:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6f86a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x32c:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f020 expref: 75 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.262955:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32c:0x0].0x0 (000000005046deb8) 00010000:00010000:0.0:1772305925.262956:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1772305925.262958:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000034fec1fd, rc 0) 00000100:00100000:0.0:1772305925.262984:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000db51b4fe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+75:99172:x1858396225387264:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 483us (588us total) trans 8589934913 rc 0/0 00000100:00100000:0.0:1772305925.262989:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1035 00000100:00100000:2.0:1772305925.264063:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305925.264128:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225387392 00000100:00100000:0.0:1772305925.264157:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1036 00000100:00100000:0.0:1772305925.264162:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fb0c289e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+75:99172:x1858396225387392:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1772305925.264183:0:54697:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1772305925.264195:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6f86a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x32c:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f020 expref: 75 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.264205:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32c:0x0].0x0 (000000005046deb8) 00010000:00010000:0.0:1772305925.264209:0:54697:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1772305925.264220:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f878 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.264227:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f878 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.264232:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f878 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.264240:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f87f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xdbb0344d bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.264244:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f87f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdbb0344d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.264248:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f87f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdbb0344d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.264273:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f878 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.264277:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f878 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.264281:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f878 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.264284:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c7dfb548 already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305925.264286:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f878 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.264290:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f878 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.264295:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:0.0:1772305925.264296:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305925.264298:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f878 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.264301:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f878 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.264306:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f87f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdbb0344d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.264310:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f87f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdbb0344d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.264314:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f87f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdbb0344d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.264317:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000fd93d0b1 already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305925.264318:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f87f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdbb0344d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.264321:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f87f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdbb0344d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.264325:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdbb0344d (00000000a1075899) 00010000:00010000:0.0:1772305925.264327:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305925.264328:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f87f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xdbb0344d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.264331:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f87f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xdbb0344d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305925.264366:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fb0c289e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+74:99172:x1858396225387392:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 203us (310us total) trans 0 rc -2/-2 00000100:00100000:0.0:1772305925.264371:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1036 00000100:00100000:1.0:1772305925.265119:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305925.265184:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225387456 00000100:00100000:0.0:1772305925.265211:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1037 00000100:00100000:0.0:1772305925.265214:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f8a1bcf1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+74:99172:x1858396225387456:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1772305925.265221:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305925.265230:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f886 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x32c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f027 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.265245:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c6f88d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x32c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.265252:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c6f88d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.265257:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c6f88d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.265307:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f886 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x32c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f027 expref: 76 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.265320:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c6f88d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32c:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f027 expref: 75 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.265325:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32c:0x0].0x0 (00000000553f09f6) 00010000:00010000:0.0:1772305925.265327:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1772305925.265328:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000004820b6c, rc 0) 00000100:00100000:0.0:1772305925.265353:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f8a1bcf1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+75:99172:x1858396225387456:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 138us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305925.265358:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1037 00000100:00100000:1.0:1772305925.266099:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305925.266140:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225387584 00000100:00100000:0.0:1772305925.266167:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1038 00000100:00100000:0.0:1772305925.266171:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008608acb2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+75:99172:x1858396225387584:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1772305925.266204:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6f894 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x32c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.266212:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6f894 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.266218:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6f894 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1772305925.266295:0:54697:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000008608acb2 reply state 00000000e5b76b85 transno 8589934914 ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6f894 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305925.266341:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008608acb2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+77:99172:x1858396225387584:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 169us (245us total) trans 8589934914 rc 0/0 00000100:00100000:0.0:1772305925.266349:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1038 00010000:00010000:1.0:1772305925.266949:0:2977:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6f894 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305925.266958:0:2977:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6f894 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x32c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305925.266963:0:2977:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6f894 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x32c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305925.266971:0:2977:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000001e903b7f already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305925.266973:0:2977:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6f894 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x32c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305925.266977:0:2977:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6f894 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x32c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305925.266984:0:2977:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32c:0x0].0x0 (00000000553f09f6) 00010000:00010000:1.0:1772305925.266986:0:2977:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1772305925.266987:0:2977:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6f894 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x32c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305925.266991:0:2977:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6f894 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x32c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305925.267081:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305925.267113:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225387648 00000100:00100000:0.0:1772305925.267144:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1039 00000100:00100000:0.0:1772305925.267151:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005b0c5d35 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+76:99172:x1858396225387648:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1772305925.267162:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305925.267172:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f89b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x32c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f02e expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.267200:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f89b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x32c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f02e expref: 77 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.267208:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f89b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x32c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f02e expref: 77 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.267213:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32c:0x0].0x0 (00000000553f09f6) 00010000:00010000:0.0:1772305925.267215:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1772305925.267216:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a7782eea, rc 0) 00000100:00100000:0.0:1772305925.267240:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005b0c5d35 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+77:99172:x1858396225387648:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 90us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305925.267245:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1039 00000100:00100000:2.0:1772305925.267838:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305925.267873:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225387712 00000100:00100000:0.0:1772305925.267898:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 123 00000100:00100000:0.0:1772305925.267902:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d47ba4c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+77:99172:x1858396225387712:12345-192.168.203.30@tcp:49:lhsmtool_posix.0 00000100:00100000:0.0:1772305925.267945:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d47ba4c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+77:99172:x1858396225387712:12345-192.168.203.30@tcp:49:lhsmtool_posix.0 Request processed in 43us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305925.267954:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 123 00000100:00100000:1.0:1772305925.268675:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305925.268717:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225387840 00000100:00100000:2.0:1772305925.268742:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1040 00000100:00100000:2.0:1772305925.268745:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ba314d1a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+77:99172:x1858396225387840:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1772305925.268788:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ba314d1a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+77:99172:x1858396225387840:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 41us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305925.268793:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1040 00000100:00100000:1.0:1772305925.269716:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305925.269774:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225387968 00000100:00100000:2.0:1772305925.269805:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1041 00000100:00100000:2.0:1772305925.269811:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000339dc28b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+77:99172:x1858396225387968:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1772305925.269819:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305925.269829:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6f8a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f035 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.269870:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c6f8a9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x32c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.269879:0:54697:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f89b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x32c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f02e expref: 78 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.269884:0:54697:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c6f8a9 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x32c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.269911:0:54697:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f89b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x32c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f02e expref: 78 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.269919:0:54697:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f89b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x32c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f02e expref: 78 pid: 54697 timeout: 1337 lvb_type: 0 00000100:00100000:2.0:1772305925.269927:0:54697:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003b46920d pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:54697:1858396216606208:192.168.203.30@tcp:104: 00000100:00100000:2.0:1772305925.269964:0:54697:0:(client.c:2500:ptlrpc_set_wait()) set 00000000a8afa38e going to sleep for 6 seconds 00000100:00100000:2.0:1772305925.270648:0:54697:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003b46920d pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:54697:1858396216606208:192.168.203.30@tcp:104: 00010000:00010000:2.0:1772305925.270663:0:54697:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c6f8a9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x32c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305925.270807:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305925.270840:0:6323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225388032 00010000:00010000:2.0:1772305925.270859:0:6323:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f89b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x32c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f02e expref: 79 pid: 54697 timeout: 1337 lvb_type: 0 00000100:00100000:2.0:1772305925.270878:0:6323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3119 00000100:00100000:2.0:1772305925.270882:0:6323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b29332f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+79:2216:x1858396225388032:12345-192.168.203.30@tcp:103:ldlm_bl_08.0 00010000:00010000:2.0:1772305925.270888:0:6323:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1772305925.270893:0:6323:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f89b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x32c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f02e expref: 79 pid: 54697 timeout: 1337 lvb_type: 0 00010000:00010000:2.0:1772305925.270900:0:6323:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f89b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x32c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f02e expref: 79 pid: 54697 timeout: 1337 lvb_type: 0 00010000:00010000:2.0:1772305925.270911:0:6323:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f89b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x32c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f02e expref: 79 pid: 54697 timeout: 1337 lvb_type: 0 00010000:00010000:2.0:1772305925.270920:0:6323:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32c:0x0].0x0 (00000000553f09f6) 00010000:00010000:2.0:1772305925.270923:0:6323:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c6f8a9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x32c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.270929:0:6323:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c6f8a9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.270933:0:6323:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c6f8a9 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x32c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.270952:0:6323:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1772305925.270974:0:6323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b29332f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+78:2216:x1858396225388032:12345-192.168.203.30@tcp:103:ldlm_bl_08.0 Request processed in 91us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305925.270979:0:6323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3119 00010000:00010000:0.0:1772305925.270988:0:54697:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c6f8a9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.271000:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c6f8a9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305925.271014:0:54697:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x32c:0x0]: returning size 0 00000004:00080000:0.0:1772305925.271142:0:54697:0:(osp_object.c:1645:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x100000000:0x1b0:0x0], index 0: 0 00010000:00010000:0.0:1772305925.271266:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c6f8a9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.271275:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c6f8a9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x32c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.271281:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c6f8a9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x32c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.271287:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000004e3177f5 already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305925.271289:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c6f8a9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x32c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.271296:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c6f8a9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x32c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.271305:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32c:0x0].0x0 (00000000553f09f6) 00010000:00010000:0.0:1772305925.271308:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1772305925.271310:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c6f8a9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x32c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.271320:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c6f8a9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x32c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.271345:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6f8a2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f035 expref: 78 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.271354:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6f8a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f035 expref: 78 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.271362:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010dea6ba, rc 0) 00000100:00100000:0.0:1772305925.271407:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000339dc28b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+77:99172:x1858396225387968:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 1594us (1690us total) trans 8589934915 rc 301/301 00000100:00100000:0.0:1772305925.271414:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1041 00000100:00100000:1.0:1772305925.272359:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305925.272411:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225388160 00000100:00100000:0.0:1772305925.272441:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 124 00000100:00100000:0.0:1772305925.272448:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008066f4bf pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+77:99172:x1858396225388160:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1772305925.272622:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008066f4bf pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+78:99172:x1858396225388160:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 173us (265us total) trans 8589934916 rc 0/0 00000100:00100000:0.0:1772305925.272662:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 124 00000100:00100000:1.0:1772305925.273400:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305925.273440:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225388224 00000100:00100000:0.0:1772305925.273463:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1042 00000100:00100000:0.0:1772305925.273467:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004ca53634 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+78:99172:x1858396225388224:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1772305925.273476:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305925.273484:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f8b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f03c expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.273517:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f8be lrc: 3/1,0 mode: --/PR res: [0x200000402:0x32c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.273524:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f8be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.273530:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f8be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305925.273544:0:54697:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x32c:0x0]: returning size 0 00000004:00200000:0.0:1772305925.273547:0:54697:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1772305925.273554:0:54697:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f8be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.273560:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f8be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.273571:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f8b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f03c expref: 80 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.273579:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f8be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f03c expref: 79 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.273584:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32c:0x0].0x0 (00000000553f09f6) 00010000:00010000:0.0:1772305925.273586:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1772305925.273587:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c7dfb548, rc 0) 00000100:00100000:0.0:1772305925.273611:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004ca53634 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+79:99172:x1858396225388224:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 143us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305925.273615:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1042 00000100:00100000:1.0:1772305925.274588:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305925.274642:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225388288 00000100:00100000:0.0:1772305925.274674:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5736 00000100:00100000:0.0:1772305925.274678:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ab80ba74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+226:2215:x1858396225388288:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1772305925.274685:0:21400:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305925.274696:0:21400:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6f8c5 lrc: 2/0,0 mode: --/PR res: [0x1b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f043 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1772305925.274711:0:21400:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x1b0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1772305925.274720:0:21400:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305925.274722:0:21400:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305925.274727:0:21400:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6f8c5 lrc: 3/0,0 mode: PR/PR res: [0x1b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f043 expref: 227 pid: 21400 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1772305925.274736:0:21400:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6f8c5 lrc: 3/0,0 mode: PR/PR res: [0x1b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f043 expref: 227 pid: 21400 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1772305925.274743:0:21400:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000034fec1fd, rc 0) 00000100:00100000:0.0:1772305925.274765:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ab80ba74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2215:x1858396225388288:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 86us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305925.274769:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5736 00000100:00100000:1.0:1772305925.275516:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305925.275550:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225388416 00000100:00100000:0.0:1772305925.275572:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1043 00000100:00100000:0.0:1772305925.275575:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000010235c68 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+79:99172:x1858396225388416:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1772305925.275612:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000010235c68 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+79:99172:x1858396225388416:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 36us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305925.275617:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1043 00000100:00100000:1.0:1772305925.278866:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305925.278901:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225388480 00000100:00100000:0.0:1772305925.278937:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5737 00000100:00100000:0.0:1772305925.278942:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a28db514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:99172:x1858396225388480:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1772305925.278951:0:21400:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305925.278964:0:21400:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f8cc lrc: 2/0,0 mode: --/PW res: [0x1b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f04a expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.278983:0:21400:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6f8c5 lrc: 2/0,0 mode: PR/PR res: [0x1b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f043 expref: 228 pid: 21400 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1772305925.278989:0:21400:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305925.278991:0:21400:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305925.278993:0:21400:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f8cc lrc: 4/0,0 mode: --/PW res: [0x1b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f04a expref: 228 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.279013:0:21400:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6f8c5 lrc: 3/0,0 mode: PR/PR res: [0x1b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f043 expref: 228 pid: 21400 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1772305925.279021:0:21400:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6f8c5 lrc: 4/0,0 mode: PR/PR res: [0x1b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f043 expref: 228 pid: 21400 timeout: 1337 lvb_type: 1 00000100:00100000:0.0:1772305925.279029:0:21400:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003084e0c8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:21400:1858396216606272:192.168.203.30@tcp:104: 00000100:00100000:0.0:1772305925.279070:0:21400:0:(client.c:2500:ptlrpc_set_wait()) set 000000007630f830 going to sleep for 6 seconds 00000100:00100000:0.0:1772305925.279925:0:21400:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003084e0c8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:21400:1858396216606272:192.168.203.30@tcp:104: 00010000:00010000:0.0:1772305925.279947:0:21400:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f8cc lrc: 3/0,0 mode: --/PW res: [0x1b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f04a expref: 228 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.279966:0:21400:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079ce3603, rc 0) 00000100:00100000:0.0:1772305925.280000:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a28db514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+228:99172:x1858396225388480:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 1055us (1136us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305925.280009:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5737 00000100:00100000:1.0:1772305925.280079:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305925.280124:0:6323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225388544 00010000:00010000:2.0:1772305925.280154:0:6323:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6f8c5 lrc: 4/0,0 mode: PR/PR res: [0x1b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f043 expref: 228 pid: 21400 timeout: 1337 lvb_type: 1 00000100:00100000:2.0:1772305925.280187:0:6323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3120 00000100:00100000:2.0:1772305925.280193:0:6323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c230ed64 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+228:2216:x1858396225388544:12345-192.168.203.30@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1772305925.280203:0:6323:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1772305925.280222:0:6323:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6f8c5 lrc: 4/0,0 mode: PR/PR res: [0x1b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f043 expref: 228 pid: 21400 timeout: 1337 lvb_type: 1 00010000:00010000:2.0:1772305925.280234:0:6323:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6f8c5 lrc: 3/0,0 mode: PR/PR res: [0x1b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f043 expref: 228 pid: 21400 timeout: 1337 lvb_type: 1 00010000:00010000:2.0:1772305925.280259:0:6323:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6f8c5 lrc: 0/0,0 mode: --/PR res: [0x1b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f043 expref: 228 pid: 21400 timeout: 1337 lvb_type: 1 00010000:00010000:2.0:1772305925.280271:0:6323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1772305925.280273:0:6323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1772305925.280278:0:6323:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f8cc lrc: 2/0,0 mode: PW/PW res: [0x1b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f04a expref: 227 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.280287:0:6323:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f8cc lrc: 3/0,0 mode: PW/PW res: [0x1b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f04a expref: 227 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.280312:0:6323:0:(ldlm_lockd.c:1069:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f8cc lrc: 3/0,0 mode: PW/PW res: [0x1b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f04a expref: 227 pid: 21400 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305925.280323:0:6323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003b46920d pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6323:1858396216606336:192.168.203.30@tcp:105: 00000100:00100000:2.0:1772305925.280364:0:6323:0:(client.c:2500:ptlrpc_set_wait()) set 00000000a8afa38e going to sleep for 6 seconds 00000100:00100000:2.0:1772305925.281214:0:6323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003b46920d pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6323:1858396216606336:192.168.203.30@tcp:105: 00010000:00010000:2.0:1772305925.281227:0:6323:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1772305925.281257:0:6323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c230ed64 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2216:x1858396225388544:12345-192.168.203.30@tcp:103:ldlm_bl_03.0 Request processed in 1063us (1178us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305925.281266:0:6323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3120 00000100:00100000:1.0:1772305925.288987:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305925.289049:0:21399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225388672 00002000:00100000:0.0:1772305925.289093:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1b0:0x0] (0->1048575) req@000000001770c2e6 x1858396225388672/t0(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:56/0 lens 488/0 e 0 to 0 dl 1772305931 ref 1 fl New:/0/ffffffff rc 0/-1 job:'lhsmtool_posix.0' 00002000:00100000:0.0:1772305925.289105:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 000000001770c2e6 with x1858396225388672 ext(0->1048575) 00002000:00010000:0.0:1772305925.289110:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000001770c2e6 00000100:00100000:0.0:1772305925.289147:0:21399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2045 00000100:00100000:0.0:1772305925.289155:0:21399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001770c2e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2215:x1858396225388672:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1772305925.297157:0:21399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001770c2e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+229:2215:x1858396225388672:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 Request processed in 7997us (8172us total) trans 4294968309 rc 0/0 00000100:00100000:0.0:1772305925.297170:0:21399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2045 00002000:00100000:0.0:1772305925.297181:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1b0:0x0] (0->1048575) req@000000001770c2e6 x1858396225388672/t4294968309(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:56/0 lens 488/448 e 0 to 0 dl 1772305931 ref 1 fl Complete:/0/0 rc 0/0 job:'lhsmtool_posix.0' 00002000:00100000:0.0:1772305925.297189:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 000000001770c2e6 with x1858396225388672 ext(0->1048575) 00002000:00010000:0.0:1772305925.297194:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000001770c2e6 00000100:00100000:1.0:1772305925.298398:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305925.298499:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225388736 00000100:00100000:0.0:1772305925.298541:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1044 00000100:00100000:0.0:1772305925.298547:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006f4c803f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+79:99172:x1858396225388736:12345-192.168.203.30@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1772305925.311094:0:70221:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934916 is committed 00000001:00080000:3.0:1772305925.311137:0:70221:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934912 is committed 00000004:00080000:2.0:1772305925.311213:0:54724:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 10 committed 00000100:00100000:0.0:1772305925.311213:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006f4c803f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+73:99172:x1858396225388736:12345-192.168.203.30@tcp:44:lhsmtool_posix.0 Request processed in 12660us (12824us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305925.311230:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1044 00000020:00080000:2.0:1772305925.311238:0:54724:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt 000000000a383495 refcount 2 committed 0 result 0 batchid 4295052954 00000020:00080000:2.0:1772305925.311243:0:54724:0:(update_trans.c:89:top_multiple_thandle_dump()) st 00000000b3cf0a33 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th 00000000ed3cf40f 00000020:00080000:2.0:1772305925.311245:0:54724:0:(update_trans.c:89:top_multiple_thandle_dump()) st 000000000ecf825f obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th 00000000621eef43 00000020:00080000:2.0:1772305925.311352:0:54735:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4295052954 committed batchid 4295052953 00000100:00100000:3.0:1772305925.311454:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003b46920d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216606400:0@lo:6:osp-syn-0-0.0 00000020:00080000:2.0:1772305925.311459:0:54735:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4295052953 00000100:00100000:3.0:1772305925.311504:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772305925.311575:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216606400 00000100:00100000:0.0:1772305925.311619:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5738 00000100:00100000:0.0:1772305925.311624:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000004a705af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:2993:x1858396216606400:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1772305925.311666:0:21400:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:431 count 1 00002000:00010000:0.0:1772305925.311699:0:21400:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x1af:0x0] initial LVB size: 1048576, mtime: 0x69a33e03, atime: 0x0, ctime: 0x69a33e03, blocks: 0x1 00010000:00010000:0.0:1772305925.311706:0:21400:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f8d3 lrc: 3/0,1 mode: --/PW res: [0x1af:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.311720:0:21400:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305925.311722:0:21400:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305925.311726:0:21400:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f8d3 lrc: 3/0,1 mode: PW/PW res: [0x1af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.311740:0:21400:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f8d3 lrc: 3/0,1 mode: PW/PW res: [0x1af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.311747:0:21400:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f8d3 lrc: 3/0,1 mode: PW/PW res: [0x1af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.311753:0:21400:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f8d3 lrc: 2/0,0 mode: PW/PW res: [0x1af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.311770:0:21400:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1772305925.311784:0:5496:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1772305925.311790:0:5496:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f8d3 lrc: 2/0,0 mode: PW/PW res: [0x1af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.311799:0:5496:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000fd93d0b1 already unused, calling callback (00000000b5e4f3c0) 00010000:00010000:2.0:1772305925.311802:0:5496:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f8d3 lrc: 2/0,0 mode: PW/PW res: [0x1af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.311809:0:5496:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f8d3 lrc: 3/0,0 mode: PW/PW res: [0x1af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.311825:0:5496:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f8d3 lrc: 1/0,0 mode: --/PW res: [0x1af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.311829:0:5496:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f8d3 lrc: 0/0,0 mode: --/PW res: [0x1af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.311845:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1772305925.311846:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1772305925.311847:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1772305925.312045:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000004a705af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:2993:x1858396216606400:12345-0@lo:6:osp-syn-0-0.0 Request processed in 419us (542us total) trans 4294968310 rc 0/0 00000100:00100000:0.0:1772305925.312054:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5738 00000004:00080000:3.0:1772305925.312082:0:2993:0:(osp_sync.c:563:osp_sync_interpret()) reply req 000000003b46920d/2, rc 0, transno 1014 00000100:00100000:3.0:1772305925.312088:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003b46920d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216606400:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1772305925.312715:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305925.312755:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225388800 00000100:00100000:0.0:1772305925.312784:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5739 00000100:00100000:0.0:1772305925.312788:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000084e1bde0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+229:2216:x1858396225388800:12345-192.168.203.30@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1772305925.322101:0:6332:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-OST0000: transno 4294968310 is committed 00000001:00080000:1.0:1772305925.322112:0:6332:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-OST0000: transno 4294968309 is committed 00000100:00100000:0.0:1772305925.322175:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000084e1bde0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+225:2216:x1858396225388800:12345-192.168.203.30@tcp:16:lhsmtool_posix.0 Request processed in 9380us (9458us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305925.322189:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5739 00000100:00100000:1.0:1772305925.323414:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305925.323480:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225388928 00000100:00100000:0.0:1772305925.323521:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1045 00000100:00100000:0.0:1772305925.323529:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d6661384 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+68:99172:x1858396225388928:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1772305925.323576:0:54697:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1772305925.323599:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f8be lrc: 0/0,0 mode: --/PR res: [0x200000402:0x32c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f03c expref: 68 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.323618:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32c:0x0].0x0 (00000000553f09f6) 00010000:00010000:0.0:1772305925.323623:0:54697:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1772305925.323682:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f8da lrc: 3/0,1 mode: --/PW res: [0x200000402:0x32c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.323697:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f8da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.323709:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f8da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.323728:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f8da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.323735:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f8da lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x32c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.323743:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f8da lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x32c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.323749:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000082c88ffe already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305925.323753:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f8da lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x32c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.323760:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f8da lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x32c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.323768:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32c:0x0].0x0 (00000000553f09f6) 00010000:00010000:0.0:1772305925.323771:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305925.323773:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f8da lrc: 2/0,0 mode: --/PW res: [0x200000402:0x32c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.323779:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f8da lrc: 0/0,0 mode: --/PW res: [0x200000402:0x32c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305925.323847:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d6661384 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+67:99172:x1858396225388928:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 318us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305925.323854:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1045 00000100:00100000:1.0:1772305925.324537:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305925.324576:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225388992 00000100:00100000:0.0:1772305925.324609:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1046 00000100:00100000:0.0:1772305925.324656:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003397d536 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+67:99172:x1858396225388992:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1772305925.324668:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305925.324679:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f8e1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x32c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f051 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.324715:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f8e1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x32c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f051 expref: 68 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.324726:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f8e1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x32c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f051 expref: 68 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.324741:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32c:0x0].0x0 (00000000553f09f6) 00010000:00010000:0.0:1772305925.324743:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1772305925.324746:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006e08f961, rc 0) 00000100:00100000:0.0:1772305925.324773:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003397d536 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+68:99172:x1858396225388992:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 150us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305925.324780:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1046 00000100:00100000:1.0:1772305925.325645:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305925.325692:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225389056 00000100:00100000:0.0:1772305925.325721:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5740 00000100:00100000:0.0:1772305925.325727:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000043720844 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+225:2216:x1858396225389056:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1772305925.325906:0:21400:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x1b0:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:0.0:1772305925.325909:0:21400:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x1b0:0x0] updating lvb mtime from disk: 0 -> 1772305923 00002000:00010000:0.0:1772305925.325911:0:21400:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x1b0:0x0] updating lvb atime from disk: 0 -> 1772305923 00002000:00010000:0.0:1772305925.325913:0:21400:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x1b0:0x0] updating lvb ctime from disk: 0 -> 1772305923 00002000:00010000:0.0:1772305925.325915:0:21400:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x1b0:0x0] updating lvb blocks from disk: 1 -> 2051 00000100:00100000:0.0:1772305925.325950:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000043720844 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+226:2216:x1858396225389056:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 Request processed in 223us (305us total) trans 4294968311 rc 0/0 00000100:00100000:0.0:1772305925.325958:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5740 00000100:00100000:1.0:1772305925.327493:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305925.327540:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225389184 00000100:00100000:0.0:1772305925.327574:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1047 00000100:00100000:0.0:1772305925.327580:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000038ede71c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+68:99172:x1858396225389184:12345-192.168.203.30@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1772305925.327608:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f8e8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x32c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.327621:0:54697:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c6f88d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x32c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f027 expref: 68 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.327643:0:54697:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f8e8 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x32c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.327669:0:54697:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c6f88d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f027 expref: 68 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.327680:0:54697:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c6f88d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x32c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f027 expref: 68 pid: 54697 timeout: 1337 lvb_type: 0 00000100:00100000:0.0:1772305925.327690:0:54697:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003084e0c8 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:54697:1858396216606464:192.168.203.30@tcp:104: 00000100:00100000:0.0:1772305925.327731:0:54697:0:(client.c:2500:ptlrpc_set_wait()) set 000000007630f830 going to sleep for 6 seconds 00000100:00100000:0.0:1772305925.328558:0:54697:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003084e0c8 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:54697:1858396216606464:192.168.203.30@tcp:104: 00010000:00010000:0.0:1772305925.328574:0:54697:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f8e8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x32c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305925.328707:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305925.328757:0:6323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225389248 00010000:00010000:2.0:1772305925.328773:0:6323:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c6f88d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x32c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f027 expref: 69 pid: 54697 timeout: 1337 lvb_type: 0 00000100:00100000:2.0:1772305925.328792:0:6323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3121 00000100:00100000:2.0:1772305925.328795:0:6323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000747b88e1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:2215:x1858396225389248:12345-192.168.203.30@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1772305925.328804:0:6323:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1772305925.328808:0:6323:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c6f88d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x32c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f027 expref: 69 pid: 54697 timeout: 1337 lvb_type: 0 00010000:00010000:2.0:1772305925.328815:0:6323:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c6f88d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f027 expref: 69 pid: 54697 timeout: 1337 lvb_type: 0 00010000:00010000:2.0:1772305925.328825:0:6323:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c6f88d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x32c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f027 expref: 69 pid: 54697 timeout: 1337 lvb_type: 0 00010000:00010000:2.0:1772305925.328834:0:6323:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32c:0x0].0x0 (00000000553f09f6) 00010000:00010000:2.0:1772305925.328836:0:6323:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f8e8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x32c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.328842:0:6323:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f8e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.328846:0:6323:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f8e8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x32c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.328864:0:6323:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1772305925.328893:0:6323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000747b88e1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+68:2215:x1858396225389248:12345-192.168.203.30@tcp:103:ldlm_bl_02.0 Request processed in 97us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305925.328899:0:6323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3121 00010000:00010000:0.0:1772305925.328899:0:54697:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f8e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.328916:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f8e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.328939:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f8e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.328946:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f8e8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x32c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.328953:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f8e8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x32c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.328959:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000f7a426e already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305925.328962:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f8e8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x32c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.328969:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f8e8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x32c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.328989:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32c:0x0].0x0 (00000000553f09f6) 00010000:00010000:0.0:1772305925.328992:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1772305925.328996:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f8e8 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x32c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.329002:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f8e8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x32c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305925.329048:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000038ede71c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+67:99172:x1858396225389184:12345-192.168.203.30@tcp:55:lhsmtool_posix.0 Request processed in 1466us (1554us total) trans 0 rc -22/-22 00000100:00100000:0.0:1772305925.329058:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1047 00000100:00100000:1.0:1772305925.329786:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305925.329825:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225389312 00000100:00100000:0.0:1772305925.329858:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5741 00000100:00100000:0.0:1772305925.329864:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ae1f1e77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+226:2215:x1858396225389312:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1772305925.329892:0:21400:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f8ef lrc: 3/1,0 mode: --/PR res: [0x1b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.329906:0:21400:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f8cc lrc: 2/0,0 mode: PW/PW res: [0x1b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f04a expref: 226 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.329915:0:21400:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1772305925.329917:0:21400:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1772305925.329919:0:21400:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f8ef lrc: 4/1,0 mode: --/PR res: [0x1b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.329938:0:21400:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f8cc lrc: 3/0,0 mode: PW/PW res: [0x1b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f04a expref: 226 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.329949:0:21400:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f8cc lrc: 4/0,0 mode: PW/PW res: [0x1b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f04a expref: 226 pid: 21400 timeout: 1337 lvb_type: 0 00000100:00100000:0.0:1772305925.329964:0:21400:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003084e0c8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:21400:1858396216606528:192.168.203.30@tcp:104: 00000100:00100000:0.0:1772305925.330014:0:21400:0:(client.c:2500:ptlrpc_set_wait()) set 000000007630f830 going to sleep for 6 seconds 00000100:00100000:0.0:1772305925.330842:0:21400:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003084e0c8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:21400:1858396216606528:192.168.203.30@tcp:104: 00010000:00010000:0.0:1772305925.330855:0:21400:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f8ef lrc: 3/1,0 mode: --/PR res: [0x1b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305925.332138:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305925.332187:0:6323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225389376 00010000:00010000:2.0:1772305925.332206:0:6323:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f8cc lrc: 4/0,0 mode: PW/PW res: [0x1b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f04a expref: 227 pid: 21400 timeout: 1337 lvb_type: 0 00000100:00100000:2.0:1772305925.332227:0:6323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3122 00000100:00100000:2.0:1772305925.332232:0:6323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a870219c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2215:x1858396225389376:12345-192.168.203.30@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1772305925.332239:0:6323:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1772305925.332253:0:6323:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f8cc lrc: 4/0,0 mode: PW/PW res: [0x1b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f04a expref: 227 pid: 21400 timeout: 1337 lvb_type: 0 00010000:00010000:2.0:1772305925.332261:0:6323:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f8cc lrc: 3/0,0 mode: PW/PW res: [0x1b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f04a expref: 227 pid: 21400 timeout: 1337 lvb_type: 0 00010000:00010000:2.0:1772305925.332277:0:6323:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f8cc lrc: 0/0,0 mode: --/PW res: [0x1b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f04a expref: 227 pid: 21400 timeout: 1337 lvb_type: 0 00010000:00010000:2.0:1772305925.332286:0:6323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1772305925.332287:0:6323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1772305925.332289:0:6323:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f8ef lrc: 3/1,0 mode: PR/PR res: [0x1b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.332295:0:6323:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f8ef lrc: 4/1,0 mode: PR/PR res: [0x1b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.332311:0:6323:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1772305925.332337:0:6323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a870219c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+226:2215:x1858396225389376:12345-192.168.203.30@tcp:103:ldlm_bl_01.0 Request processed in 104us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305925.332342:0:6323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3122 00010000:00010000:0.0:1772305925.332344:0:21400:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f8ef lrc: 3/1,0 mode: PR/PR res: [0x1b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.332361:0:21400:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f8ef lrc: 3/1,0 mode: PR/PR res: [0x1b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.332381:0:21400:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f8ef lrc: 3/1,0 mode: PR/PR res: [0x1b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.332402:0:21400:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f8ef lrc: 2/0,0 mode: PR/PR res: [0x1b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.332420:0:21400:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1772305925.332450:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ae1f1e77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+225:2215:x1858396225389312:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 Request processed in 2586us (2666us total) trans 0 rc 0/0 00010000:00010000:3.0:1772305925.332453:0:38581:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1772305925.332458:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5741 00010000:00010000:3.0:1772305925.332461:0:38581:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f8ef lrc: 2/0,0 mode: PR/PR res: [0x1b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305925.332539:0:38581:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c7dfb548 already unused, calling callback (00000000b5e4f3c0) 00010000:00010000:3.0:1772305925.332543:0:38581:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f8ef lrc: 2/0,0 mode: PR/PR res: [0x1b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305925.332551:0:38581:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f8ef lrc: 3/0,0 mode: PR/PR res: [0x1b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305925.332604:0:38581:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f8ef lrc: 1/0,0 mode: --/PR res: [0x1b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305925.332613:0:38581:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f8ef lrc: 0/0,0 mode: --/PR res: [0x1b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305925.332656:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1772305925.332658:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1772305925.332661:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772305925.333031:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305925.333065:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225389504 00000100:00100000:0.0:1772305925.333090:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1048 00000100:00100000:0.0:1772305925.333094:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000080e4cc77 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+67:99172:x1858396225389504:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1772305925.333303:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f8f6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x32c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.333317:0:54697:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f8e1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x32c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f051 expref: 68 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.333324:0:54697:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f8f6 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x32c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.333343:0:54697:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f8e1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x32c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f051 expref: 68 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.333353:0:54697:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f8e1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x32c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f051 expref: 68 pid: 54697 timeout: 1337 lvb_type: 0 00000100:00100000:0.0:1772305925.333362:0:54697:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003084e0c8 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:54697:1858396216606592:192.168.203.30@tcp:104: 00000100:00100000:0.0:1772305925.333412:0:54697:0:(client.c:2500:ptlrpc_set_wait()) set 000000008422c11e going to sleep for 6 seconds 00000100:00100000:0.0:1772305925.334125:0:54697:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003084e0c8 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:54697:1858396216606592:192.168.203.30@tcp:104: 00010000:00010000:0.0:1772305925.334139:0:54697:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f8f6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x32c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305925.334301:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305925.334341:0:6323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225389568 00010000:00010000:2.0:1772305925.334356:0:6323:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f8e1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x32c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f051 expref: 69 pid: 54697 timeout: 1337 lvb_type: 0 00000100:00100000:2.0:1772305925.334378:0:6323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3123 00000100:00100000:2.0:1772305925.334396:0:6323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f237ebcd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:2216:x1858396225389568:12345-192.168.203.30@tcp:103:ldlm_bl_04.0 00010000:00010000:2.0:1772305925.334404:0:6323:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1772305925.334408:0:6323:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f8e1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x32c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f051 expref: 69 pid: 54697 timeout: 1337 lvb_type: 0 00010000:00010000:2.0:1772305925.334416:0:6323:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f8e1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x32c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f051 expref: 69 pid: 54697 timeout: 1337 lvb_type: 0 00010000:00010000:2.0:1772305925.334426:0:6323:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f8e1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x32c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f051 expref: 69 pid: 54697 timeout: 1337 lvb_type: 0 00010000:00010000:2.0:1772305925.334437:0:6323:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32c:0x0].0x0 (00000000553f09f6) 00010000:00010000:2.0:1772305925.334440:0:6323:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f8f6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x32c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.334447:0:6323:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f8f6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.334453:0:6323:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f8f6 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x32c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.334477:0:6323:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1772305925.334500:0:54697:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f8f6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305925.334510:0:6323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f237ebcd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+68:2216:x1858396225389568:12345-192.168.203.30@tcp:103:ldlm_bl_04.0 Request processed in 124us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305925.334517:0:6323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3123 00010000:00010000:0.0:1772305925.334519:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f8f6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1772305925.334624:0:54697:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934917 00000001:00080000:0.0:1772305925.334769:0:54697:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934917 00000001:00080000:0.0:1772305925.334805:0:54697:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934917 00000100:00100000:0.0:1772305925.334859:0:54697:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003084e0c8 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:54697:1858396216606656:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1772305925.334894:0:54697:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772305925.334915:0:54697:0:(client.c:2500:ptlrpc_set_wait()) set 000000004b452d21 going to sleep for 6 seconds 00000100:00100000:2.0:1772305925.334932:0:57220:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216606656 00000100:00100000:2.0:1772305925.334960:0:57220:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1772305925.334964:0:57220:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000756cf3a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:54697:x1858396216606656:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1772305925.335014:0:57220:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000756cf3a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:54697:x1858396216606656:12345-0@lo:1000:mdt00_001.0 Request processed in 50us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305925.335019:0:57220:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1772305925.335041:0:54697:0:(client.c:2868:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968310 gen 2 00000004:00080000:0.0:1772305925.335048:0:54697:0:(osp_trans.c:1044:osp_request_commit_cb()) trans no 4294968308 committed transno 4294968310 00000004:00080000:0.0:1772305925.335065:0:54697:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 000000003b46920d, transno 4294968310 00000100:00100000:0.0:1772305925.335080:0:54697:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003084e0c8 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:54697:1858396216606656:0@lo:1000:mdt00_001.0 00000040:00100000:2.0:1772305925.335100:0:54719:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 10 in log [0xb:0x1:0x0] 00000001:00080000:0.0:1772305925.335244:0:54697:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934917 00000100:00100000:0.0:1772305925.335268:0:54697:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003084e0c8 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:54697:1858396216606720:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1772305925.335286:0:54697:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772305925.335300:0:54697:0:(client.c:2500:ptlrpc_set_wait()) set 000000008422c11e going to sleep for 6 seconds 00000100:00100000:2.0:1772305925.335314:0:57220:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216606720 00000100:00100000:2.0:1772305925.335335:0:57220:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1772305925.335339:0:57220:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000774de3b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:54697:x1858396216606720:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1772305925.335460:0:57220:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000774de3b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:54697:x1858396216606720:12345-0@lo:1000:mdt00_001.0 Request processed in 119us (171us total) trans 4294968312 rc 0/0 00000100:00100000:2.0:1772305925.335469:0:57220:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1772305925.335480:0:54697:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003084e0c8 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:54697:1858396216606720:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1772305925.335523:0:54697:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934917 00010000:00010000:0.0:1772305925.335530:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f8f6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.335536:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f8f6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x32c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.335540:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f8f6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x32c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.335543:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000082c88ffe already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305925.335545:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f8f6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x32c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.335549:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f8f6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x32c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.335555:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32c:0x0].0x0 (00000000553f09f6) 00010000:00010000:0.0:1772305925.335557:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1772305925.335558:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f8f6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x32c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.335562:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f8f6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x32c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.335575:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000003bb10b1c/0xa5e9c8c58c6f840 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.335580:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000003bb10b1c/0xa5e9c8c58c6f840 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.335584:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000003bb10b1c/0xa5e9c8c58c6f840 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.335587:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000003bb10b1c already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305925.335588:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000003bb10b1c/0xa5e9c8c58c6f840 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.335591:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000003bb10b1c/0xa5e9c8c58c6f840 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000020 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.335595:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32b:0x0].0x0 (000000000c14a94e) 00010000:00010000:0.0:1772305925.335597:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1772305925.335599:0:54697:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: 00000000c90074c9/0xa5e9c8c58c6f847 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f019 expref: 53 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.335604:0:54697:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000c90074c9/0xa5e9c8c58c6f847 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f019 expref: 53 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.335608:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c90074c9/0xa5e9c8c58c6f847 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f019 expref: 53 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.335622:0:54697:0:(ldlm_lockd.c:1069:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: 00000000c90074c9/0xa5e9c8c58c6f847 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f019 expref: 53 pid: 54697 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305925.335648:0:54697:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cc0879e3 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:54697:1858396216606784:192.168.203.30@tcp:105: 00000100:00100000:0.0:1772305925.335677:0:54697:0:(client.c:2500:ptlrpc_set_wait()) set 0000000041fdb5c3 going to sleep for 6 seconds 00000100:00100000:0.0:1772305925.336536:0:54697:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cc0879e3 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:54697:1858396216606784:192.168.203.30@tcp:105: 00010000:00010000:0.0:1772305925.336548:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000003bb10b1c/0xa5e9c8c58c6f840 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.336553:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000003bb10b1c/0xa5e9c8c58c6f840 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.336569:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6f8fd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.336576:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6f8fd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.336581:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6f8fd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.336586:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6f8fd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.336590:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6f8fd lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.336594:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6f8fd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.336598:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000870ce7f2 already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305925.336599:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6f8fd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.336606:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6f8fd lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.336611:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32b:0x0].0x0 (000000000c14a94e) 00010000:00010000:0.0:1772305925.336613:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305925.336614:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6f8fd lrc: 2/0,0 mode: --/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.336617:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6f8fd lrc: 0/0,0 mode: --/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305925.336695:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000040:00080000:0.0:1772305925.336708:0:54697:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772305925.336712:0:54697:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000100:00100000:2.0:1772305925.336740:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225389632 00000040:00080000:0.0:1772305925.336779:0:54697:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 41 count 13 00000100:00100000:2.0:1772305925.336785:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 125 00000040:00080000:0.0:1772305925.336788:0:54697:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:2.0:1772305925.336794:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000024ecc70c pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+54:99171:x1858396225389632:12345-192.168.203.30@tcp:49:cp.0 00000100:00100000:0.0:1772305925.336839:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000080e4cc77 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+67:99172:x1858396225389504:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 3744us (3809us total) trans 8589934917 rc 0/0 00000100:00100000:0.0:1772305925.336847:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1048 00000100:00100000:2.0:1772305925.336852:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000024ecc70c pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+54:99171:x1858396225389632:12345-192.168.203.30@tcp:49:cp.0 Request processed in 58us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305925.336860:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 125 00000040:00080000:3.0:1772305925.336884:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305925.336888:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305925.337357:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 13 00000040:00080000:3.0:1772305925.337363:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:1.0:1772305925.337666:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305925.337697:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225389760 00000100:00100000:2.0:1772305925.337724:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 126 00000100:00100000:2.0:1772305925.337728:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e6eb5d84 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+67:99172:x1858396225389760:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1772305925.337859:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305925.337901:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225389824 00000004:00080000:2.0:1772305925.337927:0:57054:0:(mdd_object.c:3529:mdd_close()) Object [0x200000402:0x32c:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00100000:0.0:1772305925.337937:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5742 00000100:00100000:0.0:1772305925.337942:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e66c634e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f935b4d0-e17f-49c8-8011-4be99ba75430+161:99171:x1858396225389824:12345-192.168.203.30@tcp:101:cp.0 00010000:00010000:0.0:1772305925.337950:0:21400:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305925.337963:0:21400:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f904 lrc: 2/0,0 mode: --/PR res: [0x1b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f058 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1772305925.337977:0:21400:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x1b0:0x0] initial LVB size: 1048576, mtime: 0x69a33e03, atime: 0x69a33e03, ctime: 0x69a33e03, blocks: 0x803 00010000:00010000:0.0:1772305925.337990:0:21400:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305925.337993:0:21400:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305925.337999:0:21400:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f904 lrc: 3/0,0 mode: PR/PR res: [0x1b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f058 expref: 162 pid: 21400 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1772305925.338003:0:57054:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934918 00010000:00010000:0.0:1772305925.338010:0:21400:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f904 lrc: 3/0,0 mode: PR/PR res: [0x1b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f058 expref: 162 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.338018:0:21400:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000f7a426e, rc 0) 00010000:00010000:2.0:1772305925.338025:0:57054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000e8ea7e31/0xa5e9c8c58c6f90b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x32c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.338034:0:57054:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e8ea7e31/0xa5e9c8c58c6f90b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446631280743258432 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305925.338045:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e66c634e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f935b4d0-e17f-49c8-8011-4be99ba75430+162:99171:x1858396225389824:12345-192.168.203.30@tcp:101:cp.0 Request processed in 102us (187us total) trans 0 rc 0/0 00010000:00010000:2.0:1772305925.338046:0:57054:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e8ea7e31/0xa5e9c8c58c6f90b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446631280743258432 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305925.338057:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5742 00010000:00010000:2.0:1772305925.338058:0:57054:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000e8ea7e31/0xa5e9c8c58c6f90b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x32c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446631280743258432 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.338068:0:57054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000e8ea7e31/0xa5e9c8c58c6f90b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x32c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446631280743258432 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.338074:0:57054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e8ea7e31/0xa5e9c8c58c6f90b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x32c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446631280743258432 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.338095:0:57054:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1772305925.338109:0:5497:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1772305925.338114:0:5497:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000e8ea7e31/0xa5e9c8c58c6f90b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x32c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446631280743258432 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.338123:0:5497:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e8ea7e31 already unused, calling callback (00000000b5e4f3c0) 00010000:00010000:0.0:1772305925.338126:0:5497:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e8ea7e31/0xa5e9c8c58c6f90b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x32c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446631280743258432 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.338134:0:5497:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e8ea7e31/0xa5e9c8c58c6f90b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x32c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446631280743258432 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.338157:0:5497:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32c:0x0].0x0 (00000000fc961c4f) 00010000:00010000:0.0:1772305925.338161:0:5497:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1772305925.338164:0:5497:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000e8ea7e31/0xa5e9c8c58c6f90b lrc: 1/0,0 mode: --/PW res: [0x200000402:0x32c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446631280743258432 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305925.338170:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e6eb5d84 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+68:99172:x1858396225389760:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 437us (503us total) trans 8589934918 rc 0/0 00000100:00100000:2.0:1772305925.338183:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 126 00010000:00010000:0.0:1772305925.338187:0:5497:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e8ea7e31/0xa5e9c8c58c6f90b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x32c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446631280743258432 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.338211:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1772305925.338214:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1772305925.338216:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772305925.340607:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305925.340671:0:21399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225389952 00002000:00100000:0.0:1772305925.340699:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1b0:0x0] (0->1048575) req@00000000338bd133 x1858396225389952/t0(0) o3->f935b4d0-e17f-49c8-8011-4be99ba75430@192.168.203.30@tcp:56/0 lens 488/0 e 0 to 0 dl 1772305931 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cp.0' 00002000:00100000:0.0:1772305925.340710:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 00000000338bd133 with x1858396225389952 ext(0->1048575) 00002000:00010000:0.0:1772305925.340714:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000338bd133 00000100:00100000:0.0:1772305925.340739:0:21399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2046 00000100:00100000:0.0:1772305925.340746:0:21399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000338bd133 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+162:2216:x1858396225389952:12345-192.168.203.30@tcp:3:cp.0 00000100:00100000:0.0:1772305925.344541:0:21399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000338bd133 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+162:2216:x1858396225389952:12345-192.168.203.30@tcp:3:cp.0 Request processed in 3792us (3933us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1772305925.344554:0:21399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2046 00002000:00100000:0.0:1772305925.344564:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1b0:0x0] (0->1048575) req@00000000338bd133 x1858396225389952/t0(0) o3->f935b4d0-e17f-49c8-8011-4be99ba75430@192.168.203.30@tcp:56/0 lens 488/440 e 0 to 0 dl 1772305931 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'cp.0' 00002000:00100000:0.0:1772305925.344575:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 00000000338bd133 with x1858396225389952 ext(0->1048575) 00002000:00010000:0.0:1772305925.344579:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000338bd133 00000100:00100000:1.0:1772305925.349917:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305925.349974:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225390016 00000100:00100000:0.0:1772305925.350016:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5743 00000100:00100000:0.0:1772305925.350024:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fe12e717 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f935b4d0-e17f-49c8-8011-4be99ba75430+141:99171:x1858396225390016:12345-192.168.203.30@tcp:101:cp.0 00010000:00010000:0.0:1772305925.350038:0:21400:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305925.350059:0:21400:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6f912 lrc: 2/0,0 mode: --/PW res: [0x1b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f05f expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.350094:0:21400:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000027bbef42/0xa5e9c8c58c6f839 lrc: 2/0,0 mode: PR/PR res: [0x1b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f012 expref: 142 pid: 21400 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1772305925.350103:0:21400:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305925.350105:0:21400:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305925.350108:0:21400:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6f912 lrc: 4/0,0 mode: --/PW res: [0x1b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f05f expref: 142 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.350138:0:21400:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000027bbef42/0xa5e9c8c58c6f839 lrc: 3/0,0 mode: PR/PR res: [0x1b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f012 expref: 142 pid: 21400 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1772305925.350164:0:21400:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000027bbef42/0xa5e9c8c58c6f839 lrc: 4/0,0 mode: PR/PR res: [0x1b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f012 expref: 142 pid: 21400 timeout: 1337 lvb_type: 1 00000100:00100000:0.0:1772305925.350177:0:21400:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cc0879e3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:21400:1858396216606848:192.168.203.30@tcp:104: 00000100:00100000:0.0:1772305925.350229:0:21400:0:(client.c:2500:ptlrpc_set_wait()) set 0000000041fdb5c3 going to sleep for 6 seconds 00000100:00100000:0.0:1772305925.350999:0:21400:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cc0879e3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:21400:1858396216606848:192.168.203.30@tcp:104: 00010000:00010000:0.0:1772305925.351024:0:21400:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6f912 lrc: 3/0,0 mode: --/PW res: [0x1b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f05f expref: 142 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.351039:0:21400:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000870ce7f2, rc 0) 00000100:00100000:0.0:1772305925.351069:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fe12e717 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f935b4d0-e17f-49c8-8011-4be99ba75430+142:99171:x1858396225390016:12345-192.168.203.30@tcp:101:cp.0 Request processed in 1045us (1155us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305925.351074:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5743 00000100:00100000:1.0:1772305925.351186:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305925.351270:0:6323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225390080 00010000:00010000:3.0:1772305925.351305:0:6323:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000027bbef42/0xa5e9c8c58c6f839 lrc: 4/0,0 mode: PR/PR res: [0x1b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f012 expref: 142 pid: 21400 timeout: 1337 lvb_type: 1 00000100:00100000:3.0:1772305925.351341:0:6323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3124 00000100:00100000:3.0:1772305925.351361:0:6323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000566cbf94 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+142:2215:x1858396225390080:12345-192.168.203.30@tcp:103:ldlm_bl_05.0 00010000:00010000:3.0:1772305925.351376:0:6323:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1772305925.351417:0:6323:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000027bbef42/0xa5e9c8c58c6f839 lrc: 4/0,0 mode: PR/PR res: [0x1b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f012 expref: 142 pid: 21400 timeout: 1337 lvb_type: 1 00010000:00010000:3.0:1772305925.351428:0:6323:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000027bbef42/0xa5e9c8c58c6f839 lrc: 3/0,0 mode: PR/PR res: [0x1b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f012 expref: 142 pid: 21400 timeout: 1337 lvb_type: 1 00010000:00010000:3.0:1772305925.351453:0:6323:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027bbef42/0xa5e9c8c58c6f839 lrc: 0/0,0 mode: --/PR res: [0x1b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f012 expref: 142 pid: 21400 timeout: 1337 lvb_type: 1 00010000:00010000:3.0:1772305925.351466:0:6323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1772305925.351468:0:6323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1772305925.351475:0:6323:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6f912 lrc: 2/0,0 mode: PW/PW res: [0x1b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f05f expref: 141 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305925.351482:0:6323:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6f912 lrc: 3/0,0 mode: PW/PW res: [0x1b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f05f expref: 141 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305925.351511:0:6323:0:(ldlm_lockd.c:1069:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6f912 lrc: 3/0,0 mode: PW/PW res: [0x1b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f05f expref: 141 pid: 21400 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305925.351520:0:6323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000024c17032 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6323:1858396216606912:192.168.203.30@tcp:105: 00000100:00100000:3.0:1772305925.351588:0:6323:0:(client.c:2500:ptlrpc_set_wait()) set 00000000c7e29024 going to sleep for 6 seconds 00000100:00100000:3.0:1772305925.352476:0:6323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000024c17032 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6323:1858396216606912:192.168.203.30@tcp:105: 00010000:00010000:3.0:1772305925.352492:0:6323:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1772305925.352522:0:6323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000566cbf94 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+141:2215:x1858396225390080:12345-192.168.203.30@tcp:103:ldlm_bl_05.0 Request processed in 1161us (1339us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305925.352537:0:6323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3124 00000100:00100000:1.0:1772305925.360484:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305925.360546:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225390272 00000100:00100000:2.0:1772305925.360600:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 127 00000100:00100000:2.0:1772305925.360609:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c8b46b0c pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+54:99171:x1858396225390272:12345-192.168.203.30@tcp:35:cp.0 00000100:00100000:1.0:1772305925.360845:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305925.360903:0:21399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225390336 00000001:00080000:2.0:1772305925.360913:0:57054:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934919 00002000:00100000:0.0:1772305925.360940:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x100010000:0x1b0:0x0] (0->1048575) req@00000000c67c9448 x1858396225390336/t0(0) o4->f935b4d0-e17f-49c8-8011-4be99ba75430@192.168.203.30@tcp:56/0 lens 488/0 e 0 to 0 dl 1772305931 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cp.0' 00002000:00100000:0.0:1772305925.360952:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 00000000c67c9448 with x1858396225390336 ext(0->1048575) 00002000:00010000:0.0:1772305925.360959:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000c67c9448 00000100:00100000:0.0:1772305925.360987:0:21399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2047 00000100:00100000:0.0:1772305925.360993:0:21399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c67c9448 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+141:2215:x1858396225390336:12345-192.168.203.30@tcp:4:cp.0 00000100:00100000:2.0:1772305925.361011:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c8b46b0c pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+55:99171:x1858396225390272:12345-192.168.203.30@tcp:35:cp.0 Request processed in 401us (532us total) trans 8589934919 rc 0/0 00000100:00100000:2.0:1772305925.361022:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 127 00000100:00100000:1.0:1772305925.361865:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305925.361911:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225390464 00000100:00100000:2.0:1772305925.361943:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 128 00000100:00100000:2.0:1772305925.361949:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c9f16044 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+55:99171:x1858396225390464:12345-192.168.203.30@tcp:35:cp.0 00000100:00100000:2.0:1772305925.362051:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c9f16044 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+56:99171:x1858396225390464:12345-192.168.203.30@tcp:35:cp.0 Request processed in 100us (186us total) trans 8589934920 rc 0/0 00000100:00100000:2.0:1772305925.362059:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 128 00000100:00100000:0.0:1772305925.366624:0:21399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c67c9448 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2215:x1858396225390336:12345-192.168.203.30@tcp:4:cp.0 Request processed in 5627us (5780us total) trans 4294968347 rc 0/0 00000100:00100000:0.0:1772305925.366650:0:21399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2047 00002000:00100000:0.0:1772305925.366660:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x100010000:0x1b0:0x0] (0->1048575) req@00000000c67c9448 x1858396225390336/t4294968347(0) o4->f935b4d0-e17f-49c8-8011-4be99ba75430@192.168.203.30@tcp:56/0 lens 488/448 e 0 to 0 dl 1772305931 ref 1 fl Complete:/0/0 rc 0/0 job:'cp.0' 00002000:00100000:0.0:1772305925.366670:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 00000000c67c9448 with x1858396225390336 ext(0->1048575) 00002000:00010000:0.0:1772305925.366675:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000c67c9448 00000100:00100000:1.0:1772305925.369413:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305925.369472:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225390592 00000100:00100000:0.0:1772305925.369505:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1049 00000100:00100000:0.0:1772305925.369510:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009e8df762 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+56:99173:x1858396225390592:12345-192.168.203.30@tcp:101:cmp.0 00010000:00010000:0.0:1772305925.369528:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305925.369545:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f919 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f066 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.369596:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f920 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.369607:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f920 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.369619:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f920 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.369647:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f927 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.369653:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f927 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.369657:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f927 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.369770:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f92e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.369776:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f92e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.369781:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f92e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305925.369787:0:54697:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x32b:0x0]: returning size 1048576 00010000:00010000:0.0:1772305925.369851:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f920 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.369856:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f920 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.369861:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f920 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.369868:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006e08f961 already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305925.369871:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f920 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.369875:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f920 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.369883:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:0.0:1772305925.369885:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305925.369888:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f920 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.369893:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f920 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.369904:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f927 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.369910:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f927 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.369916:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f927 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.369923:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000079ce3603 already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305925.369925:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f927 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.369931:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f927 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.369940:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6325532c (0000000029823b66) 00010000:00010000:0.0:1772305925.369942:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305925.369944:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f927 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.369950:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f927 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.369979:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f919 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f066 expref: 59 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.369991:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f92e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f066 expref: 58 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.369998:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32b:0x0].0x0 (000000000c14a94e) 00010000:00010000:0.0:1772305925.370000:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1772305925.370002:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c7dfb548, rc 0) 00000100:00100000:0.0:1772305925.370040:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009e8df762 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+58:99173:x1858396225390592:12345-192.168.203.30@tcp:101:cmp.0 Request processed in 528us (630us total) trans 8589934921 rc 0/0 00000100:00100000:0.0:1772305925.370048:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1049 00000100:00100000:3.0:1772305925.371141:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305925.371208:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225390656 00000100:00100000:0.0:1772305925.371249:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1050 00000100:00100000:0.0:1772305925.371255:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000024c17032 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+58:99173:x1858396225390656:12345-192.168.203.30@tcp:101:cmp.0 00010000:00010000:0.0:1772305925.371269:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305925.371280:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c6f93c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f06d expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.371324:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f943 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.371335:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f943 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.371343:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f943 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305925.371364:0:54697:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x32b:0x0]: returning size 1048576 00000004:00200000:0.0:1772305925.371368:0:54697:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1772305925.371379:0:54697:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f943 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.371405:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f943 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.371422:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c6f93c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f06d expref: 60 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.371434:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f943 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f06d expref: 59 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.371440:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32b:0x0].0x0 (000000000c14a94e) 00010000:00010000:0.0:1772305925.371442:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1772305925.371444:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fd93d0b1, rc 0) 00000100:00100000:0.0:1772305925.371483:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000024c17032 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+59:99173:x1858396225390656:12345-192.168.203.30@tcp:101:cmp.0 Request processed in 227us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305925.371492:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1050 00000100:00100000:1.0:1772305925.372833:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305925.372879:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225390784 00000100:00100000:0.0:1772305925.372912:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1051 00000100:00100000:0.0:1772305925.372925:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000933c070b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+59:99173:x1858396225390784:12345-192.168.203.30@tcp:101:cmp.0 00010000:00010000:0.0:1772305925.372936:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305925.372946:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6f94a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f074 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.372992:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f951 lrc: 3/1,0 mode: --/CR res: [0x200000408:0x8f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.373003:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f951 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8f:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.373011:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f951 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8f:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305925.373020:0:54697:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000408:0x8f:0x0]: returning size 1048576 00010000:00010000:0.0:1772305925.373086:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6f94a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f074 expref: 62 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.373099:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f951 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x8f:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f074 expref: 61 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.373106:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8f:0x0].0x0 (00000000955bccbc) 00010000:00010000:0.0:1772305925.373109:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1772305925.373111:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a7782eea, rc 0) 00000100:00100000:0.0:1772305925.373144:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000933c070b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+61:99173:x1858396225390784:12345-192.168.203.30@tcp:101:cmp.0 Request processed in 226us (312us total) trans 8589934922 rc 0/0 00000100:00100000:0.0:1772305925.373153:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1051 00000100:00100000:1.0:1772305925.378955:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305925.379024:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225390912 00000100:00100000:2.0:1772305925.379067:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 129 00000100:00100000:2.0:1772305925.379074:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001275cd11 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+61:99173:x1858396225390912:12345-192.168.203.30@tcp:35:cmp.0 00000100:00100000:2.0:1772305925.379220:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001275cd11 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+62:99173:x1858396225390912:12345-192.168.203.30@tcp:35:cmp.0 Request processed in 146us (266us total) trans 8589934923 rc 0/0 00000100:00100000:2.0:1772305925.379228:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 129 00000100:00100000:3.0:1772305925.386678:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305925.386739:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225390976 00000100:00100000:0.0:1772305925.386795:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1052 00000100:00100000:0.0:1772305925.386802:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000773e607e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+62:99174:x1858396225390976:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1772305925.386823:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305925.386841:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6f95f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f07b expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.386891:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c6f966 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.386905:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c6f966 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.386917:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c6f966 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305925.386967:0:54697:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:0.0:1772305925.386970:0:54697:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 111 stripe count 1 MDT count 1 00000004:00010000:0.0:1772305925.386985:0:54697:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c6f966 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.387004:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6f95f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f07b expref: 64 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.387015:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c6f966 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f07b expref: 63 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.387020:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:0.0:1772305925.387022:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1772305925.387025:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000004820b6c, rc 0) 00000100:00100000:0.0:1772305925.387072:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000773e607e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+63:99174:x1858396225390976:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 270us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305925.387081:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1052 00000100:00100000:1.0:1772305925.389258:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305925.389294:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225391104 00000100:00100000:0.0:1772305925.389319:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1053 00000100:00100000:0.0:1772305925.389323:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d02fd03d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+63:99174:x1858396225391104:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1772305925.389330:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305925.389338:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f96d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f082 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.389395:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f974 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.389404:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f974 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.389410:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f974 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305925.389419:0:54697:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x32b:0x0]: returning size 1048576 00010000:00010000:0.0:1772305925.389510:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f96d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f082 expref: 66 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.389523:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f974 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x32b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f082 expref: 65 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.389530:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32b:0x0].0x0 (000000000c14a94e) 00010000:00010000:0.0:1772305925.389533:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1772305925.389535:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079ce3603, rc 0) 00000100:00100000:0.0:1772305925.389565:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d02fd03d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+65:99174:x1858396225391104:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 241us (309us total) trans 8589934924 rc 0/0 00000100:00100000:0.0:1772305925.389570:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1053 00000100:00100000:1.0:1772305925.390533:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305925.390572:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225391168 00000100:00100000:0.0:1772305925.390601:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5744 00000100:00100000:0.0:1772305925.390604:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000acf112ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f935b4d0-e17f-49c8-8011-4be99ba75430+162:2216:x1858396225391168:12345-192.168.203.30@tcp:1:lfs.0 00010000:00010000:0.0:1772305925.390625:0:21400:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f982 lrc: 3/0,1 mode: --/PW res: [0x1b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.390679:0:21400:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f904 lrc: 2/0,0 mode: PR/PR res: [0x1b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f058 expref: 162 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.390688:0:21400:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305925.390690:0:21400:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305925.390692:0:21400:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f982 lrc: 4/0,1 mode: --/PW res: [0x1b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.390723:0:21400:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f904 lrc: 3/0,0 mode: PR/PR res: [0x1b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f058 expref: 162 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.390737:0:21400:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f904 lrc: 4/0,0 mode: PR/PR res: [0x1b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f058 expref: 162 pid: 21400 timeout: 1337 lvb_type: 0 00000100:00100000:0.0:1772305925.390752:0:21400:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cc0879e3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:21400:1858396216606976:192.168.203.30@tcp:104: 00000100:00100000:0.0:1772305925.390806:0:21400:0:(client.c:2500:ptlrpc_set_wait()) set 0000000041fdb5c3 going to sleep for 6 seconds 00000100:00100000:0.0:1772305925.391559:0:21400:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cc0879e3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:21400:1858396216606976:192.168.203.30@tcp:104: 00010000:00010000:0.0:1772305925.391577:0:21400:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f982 lrc: 3/0,1 mode: --/PW res: [0x1b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305925.392847:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305925.392969:0:6323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225391232 00010000:00010000:3.0:1772305925.393000:0:6323:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f904 lrc: 4/0,0 mode: PR/PR res: [0x1b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f058 expref: 163 pid: 21400 timeout: 1337 lvb_type: 0 00000100:00100000:3.0:1772305925.393032:0:6323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3125 00000100:00100000:3.0:1772305925.393037:0:6323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005b961f6e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+163:2215:x1858396225391232:12345-192.168.203.30@tcp:103:ldlm_bl_07.0 00010000:00010000:3.0:1772305925.393049:0:6323:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1772305925.393072:0:6323:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f904 lrc: 4/0,0 mode: PR/PR res: [0x1b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f058 expref: 163 pid: 21400 timeout: 1337 lvb_type: 0 00010000:00010000:3.0:1772305925.393081:0:6323:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f904 lrc: 3/0,0 mode: PR/PR res: [0x1b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f058 expref: 163 pid: 21400 timeout: 1337 lvb_type: 0 00010000:00010000:3.0:1772305925.393103:0:6323:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6f904 lrc: 0/0,0 mode: --/PR res: [0x1b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f058 expref: 163 pid: 21400 timeout: 1337 lvb_type: 0 00010000:00010000:3.0:1772305925.393116:0:6323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1772305925.393117:0:6323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1772305925.393120:0:6323:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f982 lrc: 3/0,1 mode: PW/PW res: [0x1b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305925.393128:0:6323:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f982 lrc: 4/0,1 mode: PW/PW res: [0x1b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305925.393169:0:6323:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1772305925.393207:0:6323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005b961f6e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+162:2215:x1858396225391232:12345-192.168.203.30@tcp:103:ldlm_bl_07.0 Request processed in 170us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305925.393214:0:6323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3125 00010000:00010000:0.0:1772305925.393247:0:21400:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f982 lrc: 3/0,1 mode: PW/PW res: [0x1b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.393257:0:21400:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f982 lrc: 3/0,1 mode: PW/PW res: [0x1b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.393280:0:21400:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f982 lrc: 3/0,1 mode: PW/PW res: [0x1b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.393286:0:21400:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f982 lrc: 2/0,0 mode: PW/PW res: [0x1b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.393307:0:21400:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1772305925.393350:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000acf112ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f935b4d0-e17f-49c8-8011-4be99ba75430+161:2216:x1858396225391168:12345-192.168.203.30@tcp:1:lfs.0 Request processed in 2744us (2818us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305925.393358:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5744 00010000:00010000:3.0:1772305925.393399:0:6322:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1772305925.393406:0:6322:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f982 lrc: 2/0,0 mode: PW/PW res: [0x1b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305925.393417:0:6322:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006e08f961 already unused, calling callback (00000000b5e4f3c0) 00010000:00010000:3.0:1772305925.393421:0:6322:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f982 lrc: 2/0,0 mode: PW/PW res: [0x1b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305925.393431:0:6322:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f982 lrc: 3/0,0 mode: PW/PW res: [0x1b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305925.393446:0:6322:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f982 lrc: 1/0,0 mode: --/PW res: [0x1b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305925.393453:0:6322:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6f982 lrc: 0/0,0 mode: --/PW res: [0x1b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305925.393513:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1772305925.393515:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1772305925.393516:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772305925.394028:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305925.394077:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225391360 00000100:00100000:2.0:1772305925.394108:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 130 00000100:00100000:2.0:1772305925.394112:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000361b5fba pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+65:99174:x1858396225391360:12345-192.168.203.30@tcp:35:lfs.0 00000004:00010000:2.0:1772305925.394142:0:57054:0:(mdt_open.c:1862:mdt_hsm_release()) ### [0x200000402:0x32b:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f974 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x32b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f082 expref: 65 pid: 54697 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1772305925.394295:0:57054:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934925 00000001:00080000:2.0:1772305925.394594:0:57054:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934925 00010000:00010000:2.0:1772305925.394624:0:57054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6f989 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.394661:0:57054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000c90074c9/0xa5e9c8c58c6f847 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f019 expref: 66 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.394667:0:57054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f92e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f066 expref: 66 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.394672:0:57054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f943 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f06d expref: 66 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.394677:0:57054:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6f989 lrc: 6/0,1 mode: --/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.394694:0:57054:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f943 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f06d expref: 66 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.394701:0:57054:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f943 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f06d expref: 66 pid: 54697 timeout: 1337 lvb_type: 0 00000100:00100000:2.0:1772305925.394707:0:57054:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003b46920d pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:57054:1858396216607040:192.168.203.30@tcp:104: 00010000:00010000:2.0:1772305925.394747:0:57054:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f92e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f066 expref: 66 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.394756:0:57054:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f92e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f066 expref: 66 pid: 54697 timeout: 1337 lvb_type: 0 00000100:00100000:2.0:1772305925.394763:0:57054:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000873b4f3c pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:57054:1858396216607104:192.168.203.30@tcp:104: 00010000:00010000:2.0:1772305925.394784:0:57054:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000c90074c9/0xa5e9c8c58c6f847 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f019 expref: 66 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.394789:0:57054:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000c90074c9/0xa5e9c8c58c6f847 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f019 expref: 66 pid: 54697 timeout: 1337 lvb_type: 0 00000100:00100000:2.0:1772305925.394795:0:57054:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c30d8750 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:57054:1858396216607168:192.168.203.30@tcp:104: 00000100:00100000:2.0:1772305925.394815:0:57054:0:(client.c:2500:ptlrpc_set_wait()) set 00000000e7485037 going to sleep for 6 seconds 00000100:00100000:2.0:1772305925.395723:0:57054:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003b46920d pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:57054:1858396216607040:192.168.203.30@tcp:104: 00000100:00100000:2.0:1772305925.395731:0:57054:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000873b4f3c pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:57054:1858396216607104:192.168.203.30@tcp:104: 00000100:00100000:1.0:1772305925.395879:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305925.395945:0:57054:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c30d8750 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:57054:1858396216607168:192.168.203.30@tcp:104: 00000100:00100000:1.0:1772305925.395960:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00010000:2.0:1772305925.395987:0:57054:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6f989 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305925.396010:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305925.396047:0:7104:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225391424 00000100:00100000:3.0:1772305925.396062:0:6323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225391488 00000100:00100000:2.0:1772305925.396063:0:5493:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225391552 00010000:00010000:0.0:1772305925.396073:0:7104:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f943 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f06d expref: 69 pid: 54697 timeout: 1337 lvb_type: 0 00010000:00010000:3.0:1772305925.396091:0:6323:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f92e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f066 expref: 69 pid: 54697 timeout: 1337 lvb_type: 0 00010000:00010000:2.0:1772305925.396094:0:5493:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c90074c9/0xa5e9c8c58c6f847 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f019 expref: 69 pid: 54697 timeout: 1337 lvb_type: 0 00000100:00100000:0.0:1772305925.396127:0:7104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3126 00000100:00100000:0.0:1772305925.396143:0:7104:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000030950d51 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+69:2216:x1858396225391424:12345-192.168.203.30@tcp:103:ldlm_bl_06.0 00000100:00100000:1.0:1772305925.396164:0:16126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3127 00010000:00010000:0.0:1772305925.396173:0:7104:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1772305925.396180:0:16126:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000009f3c62d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f935b4d0-e17f-49c8-8011-4be99ba75430+69:2216:x1858396225391552:12345-192.168.203.30@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1772305925.396188:0:7104:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f943 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f06d expref: 69 pid: 54697 timeout: 1337 lvb_type: 0 00000100:00100000:2.0:1772305925.396197:0:5493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3128 00010000:00010000:1.0:1772305925.396208:0:16126:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1772305925.396216:0:5493:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003116ee12 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+69:2215:x1858396225391488:12345-192.168.203.30@tcp:103:ldlm_bl_08.0 00010000:00010000:1.0:1772305925.396221:0:16126:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000c90074c9/0xa5e9c8c58c6f847 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f019 expref: 69 pid: 54697 timeout: 1337 lvb_type: 0 00010000:00010000:0.0:1772305925.396231:0:7104:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f943 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f06d expref: 69 pid: 54697 timeout: 1337 lvb_type: 0 00010000:00010000:2.0:1772305925.396236:0:5493:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1772305925.396246:0:5493:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f92e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x9/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f066 expref: 69 pid: 54697 timeout: 1337 lvb_type: 0 00010000:00010000:1.0:1772305925.396268:0:16126:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000c90074c9/0xa5e9c8c58c6f847 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f019 expref: 69 pid: 54697 timeout: 1337 lvb_type: 0 00010000:00010000:2.0:1772305925.396289:0:5493:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f92e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x9/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f066 expref: 69 pid: 54697 timeout: 1337 lvb_type: 0 00010000:00010000:0.0:1772305925.396289:0:7104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f943 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f06d expref: 69 pid: 54697 timeout: 1337 lvb_type: 0 00010000:00010000:1.0:1772305925.396324:0:16126:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c90074c9/0xa5e9c8c58c6f847 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f019 expref: 68 pid: 54697 timeout: 1337 lvb_type: 0 00010000:00010000:0.0:1772305925.396328:0:7104:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32b:0x0].0x0 (000000000c14a94e) 00010000:00010000:2.0:1772305925.396331:0:5493:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6f92e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x9/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f066 expref: 68 pid: 54697 timeout: 1337 lvb_type: 0 00010000:00010000:0.0:1772305925.396342:0:7104:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6f989 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x28/0x0 rrc: 9 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.396353:0:7104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6f989 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.396361:0:7104:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6f989 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305925.396372:0:16126:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32b:0x0].0x0 (000000000c14a94e) 00010000:00010000:1.0:1772305925.396378:0:16126:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1772305925.396379:0:5493:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32b:0x0].0x0 (000000000c14a94e) 00010000:00010000:2.0:1772305925.396398:0:5493:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1772305925.396422:0:7104:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1772305925.396444:0:57054:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6f989 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305925.396445:0:5493:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003116ee12 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+66:2215:x1858396225391488:12345-192.168.203.30@tcp:103:ldlm_bl_08.0 Request processed in 224us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305925.396446:0:16126:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000009f3c62d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f935b4d0-e17f-49c8-8011-4be99ba75430+66:2216:x1858396225391552:12345-192.168.203.30@tcp:103:ldlm_bl_03.0 Request processed in 255us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305925.396472:0:7104:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000030950d51 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+66:2216:x1858396225391424:12345-192.168.203.30@tcp:103:ldlm_bl_06.0 Request processed in 317us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305925.396485:0:5493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3128 00010000:00010000:3.0:1772305925.396498:0:57054:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6f989 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305925.396504:0:16126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3127 00000100:00100000:0.0:1772305925.396516:0:7104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3126 00000001:00080000:3.0:1772305925.396623:0:57054:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934925 00000001:00080000:3.0:1772305925.396931:0:57054:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934925 00000100:00100000:3.0:1772305925.397037:0:57054:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000983211d3 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:57054:1858396216607232:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1772305925.397085:0:57054:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305925.397110:0:57054:0:(client.c:2500:ptlrpc_set_wait()) set 0000000066369f5c going to sleep for 6 seconds 00000100:00100000:2.0:1772305925.397130:0:57220:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216607232 00000100:00100000:2.0:1772305925.397159:0:57220:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1772305925.397162:0:57220:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f34239ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:57054:x1858396216607232:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1772305925.397219:0:57220:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f34239ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:57054:x1858396216607232:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 55us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305925.397225:0:57220:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1772305925.397262:0:57054:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000983211d3 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:57054:1858396216607232:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:3.0:1772305925.397424:0:57054:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934925 00000100:00100000:3.0:1772305925.397449:0:57054:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000983211d3 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:57054:1858396216607296:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1772305925.397472:0:57054:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305925.397488:0:57054:0:(client.c:2500:ptlrpc_set_wait()) set 00000000845ba1b9 going to sleep for 6 seconds 00000100:00100000:2.0:1772305925.397507:0:57220:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216607296 00000100:00100000:2.0:1772305925.397534:0:57220:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1772305925.397538:0:57220:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000049a0d2b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:57054:x1858396216607296:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1772305925.397703:0:57220:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000049a0d2b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:57054:x1858396216607296:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 164us (230us total) trans 4294968313 rc 0/0 00000100:00100000:2.0:1772305925.397711:0:57220:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1772305925.397733:0:57054:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000983211d3 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:57054:1858396216607296:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:3.0:1772305925.397774:0:57054:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934925 00010000:00010000:3.0:1772305925.397786:0:57054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6f989 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305925.397796:0:57054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6f989 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305925.397804:0:57054:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6f989 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305925.397825:0:57054:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ad568b72 already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305925.397829:0:57054:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6f989 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305925.397836:0:57054:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6f989 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305925.397855:0:57054:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32b:0x0].0x0 (000000000c14a94e) 00010000:00010000:3.0:1772305925.397858:0:57054:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1772305925.397861:0:57054:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6f989 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305925.397866:0:57054:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6f989 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1772305925.398033:0:57054:0:(mdd_object.c:3529:mdd_close()) Object [0x200000408:0x90:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1772305925.398105:0:57054:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xb:0x0].11, 64 off8968 00000001:00080000:3.0:1772305925.398113:0:57054:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934925 00010000:00010000:3.0:1772305925.398159:0:57054:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32b:0x0].0x0 (000000000c14a94e) 00010000:00010000:3.0:1772305925.398163:0:57054:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1772305925.398168:0:57054:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f974 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x32b:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f082 expref: 63 pid: 54697 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305925.398246:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000361b5fba pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+62:99174:x1858396225391360:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 4132us (4219us total) trans 8589934925 rc 0/0 00000100:00100000:3.0:1772305925.398253:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 130 00000100:00100000:1.0:1772305925.406963:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305925.407028:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225391680 00000100:00100000:0.0:1772305925.407071:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1054 00000100:00100000:0.0:1772305925.407079:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ea17b2f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+62:99177:x1858396225391680:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1772305925.407095:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305925.407109:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f990 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f089 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.407165:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f997 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.407177:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f997 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.407197:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f997 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.407211:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6f99e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.407218:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6f99e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.407225:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6f99e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.407333:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6f9a5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.407341:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6f9a5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.407348:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6f9a5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305925.407357:0:54697:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x32b:0x0]: returning size 1048576 00010000:00010000:0.0:1772305925.407450:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f997 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.407459:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f997 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.407466:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f997 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.407472:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000082c88ffe already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305925.407475:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f997 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.407482:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f997 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.407491:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:0.0:1772305925.407494:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305925.407498:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f997 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.407504:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6f997 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.407514:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6f99e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.407520:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6f99e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.407525:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6f99e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.407536:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000034fec1fd already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305925.407537:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6f99e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.407543:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6f99e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.407549:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6325532c (0000000029823b66) 00010000:00010000:0.0:1772305925.407552:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305925.407553:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6f99e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.407558:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6f99e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.407585:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6f990 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f089 expref: 65 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.407595:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6f9a5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f089 expref: 64 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.407601:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32b:0x0].0x0 (0000000076ea1b5e) 00010000:00010000:0.0:1772305925.407604:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1772305925.407605:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001e903b7f, rc 0) 00000100:00100000:0.0:1772305925.407689:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ea17b2f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+64:99177:x1858396225391680:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 609us (727us total) trans 8589934926 rc 0/0 00000100:00100000:0.0:1772305925.407698:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1054 00000100:00100000:1.0:1772305925.408683:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305925.408730:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225391744 00000100:00100000:0.0:1772305925.408767:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1055 00000100:00100000:0.0:1772305925.408782:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000076169a73 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+64:99177:x1858396225391744:12345-192.168.203.30@tcp:54:lfs.0 00010000:00010000:0.0:1772305925.408813:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f9b3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.408824:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f9b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.408832:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f9b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.408845:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f9b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.408852:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f9b3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.408859:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f9b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.408865:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000079ce3603 already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305925.408868:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f9b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.408874:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f9b3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.408883:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32b:0x0].0x0 (0000000076ea1b5e) 00010000:00010000:0.0:1772305925.408886:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1772305925.408888:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f9b3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.408894:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6f9b3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305925.408953:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000076169a73 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+64:99177:x1858396225391744:12345-192.168.203.30@tcp:54:lfs.0 Request processed in 180us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305925.408963:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1055 00000100:00100000:2.0:1772305925.409695:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305925.409748:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225391872 00000100:00100000:3.0:1772305925.409791:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 131 00000100:00100000:3.0:1772305925.409809:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c30d8750 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+64:99177:x1858396225391872:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:3.0:1772305925.409972:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c30d8750 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+65:99177:x1858396225391872:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 163us (278us total) trans 8589934927 rc 0/0 00000100:00100000:3.0:1772305925.409979:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 131 00000100:00100000:1.0:1772305925.424308:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305925.424376:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225391936 00000100:00100000:1.0:1772305925.424412:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305925.424463:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225392064 00000100:00100000:0.0:1772305925.424490:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1056 00000100:00100000:0.0:1772305925.424498:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000096cbaee8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+66:2216:x1858396225391936:12345-192.168.203.30@tcp:41:mkdir.0 00000100:00100000:2.0:1772305925.424509:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1057 00000100:00100000:2.0:1772305925.424519:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fca5ff81 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+66:99182:x1858396225392064:12345-192.168.203.30@tcp:36:mkdir.0 00000004:00000024:0.0:1772305925.424536:0:54697:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 2256928768 avail 2254831616 00010000:00010000:2.0:1772305925.424559:0:55141:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1772305925.424581:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c6f966 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f07b expref: 66 pid: 54697 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305925.424593:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000096cbaee8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+65:2216:x1858396225391936:12345-192.168.203.30@tcp:41:mkdir.0 Request processed in 95us (295us total) trans 0 rc 0/0 00010000:00010000:2.0:1772305925.424597:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00000100:00100000:0.0:1772305925.424603:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1056 00010000:00010000:2.0:1772305925.424604:0:55141:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1772305925.424756:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fca5ff81 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+64:99182:x1858396225392064:12345-192.168.203.30@tcp:36:mkdir.0 Request processed in 239us (349us total) trans 0 rc -17/-17 00000100:00100000:2.0:1772305925.424764:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1057 00000100:00100000:1.0:1772305925.425713:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305925.425753:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225392128 00000100:00100000:2.0:1772305925.425780:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1058 00000100:00100000:2.0:1772305925.425784:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006df25124 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+64:99182:x1858396225392128:12345-192.168.203.30@tcp:101:mkdir.0 00010000:00010000:2.0:1772305925.425793:0:55141:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305925.425805:0:55141:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c6f9ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f090 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.425834:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c6f9c1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.425843:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c6f9c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.425849:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c6f9c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.425859:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6f9c8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.425863:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6f9c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.425867:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6f9c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.425903:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e8ea7e31/0xa5e9c8c58c6f9cf lrc: 3/1,0 mode: --/PR res: [0x200000408:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.425908:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e8ea7e31/0xa5e9c8c58c6f9cf lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.425912:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e8ea7e31/0xa5e9c8c58c6f9cf lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1772305925.425939:0:55141:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000408:0x8d:0x0]: returning size 11776 00000004:00200000:2.0:1772305925.425942:0:55141:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1772305925.425954:0:55141:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000e8ea7e31/0xa5e9c8c58c6f9cf lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.425961:0:55141:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c6f9c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.425965:0:55141:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c6f9c1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.425969:0:55141:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c6f9c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.425973:0:55141:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000063369192 already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305925.425975:0:55141:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c6f9c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.425979:0:55141:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c6f9c1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.425984:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:2.0:1772305925.425985:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305925.425987:0:55141:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c6f9c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.425991:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c6f9c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.425997:0:55141:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6f9c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.426001:0:55141:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6f9c8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.426005:0:55141:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6f9c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.426008:0:55141:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ad568b72 already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305925.426009:0:55141:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6f9c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.426012:0:55141:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6f9c8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.426016:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3f22ae9b (000000007f5f418e) 00010000:00010000:2.0:1772305925.426017:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305925.426018:0:55141:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6f9c8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.426021:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6f9c8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.426035:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c6f9ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f090 expref: 66 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.426041:0:55141:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000e8ea7e31/0xa5e9c8c58c6f9cf lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f090 expref: 65 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.426045:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8d:0x0].0x0 (0000000088c8ea8b) 00010000:00010000:2.0:1772305925.426047:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1772305925.426049:0:55141:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e8ea7e31, rc 0) 00000100:00100000:2.0:1772305925.426078:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006df25124 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+65:99182:x1858396225392128:12345-192.168.203.30@tcp:101:mkdir.0 Request processed in 293us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305925.426083:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1058 00000100:00100000:1.0:1772305925.432848:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305925.432894:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225392192 00000100:00100000:2.0:1772305925.432930:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1059 00000100:00100000:2.0:1772305925.432935:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000994afcfc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+65:99183:x1858396225392192:12345-192.168.203.30@tcp:101:tar.0 00010000:00010000:2.0:1772305925.432943:0:55141:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305925.432951:0:55141:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6f9d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f097 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.432977:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c6f9dd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.432985:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c6f9dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.432991:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c6f9dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1772305925.433011:0:55141:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x32b:0x0]: returning size 1048576 00000004:00200000:2.0:1772305925.433015:0:55141:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1772305925.433036:0:55141:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c6f9dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.433046:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c6f9dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.433062:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6f9d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f097 expref: 67 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.433077:0:55141:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c6f9dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f097 expref: 66 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.433084:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32b:0x0].0x0 (0000000076ea1b5e) 00010000:00010000:2.0:1772305925.433086:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1772305925.433089:0:55141:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004e3177f5, rc 0) 00000100:00100000:2.0:1772305925.433124:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000994afcfc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+66:99183:x1858396225392192:12345-192.168.203.30@tcp:101:tar.0 Request processed in 188us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305925.433129:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1059 00000100:00100000:1.0:1772305925.434179:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305925.434231:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225392320 00000100:00100000:2.0:1772305925.434258:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1060 00000100:00100000:2.0:1772305925.434262:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000006affeef pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+66:99183:x1858396225392320:12345-192.168.203.30@tcp:101:tar.0 00010000:00010000:2.0:1772305925.434270:0:55141:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305925.434277:0:55141:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c6f9e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f09e expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.434315:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6f9eb lrc: 3/1,0 mode: --/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.434323:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6f9eb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.434328:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6f9eb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1772305925.434335:0:55141:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x32b:0x0]: returning size 1048576 00010000:00010000:2.0:1772305925.434426:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c6f9e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f09e expref: 69 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.434442:0:55141:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6f9eb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f09e expref: 68 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.434447:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32b:0x0].0x0 (0000000076ea1b5e) 00010000:00010000:2.0:1772305925.434449:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1772305925.434450:0:55141:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ad568b72, rc 0) 00000100:00100000:2.0:1772305925.434478:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000006affeef pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+68:99183:x1858396225392320:12345-192.168.203.30@tcp:101:tar.0 Request processed in 215us (303us total) trans 8589934928 rc 0/0 00000100:00100000:2.0:1772305925.434483:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1060 00000100:00100000:1.0:1772305925.435503:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305925.435547:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225392448 00000100:00100000:2.0:1772305925.435573:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1061 00000100:00100000:2.0:1772305925.435577:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000843d6290 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+68:99183:x1858396225392448:12345-192.168.203.30@tcp:58:tar.0 00010000:00010000:2.0:1772305925.435611:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c6f9f9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.435621:0:55141:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6f9a5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f089 expref: 68 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.435646:0:55141:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6f9eb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f09e expref: 68 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.435651:0:55141:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c6f9dd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f097 expref: 68 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.435655:0:55141:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c6f9f9 lrc: 6/0,1 mode: --/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.435681:0:55141:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c6f9dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f097 expref: 68 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.435690:0:55141:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c6f9dd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f097 expref: 68 pid: 55141 timeout: 1337 lvb_type: 0 00000100:00100000:2.0:1772305925.435699:0:55141:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000873b4f3c pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:55141:1858396216607360:192.168.203.30@tcp:104: 00010000:00010000:2.0:1772305925.435747:0:55141:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6f9eb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f09e expref: 68 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.435753:0:55141:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6f9eb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f09e expref: 68 pid: 55141 timeout: 1337 lvb_type: 0 00000100:00100000:2.0:1772305925.435760:0:55141:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003b46920d pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:55141:1858396216607424:192.168.203.30@tcp:104: 00010000:00010000:2.0:1772305925.435781:0:55141:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6f9a5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f089 expref: 68 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305925.435790:0:55141:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6f9a5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f089 expref: 68 pid: 54697 timeout: 1337 lvb_type: 0 00000100:00100000:2.0:1772305925.435797:0:55141:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003bce9793 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:55141:1858396216607488:192.168.203.30@tcp:104: 00000100:00100000:2.0:1772305925.435817:0:55141:0:(client.c:2500:ptlrpc_set_wait()) set 00000000c8dfb8d6 going to sleep for 6 seconds 00000100:00100000:2.0:1772305925.436752:0:55141:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000873b4f3c pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:55141:1858396216607360:192.168.203.30@tcp:104: 00000100:00100000:2.0:1772305925.436767:0:55141:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003b46920d pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:55141:1858396216607424:192.168.203.30@tcp:104: 00000100:00100000:1.0:1772305925.436902:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305925.436909:0:55141:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003bce9793 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:55141:1858396216607488:192.168.203.30@tcp:104: 00000100:00100000:1.0:1772305925.436926:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00010000:2.0:1772305925.436934:0:55141:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c6f9f9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305925.436971:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305925.436983:0:16126:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225392512 00000100:00100000:0.0:1772305925.436997:0:7104:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225392640 00000100:00100000:2.0:1772305925.437002:0:5493:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225392576 00010000:00010000:3.0:1772305925.437005:0:16126:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c6f9dd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f097 expref: 70 pid: 55141 timeout: 1337 lvb_type: 0 00010000:00010000:0.0:1772305925.437016:0:7104:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6f9a5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f089 expref: 71 pid: 54697 timeout: 1337 lvb_type: 0 00010000:00010000:2.0:1772305925.437019:0:5493:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6f9eb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f09e expref: 71 pid: 55141 timeout: 1337 lvb_type: 0 00000100:00100000:3.0:1772305925.437037:0:16126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3129 00000100:00100000:3.0:1772305925.437044:0:16126:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000f58975a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f935b4d0-e17f-49c8-8011-4be99ba75430+71:2216:x1858396225392512:12345-192.168.203.30@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1772305925.437054:0:7104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3130 00010000:00010000:3.0:1772305925.437056:0:16126:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1772305925.437061:0:7104:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000566cbf94 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+71:2216:x1858396225392640:12345-192.168.203.30@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1772305925.437063:0:16126:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c6f9dd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f097 expref: 71 pid: 55141 timeout: 1337 lvb_type: 0 00000100:00100000:2.0:1772305925.437066:0:5493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3131 00000100:00100000:2.0:1772305925.437074:0:5493:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000024ecc70c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+71:2215:x1858396225392576:12345-192.168.203.30@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1772305925.437075:0:7104:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1772305925.437081:0:7104:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6f9a5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f089 expref: 71 pid: 54697 timeout: 1337 lvb_type: 0 00010000:00010000:2.0:1772305925.437086:0:5493:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1772305925.437093:0:5493:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6f9eb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f09e expref: 71 pid: 55141 timeout: 1337 lvb_type: 0 00010000:00010000:3.0:1772305925.437118:0:16126:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c6f9dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f097 expref: 71 pid: 55141 timeout: 1337 lvb_type: 0 00010000:00010000:0.0:1772305925.437129:0:7104:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6f9a5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f089 expref: 71 pid: 54697 timeout: 1337 lvb_type: 0 00010000:00010000:2.0:1772305925.437140:0:5493:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6f9eb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f09e expref: 71 pid: 55141 timeout: 1337 lvb_type: 0 00010000:00010000:3.0:1772305925.437157:0:16126:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c6f9dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f097 expref: 71 pid: 55141 timeout: 1337 lvb_type: 0 00010000:00010000:0.0:1772305925.437163:0:7104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6f9a5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x9/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f089 expref: 71 pid: 54697 timeout: 1337 lvb_type: 0 00010000:00010000:3.0:1772305925.437168:0:16126:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32b:0x0].0x0 (0000000076ea1b5e) 00010000:00010000:2.0:1772305925.437169:0:5493:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6f9eb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x32b:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f09e expref: 70 pid: 55141 timeout: 1337 lvb_type: 0 00010000:00010000:3.0:1772305925.437173:0:16126:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c6f9f9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305925.437181:0:16126:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c6f9f9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305925.437187:0:16126:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c6f9f9 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.437208:0:7104:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32b:0x0].0x0 (0000000076ea1b5e) 00010000:00010000:0.0:1772305925.437212:0:7104:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1772305925.437213:0:5493:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32b:0x0].0x0 (0000000076ea1b5e) 00010000:00010000:2.0:1772305925.437218:0:5493:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1772305925.437232:0:16126:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1772305925.437237:0:7104:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000566cbf94 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+68:2216:x1858396225392640:12345-192.168.203.30@tcp:103:ldlm_bl_02.0 Request processed in 176us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305925.437243:0:7104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3130 00000100:00100000:2.0:1772305925.437247:0:5493:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000024ecc70c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+68:2215:x1858396225392576:12345-192.168.203.30@tcp:103:ldlm_bl_01.0 Request processed in 171us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305925.437251:0:16126:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000f58975a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f935b4d0-e17f-49c8-8011-4be99ba75430+68:2216:x1858396225392512:12345-192.168.203.30@tcp:103:ldlm_bl_02.0 Request processed in 207us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305925.437257:0:5493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3131 00000100:00100000:3.0:1772305925.437261:0:16126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3129 00010000:00010000:0.0:1772305925.437278:0:55141:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c6f9f9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.437284:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c6f9f9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1772305925.437422:0:55141:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xf:0x0].41, 136 off13768 00000100:00100000:0.0:1772305925.437461:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000843d6290 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+65:99183:x1858396225392448:12345-192.168.203.30@tcp:58:tar.0 Request processed in 1883us (1962us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305925.437467:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1061 00000100:00100000:1.0:1772305925.438069:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305925.438103:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225392704 00000100:00100000:0.0:1772305925.438129:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1062 00000100:00100000:0.0:1772305925.438132:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e6eb5d84 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+65:99183:x1858396225392704:12345-192.168.203.30@tcp:101:tar.0 00010000:00010000:0.0:1772305925.438139:0:55141:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305925.438145:0:55141:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6fa00 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f0a5 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.438165:0:55141:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c6f9f9 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.438171:0:55141:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6fa00 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0a5 expref: 66 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.438180:0:55141:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c6f9f9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.438187:0:55141:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6fa00 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0a5 expref: 66 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.438195:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32b:0x0].0x0 (0000000076ea1b5e) 00010000:00010000:0.0:1772305925.438196:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1772305925.438198:0:55141:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6fa00 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0a5 expref: 66 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305925.438202:0:55141:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079ce3603, rc 0) 00000100:00100000:0.0:1772305925.438224:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e6eb5d84 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+66:99183:x1858396225392704:12345-192.168.203.30@tcp:101:tar.0 Request processed in 91us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305925.438228:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1062 00010000:00010000:2.0:1772305925.832760:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1772305926.098088:0:7114:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-OST0001: transno 4294968347 is committed 00000040:00080000:3.0:1772305926.344806:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305926.344812:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305926.344846:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 42 count 14 00000040:00080000:3.0:1772305926.344852:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:3.0:1772305926.344923:0:54732:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000216f6f28 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:54732:1858396216607552:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1772305926.344997:0:54732:0:(client.c:2500:ptlrpc_set_wait()) set 00000000ed250a64 going to sleep for 6 seconds 00000100:00100000:3.0:1772305926.346143:0:54732:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000216f6f28 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:54732:1858396216607552:192.168.203.30@tcp:107:hsm_cdtr.0 00000040:00080000:3.0:1772305926.346188:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305926.346190:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305926.346245:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 42 count 14 00000040:00080000:3.0:1772305926.346249:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:1.0:1772305926.346515:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305926.346586:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225392768 00000100:00100000:0.0:1772305926.346649:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1063 00000100:00100000:0.0:1772305926.346657:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c8b46b0c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+68:99185:x1858396225392768:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1772305926.346688:0:55141:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x32b:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1772305926.346747:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c8b46b0c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+68:99185:x1858396225392768:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 91us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305926.346754:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1063 00000100:00100000:1.0:1772305926.347561:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305926.347612:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225392832 00000100:00100000:0.0:1772305926.347655:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1064 00000100:00100000:0.0:1772305926.347659:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c9f16044 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+68:99185:x1858396225392832:12345-192.168.203.30@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1772305926.347701:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6fa07 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.347714:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6fa07 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.347725:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6fa07 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.347735:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6fa0e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x773d4bf9 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.347740:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6fa0e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x773d4bf9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.347744:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6fa0e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x773d4bf9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.347757:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6fa15 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.347762:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6fa15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.347765:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6fa15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305926.347782:0:55141:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x32b:0x0]: returning size 1048576 00000004:00200000:0.0:1772305926.347785:0:55141:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1772305926.347794:0:55141:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6fa15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.347801:0:55141:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6fa07 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.347805:0:55141:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6fa07 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.347810:0:55141:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6fa07 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.347814:0:55141:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000001e903b7f already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305926.347816:0:55141:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6fa07 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.347820:0:55141:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6fa07 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.347828:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (00000000c78481f6) 00010000:00010000:0.0:1772305926.347830:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305926.347832:0:55141:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6fa07 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.347836:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6fa07 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.347844:0:55141:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6fa0e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x773d4bf9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.347847:0:55141:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6fa0e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x773d4bf9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.347851:0:55141:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6fa0e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x773d4bf9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.347855:0:55141:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000fd93d0b1 already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305926.347856:0:55141:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6fa0e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x773d4bf9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.347859:0:55141:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6fa0e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x773d4bf9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.347863:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x773d4bf9 (000000009cd0f8c2) 00010000:00010000:0.0:1772305926.347864:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305926.347865:0:55141:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6fa0e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x773d4bf9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.347868:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6fa0e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x773d4bf9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.347876:0:55141:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6fa15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.347879:0:55141:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6fa15 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.347882:0:55141:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6fa15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.347885:0:55141:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000034fec1fd already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305926.347886:0:55141:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6fa15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.347890:0:55141:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6fa15 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.347894:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32b:0x0].0x0 (0000000076ea1b5e) 00010000:00010000:0.0:1772305926.347895:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305926.347896:0:55141:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6fa15 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.347899:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6fa15 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305926.347933:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c9f16044 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+68:99185:x1858396225392832:12345-192.168.203.30@tcp:34:lhsmtool_posix.0 Request processed in 273us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305926.347939:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1064 00000100:00100000:1.0:1772305926.348559:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305926.348592:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225392896 00000100:00100000:0.0:1772305926.348617:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1065 00000100:00100000:0.0:1772305926.348620:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ffc6c4ba pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+68:99185:x1858396225392896:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1772305926.348661:0:55141:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x32b:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1772305926.348699:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ffc6c4ba pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+68:99185:x1858396225392896:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 78us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305926.348705:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1065 00000100:00100000:1.0:1772305926.349607:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305926.349669:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225393024 00000100:00100000:0.0:1772305926.349706:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1066 00000100:00100000:0.0:1772305926.349711:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003b5a8f12 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+68:99185:x1858396225393024:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1772305926.349721:0:55141:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305926.349735:0:55141:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6fa1c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f0ac expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.350147:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6fa23 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x32d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.350158:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6fa23 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x32d:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.350166:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6fa23 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x32d:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305926.350174:0:55141:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x32d:0x0]: returning size 0 00010000:00010000:0.0:1772305926.350211:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6fa1c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0ac expref: 71 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.350225:0:55141:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6fa23 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x32d:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0ac expref: 70 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.350232:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32d:0x0].0x0 (00000000f81a7ca2) 00010000:00010000:0.0:1772305926.350234:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1772305926.350236:0:55141:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006e08f961, rc 0) 00000100:00100000:0.0:1772305926.350270:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003b5a8f12 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+70:99185:x1858396225393024:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 558us (664us total) trans 8589934929 rc 0/0 00000100:00100000:0.0:1772305926.350277:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1066 00000100:00100000:1.0:1772305926.351442:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305926.351482:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225393152 00000100:00100000:0.0:1772305926.351518:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1067 00000100:00100000:0.0:1772305926.351524:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007af21754 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+70:99185:x1858396225393152:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1772305926.351550:0:55141:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1772305926.351563:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6fa23 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x32d:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0ac expref: 70 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.351573:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32d:0x0].0x0 (00000000f81a7ca2) 00010000:00010000:0.0:1772305926.351579:0:55141:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1772305926.351593:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6fa31 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.351601:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6fa31 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.351608:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6fa31 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.351617:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6fa38 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7de90653 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.351624:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6fa38 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7de90653 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.351650:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6fa38 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7de90653 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.351687:0:55141:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6fa31 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.351694:0:55141:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6fa31 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.351701:0:55141:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6fa31 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.351706:0:55141:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c7dfb548 already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305926.351709:0:55141:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6fa31 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.351714:0:55141:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6fa31 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.351723:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:0.0:1772305926.351725:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305926.351728:0:55141:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6fa31 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.351733:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6fa31 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.351742:0:55141:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6fa38 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7de90653 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.351748:0:55141:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6fa38 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7de90653 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.351755:0:55141:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6fa38 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7de90653 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.351760:0:55141:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000f7a426e already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305926.351762:0:55141:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6fa38 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7de90653 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.351768:0:55141:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6fa38 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7de90653 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.351776:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7de90653 (00000000f605459a) 00010000:00010000:0.0:1772305926.351779:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305926.351780:0:55141:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6fa38 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7de90653 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.351786:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6fa38 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7de90653 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305926.351833:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007af21754 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:99185:x1858396225393152:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 309us (392us total) trans 0 rc -2/-2 00000100:00100000:0.0:1772305926.351841:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1067 00000100:00100000:1.0:1772305926.352525:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305926.352571:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225393216 00000100:00100000:0.0:1772305926.352606:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1068 00000100:00100000:0.0:1772305926.352611:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000de6d83ec pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:99185:x1858396225393216:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1772305926.352620:0:55141:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305926.352656:0:55141:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c6fa3f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x32d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f0b3 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.352677:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c90074c9/0xa5e9c8c58c6fa46 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x32d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.352687:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c90074c9/0xa5e9c8c58c6fa46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.352695:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c90074c9/0xa5e9c8c58c6fa46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.352753:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c6fa3f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x32d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0b3 expref: 71 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.352773:0:55141:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000c90074c9/0xa5e9c8c58c6fa46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32d:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0b3 expref: 70 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.352779:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32d:0x0].0x0 (00000000f939e468) 00010000:00010000:0.0:1772305926.352782:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1772305926.352784:0:55141:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c90074c9, rc 0) 00000100:00100000:0.0:1772305926.352814:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000de6d83ec pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+70:99185:x1858396225393216:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 202us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305926.352821:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1068 00000100:00100000:1.0:1772305926.353585:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305926.353649:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225393344 00000100:00100000:0.0:1772305926.353680:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1069 00000100:00100000:0.0:1772305926.353686:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b892b34a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+70:99185:x1858396225393344:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1772305926.353722:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000027bbef42/0xa5e9c8c58c6fa4d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x32d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.353731:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000027bbef42/0xa5e9c8c58c6fa4d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.353740:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000027bbef42/0xa5e9c8c58c6fa4d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1772305926.353848:0:55141:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000b892b34a reply state 00000000c652c71d transno 8589934930 ns: mdt-lustre-MDT0000_UUID lock: 0000000027bbef42/0xa5e9c8c58c6fa4d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305926.353909:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b892b34a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+72:99185:x1858396225393344:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 222us (325us total) trans 8589934930 rc 0/0 00000100:00100000:0.0:1772305926.353922:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1069 00010000:00010000:3.0:1772305926.354525:0:2978:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000027bbef42/0xa5e9c8c58c6fa4d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305926.354533:0:2978:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000027bbef42/0xa5e9c8c58c6fa4d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x32d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305926.354539:0:2978:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000027bbef42/0xa5e9c8c58c6fa4d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x32d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305926.354544:0:2978:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000027bbef42 already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305926.354546:0:2978:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000027bbef42/0xa5e9c8c58c6fa4d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x32d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305926.354561:0:2978:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000027bbef42/0xa5e9c8c58c6fa4d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x32d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305926.354569:0:2978:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32d:0x0].0x0 (00000000f939e468) 00010000:00010000:3.0:1772305926.354571:0:2978:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1772305926.354573:0:2978:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000027bbef42/0xa5e9c8c58c6fa4d lrc: 2/0,0 mode: --/PW res: [0x200000402:0x32d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305926.354582:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00010000:3.0:1772305926.354586:0:2978:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000027bbef42/0xa5e9c8c58c6fa4d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x32d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305926.354650:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225393408 00000100:00100000:0.0:1772305926.354684:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1070 00000100:00100000:0.0:1772305926.354690:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006441cdff pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+71:99185:x1858396225393408:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1772305926.354702:0:55141:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305926.354711:0:55141:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000003bb10b1c/0xa5e9c8c58c6fa54 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x32d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f0ba expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.354737:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000003bb10b1c/0xa5e9c8c58c6fa54 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0ba expref: 72 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.354746:0:55141:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000003bb10b1c/0xa5e9c8c58c6fa54 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0ba expref: 72 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.354754:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32d:0x0].0x0 (00000000f939e468) 00010000:00010000:0.0:1772305926.354757:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1772305926.354759:0:55141:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003bb10b1c, rc 0) 00000100:00100000:0.0:1772305926.354787:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006441cdff pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+72:99185:x1858396225393408:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 97us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305926.354794:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1070 00000100:00100000:1.0:1772305926.355521:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305926.355559:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225393472 00000100:00100000:3.0:1772305926.355593:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 132 00000100:00100000:3.0:1772305926.355599:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000020bd94b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+72:99185:x1858396225393472:12345-192.168.203.30@tcp:49:lhsmtool_posix.0 00000100:00100000:3.0:1772305926.355682:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000020bd94b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+72:99185:x1858396225393472:12345-192.168.203.30@tcp:49:lhsmtool_posix.0 Request processed in 83us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305926.355691:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 132 00000100:00100000:1.0:1772305926.356345:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305926.356402:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225393600 00000100:00100000:0.0:1772305926.356434:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1071 00000100:00100000:0.0:1772305926.356440:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d8a50734 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+72:99185:x1858396225393600:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1772305926.356496:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d8a50734 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+72:99185:x1858396225393600:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 55us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305926.356507:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1071 00000100:00100000:1.0:1772305926.357319:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305926.357365:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225393728 00000100:00100000:0.0:1772305926.357411:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1072 00000100:00100000:0.0:1772305926.357416:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ad79fcd8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+72:99185:x1858396225393728:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1772305926.357426:0:55141:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305926.357439:0:55141:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000878a11a2/0xa5e9c8c58c6fa5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f0c1 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.357490:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000073b42f2f/0xa5e9c8c58c6fa62 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x32d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.357502:0:55141:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 000000003bb10b1c/0xa5e9c8c58c6fa54 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0ba expref: 73 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.357509:0:55141:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 0000000073b42f2f/0xa5e9c8c58c6fa62 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.357538:0:55141:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 000000003bb10b1c/0xa5e9c8c58c6fa54 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0ba expref: 73 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.357552:0:55141:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 000000003bb10b1c/0xa5e9c8c58c6fa54 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0ba expref: 73 pid: 55141 timeout: 1338 lvb_type: 0 00000100:00100000:0.0:1772305926.357565:0:55141:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cc0879e3 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:55141:1858396216607616:192.168.203.30@tcp:104: 00000100:00100000:0.0:1772305926.357610:0:55141:0:(client.c:2500:ptlrpc_set_wait()) set 000000008422c11e going to sleep for 6 seconds 00000100:00100000:0.0:1772305926.358506:0:55141:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cc0879e3 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:55141:1858396216607616:192.168.203.30@tcp:104: 00010000:00010000:0.0:1772305926.358523:0:55141:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 0000000073b42f2f/0xa5e9c8c58c6fa62 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305926.358686:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305926.358725:0:16126:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225393792 00010000:00010000:3.0:1772305926.358784:0:16126:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 000000003bb10b1c/0xa5e9c8c58c6fa54 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0ba expref: 74 pid: 55141 timeout: 1338 lvb_type: 0 00000100:00100000:3.0:1772305926.358813:0:16126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3132 00000100:00100000:3.0:1772305926.358818:0:16126:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000061ae132c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+74:2215:x1858396225393792:12345-192.168.203.30@tcp:103:ldlm_bl_07.0 00010000:00010000:3.0:1772305926.358828:0:16126:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1772305926.358833:0:16126:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 000000003bb10b1c/0xa5e9c8c58c6fa54 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0ba expref: 74 pid: 55141 timeout: 1338 lvb_type: 0 00010000:00010000:3.0:1772305926.358857:0:16126:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 000000003bb10b1c/0xa5e9c8c58c6fa54 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0ba expref: 74 pid: 55141 timeout: 1338 lvb_type: 0 00010000:00010000:3.0:1772305926.358870:0:16126:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000003bb10b1c/0xa5e9c8c58c6fa54 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0ba expref: 74 pid: 55141 timeout: 1338 lvb_type: 0 00010000:00010000:3.0:1772305926.358883:0:16126:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32d:0x0].0x0 (00000000f939e468) 00010000:00010000:3.0:1772305926.358886:0:16126:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: 0000000073b42f2f/0xa5e9c8c58c6fa62 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305926.358894:0:16126:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 0000000073b42f2f/0xa5e9c8c58c6fa62 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305926.358900:0:16126:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000073b42f2f/0xa5e9c8c58c6fa62 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305926.358919:0:16126:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1772305926.358947:0:55141:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 0000000073b42f2f/0xa5e9c8c58c6fa62 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305926.358948:0:16126:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000061ae132c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+73:2215:x1858396225393792:12345-192.168.203.30@tcp:103:ldlm_bl_07.0 Request processed in 127us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305926.358964:0:16126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3132 00010000:00010000:0.0:1772305926.358964:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000073b42f2f/0xa5e9c8c58c6fa62 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305926.358979:0:55141:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x32d:0x0]: returning size 0 00000004:00080000:0.0:1772305926.359219:0:55141:0:(osp_object.c:1645:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x100010000:0x1b1:0x0], index 1: 0 00010000:00010000:0.0:1772305926.359322:0:55141:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000073b42f2f/0xa5e9c8c58c6fa62 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.359331:0:55141:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000073b42f2f/0xa5e9c8c58c6fa62 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.359338:0:55141:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000073b42f2f/0xa5e9c8c58c6fa62 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.359343:0:55141:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000073b42f2f already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305926.359347:0:55141:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000073b42f2f/0xa5e9c8c58c6fa62 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.359353:0:55141:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000073b42f2f/0xa5e9c8c58c6fa62 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.359363:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32d:0x0].0x0 (00000000f939e468) 00010000:00010000:0.0:1772305926.359366:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1772305926.359368:0:55141:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000073b42f2f/0xa5e9c8c58c6fa62 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.359396:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000073b42f2f/0xa5e9c8c58c6fa62 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.359421:0:55141:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000878a11a2/0xa5e9c8c58c6fa5b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0c1 expref: 73 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.359429:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000878a11a2/0xa5e9c8c58c6fa5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0c1 expref: 73 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.359437:0:55141:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000878a11a2, rc 0) 00000100:00100000:0.0:1772305926.359469:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ad79fcd8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+72:99185:x1858396225393728:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 2051us (2150us total) trans 8589934931 rc 301/301 00000100:00100000:0.0:1772305926.359476:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1072 00000100:00100000:1.0:1772305926.360234:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305926.360268:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225393920 00000100:00100000:3.0:1772305926.360297:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 133 00000100:00100000:3.0:1772305926.360302:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000eae1ffd6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+72:99185:x1858396225393920:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1772305926.360445:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000eae1ffd6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+73:99185:x1858396225393920:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 143us (212us total) trans 8589934932 rc 0/0 00000100:00100000:3.0:1772305926.360451:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 133 00000100:00100000:1.0:1772305926.361141:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305926.361183:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225393984 00000100:00100000:0.0:1772305926.361219:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1073 00000100:00100000:0.0:1772305926.361225:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b1d66a61 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+73:99185:x1858396225393984:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1772305926.361238:0:55141:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305926.361250:0:55141:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007c4795ba/0xa5e9c8c58c6fa70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f0c8 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.361285:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6fa77 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x32d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.361296:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6fa77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.361305:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6fa77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305926.361325:0:55141:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x32d:0x0]: returning size 0 00000004:00200000:0.0:1772305926.361328:0:55141:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1772305926.361340:0:55141:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6fa77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.361349:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6fa77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.361366:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007c4795ba/0xa5e9c8c58c6fa70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0c8 expref: 75 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.361395:0:55141:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6fa77 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0c8 expref: 74 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.361403:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32d:0x0].0x0 (00000000f939e468) 00010000:00010000:0.0:1772305926.361406:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1772305926.361408:0:55141:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000034fec1fd, rc 0) 00000100:00100000:0.0:1772305926.361441:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b1d66a61 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+74:99185:x1858396225393984:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 216us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305926.361449:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1073 00000100:00100000:1.0:1772305926.362279:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305926.362318:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225394048 00000100:00100000:0.0:1772305926.362349:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5745 00000100:00100000:0.0:1772305926.362354:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b07205c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2215:x1858396225394048:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1772305926.362362:0:21400:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305926.362373:0:21400:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6fa7e lrc: 2/0,0 mode: --/PR res: [0x1b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f0cf expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1772305926.362410:0:21400:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x1b1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1772305926.362423:0:21400:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305926.362425:0:21400:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305926.362430:0:21400:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6fa7e lrc: 3/0,0 mode: PR/PR res: [0x1b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0cf expref: 228 pid: 21400 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1772305926.362441:0:21400:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6fa7e lrc: 3/0,0 mode: PR/PR res: [0x1b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0cf expref: 228 pid: 21400 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1772305926.362452:0:21400:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fd93d0b1, rc 0) 00000100:00100000:0.0:1772305926.362487:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b07205c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+228:2215:x1858396225394048:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 131us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305926.362494:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5745 00000100:00100000:1.0:1772305926.363279:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305926.363316:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225394176 00000100:00100000:0.0:1772305926.363341:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1074 00000100:00100000:0.0:1772305926.363345:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a1cffce8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+74:99185:x1858396225394176:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1772305926.363406:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a1cffce8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+74:99185:x1858396225394176:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 59us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305926.363413:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1074 00000100:00100000:1.0:1772305926.364815:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305926.364852:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225394240 00000100:00100000:0.0:1772305926.364880:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5746 00000100:00100000:0.0:1772305926.364886:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004f8db88b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+228:99185:x1858396225394240:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1772305926.364896:0:21400:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305926.364920:0:21400:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6fa85 lrc: 2/0,0 mode: --/PW res: [0x1b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f0d6 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.364946:0:21400:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6fa7e lrc: 2/0,0 mode: PR/PR res: [0x1b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0cf expref: 229 pid: 21400 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1772305926.364954:0:21400:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305926.364956:0:21400:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305926.364958:0:21400:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6fa85 lrc: 4/0,0 mode: --/PW res: [0x1b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0d6 expref: 229 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.364982:0:21400:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6fa7e lrc: 3/0,0 mode: PR/PR res: [0x1b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0cf expref: 229 pid: 21400 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1772305926.364991:0:21400:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6fa7e lrc: 4/0,0 mode: PR/PR res: [0x1b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0cf expref: 229 pid: 21400 timeout: 1338 lvb_type: 1 00000100:00100000:0.0:1772305926.365000:0:21400:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cc0879e3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:21400:1858396216607680:192.168.203.30@tcp:104: 00000100:00100000:0.0:1772305926.365049:0:21400:0:(client.c:2500:ptlrpc_set_wait()) set 000000008422c11e going to sleep for 6 seconds 00000100:00100000:0.0:1772305926.365813:0:21400:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cc0879e3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:21400:1858396216607680:192.168.203.30@tcp:104: 00010000:00010000:0.0:1772305926.365835:0:21400:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6fa85 lrc: 3/0,0 mode: --/PW res: [0x1b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0d6 expref: 229 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.365847:0:21400:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000082c88ffe, rc 0) 00000100:00100000:0.0:1772305926.365879:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004f8db88b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+229:99185:x1858396225394240:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 993us (1066us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305926.365888:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5746 00000100:00100000:1.0:1772305926.365962:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305926.366019:0:16126:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225394304 00010000:00010000:3.0:1772305926.366035:0:16126:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6fa7e lrc: 4/0,0 mode: PR/PR res: [0x1b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0cf expref: 229 pid: 21400 timeout: 1338 lvb_type: 1 00000100:00100000:3.0:1772305926.366056:0:16126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3133 00000100:00100000:3.0:1772305926.366061:0:16126:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005905500f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+229:2215:x1858396225394304:12345-192.168.203.30@tcp:103:ldlm_bl_08.0 00010000:00010000:3.0:1772305926.366068:0:16126:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1772305926.366081:0:16126:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6fa7e lrc: 4/0,0 mode: PR/PR res: [0x1b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0cf expref: 229 pid: 21400 timeout: 1338 lvb_type: 1 00010000:00010000:3.0:1772305926.366088:0:16126:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6fa7e lrc: 3/0,0 mode: PR/PR res: [0x1b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0cf expref: 229 pid: 21400 timeout: 1338 lvb_type: 1 00010000:00010000:3.0:1772305926.366101:0:16126:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6fa7e lrc: 0/0,0 mode: --/PR res: [0x1b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0cf expref: 229 pid: 21400 timeout: 1338 lvb_type: 1 00010000:00010000:3.0:1772305926.366109:0:16126:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1772305926.366111:0:16126:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1772305926.366115:0:16126:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6fa85 lrc: 2/0,0 mode: PW/PW res: [0x1b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0d6 expref: 228 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305926.366120:0:16126:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6fa85 lrc: 3/0,0 mode: PW/PW res: [0x1b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0d6 expref: 228 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305926.366136:0:16126:0:(ldlm_lockd.c:1069:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6fa85 lrc: 3/0,0 mode: PW/PW res: [0x1b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0d6 expref: 228 pid: 21400 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305926.366142:0:16126:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000216f6f28 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16126:1858396216607744:192.168.203.30@tcp:105: 00000100:00100000:3.0:1772305926.366181:0:16126:0:(client.c:2500:ptlrpc_set_wait()) set 000000007e2ab3fb going to sleep for 6 seconds 00000100:00100000:3.0:1772305926.366886:0:16126:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000216f6f28 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16126:1858396216607744:192.168.203.30@tcp:105: 00010000:00010000:3.0:1772305926.366896:0:16126:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1772305926.366918:0:16126:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005905500f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+228:2215:x1858396225394304:12345-192.168.203.30@tcp:103:ldlm_bl_08.0 Request processed in 857us (958us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305926.366923:0:16126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3133 00000100:00100000:1.0:1772305926.374253:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305926.374341:0:21399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225394432 00002000:00100000:0.0:1772305926.374387:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x100010000:0x1b1:0x0] (0->1048575) req@00000000e2528daf x1858396225394432/t0(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:57/0 lens 488/0 e 0 to 0 dl 1772305932 ref 1 fl New:/0/ffffffff rc 0/-1 job:'lhsmtool_posix.0' 00002000:00100000:0.0:1772305926.374397:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 00000000e2528daf with x1858396225394432 ext(0->1048575) 00002000:00010000:0.0:1772305926.374401:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000e2528daf 00000100:00100000:0.0:1772305926.374429:0:21399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2048 00000100:00100000:0.0:1772305926.374436:0:21399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e2528daf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+228:2216:x1858396225394432:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1772305926.380998:0:21399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e2528daf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2216:x1858396225394432:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 Request processed in 6557us (6744us total) trans 4294968348 rc 0/0 00000100:00100000:0.0:1772305926.381009:0:21399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2048 00002000:00100000:0.0:1772305926.381019:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x100010000:0x1b1:0x0] (0->1048575) req@00000000e2528daf x1858396225394432/t4294968348(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:57/0 lens 488/448 e 0 to 0 dl 1772305932 ref 1 fl Complete:/0/0 rc 0/0 job:'lhsmtool_posix.0' 00002000:00100000:0.0:1772305926.381027:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 00000000e2528daf with x1858396225394432 ext(0->1048575) 00002000:00010000:0.0:1772305926.381032:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000e2528daf 00000100:00100000:1.0:1772305926.382259:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305926.382307:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225394496 00000100:00100000:0.0:1772305926.382340:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1075 00000100:00100000:0.0:1772305926.382344:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005dcbb4b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+74:99185:x1858396225394496:12345-192.168.203.30@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1772305926.391605:0:70221:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934931 is committed 00000001:00080000:2.0:1772305926.391624:0:70221:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934926 is committed 00000020:00080000:2.0:1772305926.391660:0:70221:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt 000000004b452d21 refcount 2 committed 0 result 0 batchid 4295052955 00000020:00080000:2.0:1772305926.391664:0:70221:0:(update_trans.c:89:top_multiple_thandle_dump()) st 000000009eb8c4ba obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th 00000000ac769cb3 00000020:00080000:2.0:1772305926.391667:0:70221:0:(update_trans.c:89:top_multiple_thandle_dump()) st 0000000004954f50 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th 00000000ba946379 00000001:00080000:3.0:1772305926.391680:0:54724:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934928 is committed 00000100:00100000:0.0:1772305926.391685:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005dcbb4b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+70:99185:x1858396225394496:12345-192.168.203.30@tcp:44:lhsmtool_posix.0 Request processed in 9337us (9425us total) trans 0 rc 0/0 00000001:00080000:2.0:1772305926.391689:0:70221:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934932 is committed 00000100:00100000:0.0:1772305926.391696:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1075 00000020:00080000:1.0:1772305926.391700:0:54735:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4295052955 committed batchid 4295052953 00000020:00080000:2.0:1772305926.391721:0:70221:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt 0000000066369f5c refcount 2 committed 0 result 0 batchid 4295052956 00000020:00080000:2.0:1772305926.391724:0:70221:0:(update_trans.c:89:top_multiple_thandle_dump()) st 00000000691322c6 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th 0000000009991d09 00000020:00080000:2.0:1772305926.391727:0:70221:0:(update_trans.c:89:top_multiple_thandle_dump()) st 0000000063ee7da8 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th 000000007fbfffbd 00000020:00080000:3.0:1772305926.391745:0:54724:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 4295052954 batchid updated 00000020:00080000:1.0:1772305926.391860:0:54735:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4295052956 committed batchid 4295052954 00000020:00080000:1.0:1772305926.391880:0:54735:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4295052954 00000100:00100000:2.0:1772305926.393267:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305926.393312:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225394560 00000100:00100000:0.0:1772305926.393344:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5747 00000100:00100000:0.0:1772305926.393349:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003bce9793 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2215:x1858396225394560:12345-192.168.203.30@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1772305926.402688:0:7114:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-OST0001: transno 4294968348 is committed 00000100:00100000:0.0:1772305926.402729:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003bce9793 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+228:2215:x1858396225394560:12345-192.168.203.30@tcp:16:lhsmtool_posix.0 Request processed in 9377us (9461us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305926.402743:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5747 00000100:00100000:1.0:1772305926.403986:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305926.404037:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225394688 00000100:00100000:0.0:1772305926.404070:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1076 00000100:00100000:0.0:1772305926.404075:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009ef3a710 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+68:99185:x1858396225394688:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1772305926.404112:0:55141:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1772305926.404133:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6fa77 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x32d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0c8 expref: 68 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.404150:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32d:0x0].0x0 (00000000f939e468) 00010000:00010000:0.0:1772305926.404155:0:55141:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1772305926.404181:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c6fa8c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x32d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.404195:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c6fa8c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.404204:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c6fa8c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.404219:0:55141:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c6fa8c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.404223:0:55141:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c6fa8c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x32d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.404228:0:55141:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c6fa8c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x32d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.404235:0:55141:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000004820b6c already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305926.404238:0:55141:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c6fa8c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x32d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.404242:0:55141:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c6fa8c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x32d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.404247:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32d:0x0].0x0 (00000000f939e468) 00010000:00010000:0.0:1772305926.404248:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305926.404250:0:55141:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c6fa8c lrc: 2/0,0 mode: --/PW res: [0x200000402:0x32d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.404253:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c6fa8c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x32d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305926.404308:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009ef3a710 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+67:99185:x1858396225394688:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 232us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305926.404313:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1076 00000100:00100000:1.0:1772305926.405050:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305926.405082:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225394752 00000100:00100000:0.0:1772305926.405107:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1077 00000100:00100000:0.0:1772305926.405111:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007776dfe8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+67:99185:x1858396225394752:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1772305926.405119:0:55141:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305926.405128:0:55141:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6fa93 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x32d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f0dd expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.405159:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6fa93 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0dd expref: 68 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.405177:0:55141:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6fa93 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0dd expref: 68 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.405194:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32d:0x0].0x0 (00000000f939e468) 00010000:00010000:0.0:1772305926.405197:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1772305926.405199:0:55141:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000f7a426e, rc 0) 00000100:00100000:0.0:1772305926.405225:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007776dfe8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+68:99185:x1858396225394752:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 113us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305926.405230:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1077 00000100:00100000:2.0:1772305926.406086:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305926.406131:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225394816 00000100:00100000:0.0:1772305926.406166:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5748 00000100:00100000:0.0:1772305926.406173:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003b46920d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+228:2216:x1858396225394816:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1772305926.406362:0:21400:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x1b1:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:0.0:1772305926.406366:0:21400:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x1b1:0x0] updating lvb mtime from disk: 0 -> 1772305923 00002000:00010000:0.0:1772305926.406368:0:21400:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x1b1:0x0] updating lvb atime from disk: 0 -> 1772305925 00002000:00010000:0.0:1772305926.406370:0:21400:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x1b1:0x0] updating lvb ctime from disk: 0 -> 1772305923 00002000:00010000:0.0:1772305926.406372:0:21400:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x1b1:0x0] updating lvb blocks from disk: 1 -> 2051 00000100:00100000:0.0:1772305926.406430:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003b46920d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+229:2216:x1858396225394816:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 Request processed in 257us (345us total) trans 4294968349 rc 0/0 00000100:00100000:0.0:1772305926.406439:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5748 00000100:00100000:1.0:1772305926.407201:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305926.407267:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225394944 00000100:00100000:0.0:1772305926.407295:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1078 00000100:00100000:0.0:1772305926.407299:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000051e590c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+68:99185:x1858396225394944:12345-192.168.203.30@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1772305926.407324:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6fa9a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x32d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.407335:0:55141:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000c90074c9/0xa5e9c8c58c6fa46 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x32d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0b3 expref: 68 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.407341:0:55141:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6fa9a lrc: 4/0,1 mode: --/PW res: [0x200000402:0x32d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.407366:0:55141:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000c90074c9/0xa5e9c8c58c6fa46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0b3 expref: 68 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.407389:0:55141:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000c90074c9/0xa5e9c8c58c6fa46 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x32d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0b3 expref: 68 pid: 55141 timeout: 1338 lvb_type: 0 00000100:00100000:0.0:1772305926.407400:0:55141:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cc0879e3 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:55141:1858396216607808:192.168.203.30@tcp:104: 00000100:00100000:0.0:1772305926.407441:0:55141:0:(client.c:2500:ptlrpc_set_wait()) set 0000000085056515 going to sleep for 6 seconds 00000100:00100000:0.0:1772305926.408411:0:55141:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cc0879e3 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:55141:1858396216607808:192.168.203.30@tcp:104: 00010000:00010000:0.0:1772305926.408431:0:55141:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6fa9a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x32d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305926.408527:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305926.408685:0:16126:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225395008 00010000:00010000:3.0:1772305926.408709:0:16126:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c90074c9/0xa5e9c8c58c6fa46 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x32d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0b3 expref: 69 pid: 55141 timeout: 1338 lvb_type: 0 00000100:00100000:3.0:1772305926.408748:0:16126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3134 00000100:00100000:3.0:1772305926.408756:0:16126:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000c8c6a39 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:2216:x1858396225395008:12345-192.168.203.30@tcp:103:ldlm_bl_06.0 00010000:00010000:3.0:1772305926.408768:0:16126:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1772305926.408773:0:16126:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000c90074c9/0xa5e9c8c58c6fa46 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x32d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0b3 expref: 69 pid: 55141 timeout: 1338 lvb_type: 0 00010000:00010000:3.0:1772305926.408784:0:16126:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000c90074c9/0xa5e9c8c58c6fa46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0b3 expref: 69 pid: 55141 timeout: 1338 lvb_type: 0 00010000:00010000:3.0:1772305926.408800:0:16126:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c90074c9/0xa5e9c8c58c6fa46 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x32d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0b3 expref: 69 pid: 55141 timeout: 1338 lvb_type: 0 00010000:00010000:3.0:1772305926.408812:0:16126:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32d:0x0].0x0 (00000000f939e468) 00010000:00010000:3.0:1772305926.408816:0:16126:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6fa9a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x32d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305926.408843:0:16126:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6fa9a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305926.408849:0:16126:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6fa9a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x32d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305926.408874:0:16126:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1772305926.408889:0:55141:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6fa9a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.408897:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6fa9a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305926.408909:0:16126:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000c8c6a39 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+68:2216:x1858396225395008:12345-192.168.203.30@tcp:103:ldlm_bl_06.0 Request processed in 152us (382us total) trans 0 rc 0/0 00010000:00010000:0.0:1772305926.408911:0:55141:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6fa9a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.408922:0:55141:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6fa9a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x32d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305926.408929:0:16126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3134 00010000:00010000:0.0:1772305926.408932:0:55141:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6fa9a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x32d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.408938:0:55141:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c7dfb548 already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305926.408940:0:55141:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6fa9a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x32d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.408945:0:55141:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6fa9a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x32d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.408952:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32d:0x0].0x0 (00000000f939e468) 00010000:00010000:0.0:1772305926.408954:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1772305926.408957:0:55141:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6fa9a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x32d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.408961:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6fa9a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x32d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305926.408997:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000051e590c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+67:99185:x1858396225394944:12345-192.168.203.30@tcp:55:lhsmtool_posix.0 Request processed in 1697us (1799us total) trans 0 rc -22/-22 00000100:00100000:0.0:1772305926.409003:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1078 00000100:00100000:1.0:1772305926.409785:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305926.409820:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225395072 00000100:00100000:0.0:1772305926.409844:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5749 00000100:00100000:0.0:1772305926.409848:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000028c6430b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+229:2215:x1858396225395072:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1772305926.409866:0:21400:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006e08f961/0xa5e9c8c58c6faa1 lrc: 3/1,0 mode: --/PR res: [0x1b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.409877:0:21400:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6fa85 lrc: 2/0,0 mode: PW/PW res: [0x1b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0d6 expref: 229 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.409883:0:21400:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1772305926.409885:0:21400:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1772305926.409886:0:21400:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e08f961/0xa5e9c8c58c6faa1 lrc: 4/1,0 mode: --/PR res: [0x1b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.409898:0:21400:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6fa85 lrc: 3/0,0 mode: PW/PW res: [0x1b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0d6 expref: 229 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.409904:0:21400:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6fa85 lrc: 4/0,0 mode: PW/PW res: [0x1b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0d6 expref: 229 pid: 21400 timeout: 1338 lvb_type: 0 00000100:00100000:0.0:1772305926.409911:0:21400:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cc0879e3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:21400:1858396216607872:192.168.203.30@tcp:104: 00000100:00100000:0.0:1772305926.409938:0:21400:0:(client.c:2500:ptlrpc_set_wait()) set 0000000085056515 going to sleep for 6 seconds 00000100:00100000:0.0:1772305926.410582:0:21400:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cc0879e3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:21400:1858396216607872:192.168.203.30@tcp:104: 00010000:00010000:0.0:1772305926.410595:0:21400:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006e08f961/0xa5e9c8c58c6faa1 lrc: 3/1,0 mode: --/PR res: [0x1b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305926.411731:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305926.411756:0:16126:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225395136 00010000:00010000:3.0:1772305926.411770:0:16126:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6fa85 lrc: 4/0,0 mode: PW/PW res: [0x1b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0d6 expref: 230 pid: 21400 timeout: 1338 lvb_type: 0 00000100:00100000:2.0:1772305926.411819:0:5493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3135 00000100:00100000:2.0:1772305926.411826:0:5493:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000702c2a54 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2216:x1858396225395136:12345-192.168.203.30@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1772305926.411834:0:5493:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1772305926.411847:0:5493:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6fa85 lrc: 4/0,0 mode: PW/PW res: [0x1b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0d6 expref: 230 pid: 21400 timeout: 1338 lvb_type: 0 00010000:00010000:2.0:1772305926.411855:0:5493:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6fa85 lrc: 3/0,0 mode: PW/PW res: [0x1b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0d6 expref: 230 pid: 21400 timeout: 1338 lvb_type: 0 00010000:00010000:2.0:1772305926.411872:0:5493:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6fa85 lrc: 0/0,0 mode: --/PW res: [0x1b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0d6 expref: 230 pid: 21400 timeout: 1338 lvb_type: 0 00010000:00010000:2.0:1772305926.411884:0:5493:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1772305926.411886:0:5493:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1772305926.411888:0:5493:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006e08f961/0xa5e9c8c58c6faa1 lrc: 3/1,0 mode: PR/PR res: [0x1b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305926.411903:0:5493:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e08f961/0xa5e9c8c58c6faa1 lrc: 4/1,0 mode: PR/PR res: [0x1b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305926.411928:0:5493:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1772305926.411962:0:5493:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000702c2a54 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+229:2216:x1858396225395136:12345-192.168.203.30@tcp:103:ldlm_bl_03.0 Request processed in 135us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305926.411970:0:5493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3135 00010000:00010000:0.0:1772305926.411982:0:21400:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006e08f961/0xa5e9c8c58c6faa1 lrc: 3/1,0 mode: PR/PR res: [0x1b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.411992:0:21400:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e08f961/0xa5e9c8c58c6faa1 lrc: 3/1,0 mode: PR/PR res: [0x1b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.412008:0:21400:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006e08f961/0xa5e9c8c58c6faa1 lrc: 3/1,0 mode: PR/PR res: [0x1b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.412017:0:21400:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e08f961/0xa5e9c8c58c6faa1 lrc: 2/0,0 mode: PR/PR res: [0x1b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.412036:0:21400:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1772305926.412053:0:38581:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1772305926.412058:0:38581:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e08f961/0xa5e9c8c58c6faa1 lrc: 2/0,0 mode: PR/PR res: [0x1b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305926.412065:0:38581:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006e08f961 already unused, calling callback (00000000b5e4f3c0) 00010000:00010000:3.0:1772305926.412068:0:38581:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e08f961/0xa5e9c8c58c6faa1 lrc: 2/0,0 mode: PR/PR res: [0x1b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305926.412072:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000028c6430b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+228:2215:x1858396225395072:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 Request processed in 2219us (2284us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305926.412079:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5749 00010000:00010000:3.0:1772305926.412122:0:38581:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e08f961/0xa5e9c8c58c6faa1 lrc: 3/0,0 mode: PR/PR res: [0x1b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305926.412136:0:38581:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e08f961/0xa5e9c8c58c6faa1 lrc: 1/0,0 mode: --/PR res: [0x1b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305926.412155:0:38581:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e08f961/0xa5e9c8c58c6faa1 lrc: 0/0,0 mode: --/PR res: [0x1b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305926.412209:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1772305926.412210:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1772305926.412211:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772305926.412733:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305926.412764:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225395264 00000100:00100000:0.0:1772305926.412789:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1079 00000100:00100000:0.0:1772305926.412793:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ab509801 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+67:99185:x1858396225395264:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1772305926.412952:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6faa8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x32d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.412962:0:55141:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6fa93 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0dd expref: 68 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.412966:0:55141:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6faa8 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.412980:0:55141:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6fa93 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0dd expref: 68 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.412986:0:55141:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6fa93 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0dd expref: 68 pid: 55141 timeout: 1338 lvb_type: 0 00000100:00100000:0.0:1772305926.412992:0:55141:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cc0879e3 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:55141:1858396216607936:192.168.203.30@tcp:104: 00000100:00100000:0.0:1772305926.413023:0:55141:0:(client.c:2500:ptlrpc_set_wait()) set 0000000026b8db57 going to sleep for 6 seconds 00000100:00100000:0.0:1772305926.413737:0:55141:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cc0879e3 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:55141:1858396216607936:192.168.203.30@tcp:104: 00010000:00010000:0.0:1772305926.413750:0:55141:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6faa8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305926.413872:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305926.413909:0:5493:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225395328 00010000:00010000:2.0:1772305926.413926:0:5493:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6fa93 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0dd expref: 69 pid: 55141 timeout: 1338 lvb_type: 0 00000100:00100000:2.0:1772305926.413948:0:5493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3136 00000100:00100000:2.0:1772305926.413951:0:5493:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000eb98a4bb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:2215:x1858396225395328:12345-192.168.203.30@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1772305926.413958:0:5493:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1772305926.413962:0:5493:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6fa93 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0dd expref: 69 pid: 55141 timeout: 1338 lvb_type: 0 00010000:00010000:2.0:1772305926.413970:0:5493:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6fa93 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0dd expref: 69 pid: 55141 timeout: 1338 lvb_type: 0 00010000:00010000:2.0:1772305926.413979:0:5493:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6fa93 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0dd expref: 69 pid: 55141 timeout: 1338 lvb_type: 0 00010000:00010000:2.0:1772305926.413988:0:5493:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32d:0x0].0x0 (00000000f939e468) 00010000:00010000:2.0:1772305926.413991:0:5493:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6faa8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305926.414000:0:5493:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6faa8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305926.414004:0:5493:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6faa8 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305926.414019:0:5493:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1772305926.414039:0:55141:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6faa8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305926.414043:0:5493:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000eb98a4bb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+68:2215:x1858396225395328:12345-192.168.203.30@tcp:103:ldlm_bl_01.0 Request processed in 88us (172us total) trans 0 rc 0/0 00010000:00010000:0.0:1772305926.414056:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6faa8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305926.414059:0:5493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3136 00000001:00080000:0.0:1772305926.414157:0:55141:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934933 00000001:00080000:0.0:1772305926.414261:0:55141:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934933 00000001:00080000:0.0:1772305926.414287:0:55141:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934933 00000100:00100000:0.0:1772305926.414328:0:55141:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cc0879e3 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:55141:1858396216608000:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1772305926.414355:0:55141:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772305926.414372:0:55141:0:(client.c:2500:ptlrpc_set_wait()) set 00000000d46a6988 going to sleep for 6 seconds 00000100:00100000:2.0:1772305926.414403:0:57220:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216608000 00000100:00100000:2.0:1772305926.414436:0:57220:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1772305926.414442:0:57220:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000015c5a7c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:55141:x1858396216608000:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1772305926.414511:0:57220:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000015c5a7c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:55141:x1858396216608000:12345-0@lo:1000:mdt00_003.0 Request processed in 69us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305926.414519:0:57220:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1772305926.414545:0:55141:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cc0879e3 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:55141:1858396216608000:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1772305926.414693:0:55141:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934933 00000100:00100000:0.0:1772305926.414718:0:55141:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cc0879e3 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:55141:1858396216608064:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1772305926.414740:0:55141:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772305926.414754:0:55141:0:(client.c:2500:ptlrpc_set_wait()) set 0000000026b8db57 going to sleep for 6 seconds 00000100:00100000:2.0:1772305926.414770:0:57220:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216608064 00000100:00100000:2.0:1772305926.414791:0:57220:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1772305926.414795:0:57220:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001e5c0b12 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:55141:x1858396216608064:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1772305926.414918:0:57220:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001e5c0b12 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:55141:x1858396216608064:12345-0@lo:1000:mdt00_003.0 Request processed in 121us (176us total) trans 4294968350 rc 0/0 00000100:00100000:2.0:1772305926.414926:0:57220:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1772305926.414954:0:55141:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cc0879e3 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:55141:1858396216608064:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1772305926.414998:0:55141:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934933 00010000:00010000:0.0:1772305926.415005:0:55141:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6faa8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.415012:0:55141:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6faa8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.415016:0:55141:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6faa8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.415020:0:55141:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000001e903b7f already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305926.415022:0:55141:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6faa8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.415025:0:55141:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6faa8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.415031:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32d:0x0].0x0 (00000000f939e468) 00010000:00010000:0.0:1772305926.415033:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1772305926.415035:0:55141:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6faa8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.415038:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6faa8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.415053:0:55141:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c6f9f9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.415057:0:55141:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c6f9f9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.415060:0:55141:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c6f9f9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.415063:0:55141:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000063369192 already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305926.415065:0:55141:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c6f9f9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.415069:0:55141:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c6f9f9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000020 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.415073:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32b:0x0].0x0 (0000000076ea1b5e) 00010000:00010000:0.0:1772305926.415075:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1772305926.415078:0:55141:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6fa00 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0a5 expref: 55 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.415082:0:55141:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6fa00 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0a5 expref: 55 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.415087:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6fa00 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0a5 expref: 55 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.415101:0:55141:0:(ldlm_lockd.c:1069:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6fa00 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0a5 expref: 55 pid: 55141 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305926.415108:0:55141:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000c3382b3 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:55141:1858396216608128:192.168.203.30@tcp:105: 00000100:00100000:0.0:1772305926.415136:0:55141:0:(client.c:2500:ptlrpc_set_wait()) set 0000000026b8db57 going to sleep for 6 seconds 00000100:00100000:0.0:1772305926.416035:0:55141:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000c3382b3 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:55141:1858396216608128:192.168.203.30@tcp:105: 00010000:00010000:0.0:1772305926.416045:0:55141:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c6f9f9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.416050:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c6f9f9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.416063:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c6faaf lrc: 3/0,1 mode: --/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.416069:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c6faaf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.416074:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c6faaf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.416079:0:55141:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c6faaf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.416082:0:55141:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c6faaf lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.416086:0:55141:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c6faaf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.416089:0:55141:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000004820b6c already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305926.416090:0:55141:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c6faaf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.416093:0:55141:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c6faaf lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.416098:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32b:0x0].0x0 (0000000076ea1b5e) 00010000:00010000:0.0:1772305926.416099:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305926.416100:0:55141:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c6faaf lrc: 2/0,0 mode: --/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.416104:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c6faaf lrc: 0/0,0 mode: --/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1772305926.416159:0:55141:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772305926.416162:0:55141:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000100:00100000:1.0:1772305926.416213:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000040:00080000:0.0:1772305926.416269:0:55141:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 42 count 14 00000040:00080000:0.0:1772305926.416276:0:55141:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:3.0:1772305926.416310:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225395392 00000100:00100000:0.0:1772305926.416336:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ab509801 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+67:99185:x1858396225395264:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 3541us (3603us total) trans 8589934933 rc 0/0 00000100:00100000:0.0:1772305926.416347:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1079 00000100:00100000:3.0:1772305926.416398:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 134 00000040:00080000:1.0:1772305926.416406:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000100:00100000:3.0:1772305926.416408:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006cb6ea35 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+56:99183:x1858396225395392:12345-192.168.203.30@tcp:49:tar.0 00000040:00080000:1.0:1772305926.416410:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000100:00100000:3.0:1772305926.416591:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006cb6ea35 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+56:99183:x1858396225395392:12345-192.168.203.30@tcp:49:tar.0 Request processed in 183us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305926.416601:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 134 00000040:00080000:1.0:1772305926.416842:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 14 00000040:00080000:1.0:1772305926.416848:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:1.0:1772305926.417265:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305926.417295:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225395520 00000100:00100000:3.0:1772305926.417328:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 135 00000100:00100000:3.0:1772305926.417333:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002e3a97d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+67:99185:x1858396225395520:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1772305926.417545:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305926.417587:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225395584 00000100:00100000:0.0:1772305926.417619:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5750 00000100:00100000:0.0:1772305926.417624:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000873b4f3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f935b4d0-e17f-49c8-8011-4be99ba75430+141:99183:x1858396225395584:12345-192.168.203.30@tcp:101:tar.0 00010000:00010000:0.0:1772305926.417656:0:21400:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305926.417672:0:21400:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6fab6 lrc: 2/0,0 mode: --/PR res: [0x1b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f0e4 expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1772305926.417689:0:21400:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x1b1:0x0] initial LVB size: 1048576, mtime: 0x69a33e03, atime: 0x69a33e05, ctime: 0x69a33e03, blocks: 0x803 00010000:00010000:0.0:1772305926.417706:0:21400:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305926.417709:0:21400:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305926.417714:0:21400:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6fab6 lrc: 3/0,0 mode: PR/PR res: [0x1b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0e4 expref: 142 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.417728:0:21400:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6fab6 lrc: 3/0,0 mode: PR/PR res: [0x1b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0e4 expref: 142 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.417740:0:21400:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000034fec1fd, rc 0) 00000100:00100000:0.0:1772305926.417776:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000873b4f3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f935b4d0-e17f-49c8-8011-4be99ba75430+142:99183:x1858396225395584:12345-192.168.203.30@tcp:101:tar.0 Request processed in 149us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305926.417788:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5750 00000004:00080000:3.0:1772305926.417830:0:57054:0:(mdd_object.c:3529:mdd_close()) Object [0x200000402:0x32d:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1772305926.417956:0:57054:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934934 00010000:00010000:3.0:1772305926.417987:0:57054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c6fabd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x32d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305926.418004:0:57054:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c6fabd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446631280743258432 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305926.418016:0:57054:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c6fabd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446631280743258432 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305926.418044:0:57054:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c6fabd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x32d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446631280743258432 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305926.418052:0:57054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c6fabd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x32d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446631280743258432 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305926.418058:0:57054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c6fabd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x32d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446631280743258432 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305926.418081:0:57054:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1772305926.418105:0:5497:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1772305926.418110:0:5497:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c6fabd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x32d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446631280743258432 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.418117:0:5497:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a0648135 already unused, calling callback (00000000b5e4f3c0) 00010000:00010000:0.0:1772305926.418119:0:5497:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c6fabd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x32d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446631280743258432 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.418125:0:5497:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c6fabd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x32d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446631280743258432 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.418135:0:5497:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32d:0x0].0x0 (0000000077cfe56e) 00010000:00010000:0.0:1772305926.418137:0:5497:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1772305926.418138:0:5497:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c6fabd lrc: 1/0,0 mode: --/PW res: [0x200000402:0x32d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446631280743258432 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.418142:0:5497:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c6fabd lrc: 0/0,0 mode: --/PW res: [0x200000402:0x32d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446631280743258432 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.418155:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1772305926.418156:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1772305926.418158:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1772305926.418195:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002e3a97d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+68:99185:x1858396225395520:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 859us (929us total) trans 8589934934 rc 0/0 00000100:00100000:3.0:1772305926.418204:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 135 00000100:00100000:2.0:1772305926.418922:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305926.418961:0:21399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225395712 00002000:00100000:0.0:1772305926.418981:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x100010000:0x1b1:0x0] (0->4095) req@00000000870e476c x1858396225395712/t0(0) o3->f935b4d0-e17f-49c8-8011-4be99ba75430@192.168.203.30@tcp:57/0 lens 488/0 e 0 to 0 dl 1772305932 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tar.0' 00002000:00100000:0.0:1772305926.418988:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 00000000870e476c with x1858396225395712 ext(0->4095) 00002000:00010000:0.0:1772305926.418991:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000870e476c 00000100:00100000:0.0:1772305926.419009:0:21399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2049 00000100:00100000:0.0:1772305926.419012:0:21399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000870e476c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+142:2215:x1858396225395712:12345-192.168.203.30@tcp:3:tar.0 00000100:00100000:0.0:1772305926.419117:0:21399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000870e476c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+142:2215:x1858396225395712:12345-192.168.203.30@tcp:3:tar.0 Request processed in 103us (198us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1772305926.419122:0:21399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2049 00002000:00100000:0.0:1772305926.419126:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x100010000:0x1b1:0x0] (0->4095) req@00000000870e476c x1858396225395712/t0(0) o3->f935b4d0-e17f-49c8-8011-4be99ba75430@192.168.203.30@tcp:57/0 lens 488/4536 e 0 to 0 dl 1772305932 ref 1 fl Complete:/0/0 rc 4096/4096 job:'tar.0' 00002000:00100000:0.0:1772305926.419132:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 00000000870e476c with x1858396225395712 ext(0->4095) 00002000:00010000:0.0:1772305926.419134:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000870e476c 00000100:00100000:1.0:1772305926.421947:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305926.421987:0:21399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225395840 00002000:00100000:0.0:1772305926.422004:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x100010000:0x1b1:0x0] (4096->1048575) req@0000000020bd94b6 x1858396225395840/t0(0) o3->f935b4d0-e17f-49c8-8011-4be99ba75430@192.168.203.30@tcp:57/0 lens 488/0 e 0 to 0 dl 1772305932 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tar.0' 00002000:00100000:0.0:1772305926.422010:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 0000000020bd94b6 with x1858396225395840 ext(4096->1048575) 00002000:00010000:0.0:1772305926.422013:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000020bd94b6 00000100:00100000:0.0:1772305926.422031:0:21399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2050 00000100:00100000:0.0:1772305926.422036:0:21399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000020bd94b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+142:2217:x1858396225395840:12345-192.168.203.30@tcp:3:tar.0 00000100:00100000:0.0:1772305926.425685:0:21399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000020bd94b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+142:2217:x1858396225395840:12345-192.168.203.30@tcp:3:tar.0 Request processed in 3645us (3738us total) trans 0 rc 1044480/1044480 00000100:00100000:0.0:1772305926.425692:0:21399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2050 00002000:00100000:0.0:1772305926.425699:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x100010000:0x1b1:0x0] (4096->1048575) req@0000000020bd94b6 x1858396225395840/t0(0) o3->f935b4d0-e17f-49c8-8011-4be99ba75430@192.168.203.30@tcp:57/0 lens 488/440 e 0 to 0 dl 1772305932 ref 1 fl Complete:/0/0 rc 1044480/1044480 job:'tar.0' 00002000:00100000:0.0:1772305926.425705:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 0000000020bd94b6 with x1858396225395840 ext(4096->1048575) 00002000:00010000:0.0:1772305926.425708:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000020bd94b6 00000100:00100000:2.0:1772305926.438159:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305926.438228:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225395968 00000100:00100000:0.0:1772305926.438271:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1080 00000100:00100000:0.0:1772305926.438277:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c30d8750 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+56:99184:x1858396225395968:12345-192.168.203.30@tcp:101:tar.0 00010000:00010000:0.0:1772305926.438293:0:55141:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305926.438309:0:55141:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c6fac4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f0eb expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305926.438410:0:55141:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000408:0x8d:0x0]: returning size 11776 00010000:00010000:0.0:1772305926.438496:0:55141:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c6fac4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0eb expref: 58 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.438504:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c6fac4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0eb expref: 58 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.438513:0:55141:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000004820b6c, rc 0) 00000100:00100000:0.0:1772305926.438551:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c30d8750 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+57:99184:x1858396225395968:12345-192.168.203.30@tcp:101:tar.0 Request processed in 274us (398us total) trans 8589934935 rc 301/301 00000100:00100000:0.0:1772305926.438557:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1080 00000100:00100000:1.0:1772305926.439624:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305926.439671:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225396032 00000100:00100000:0.0:1772305926.439697:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1081 00000100:00100000:0.0:1772305926.439700:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000eae1ffd6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+57:99184:x1858396225396032:12345-192.168.203.30@tcp:101:tar.0 00010000:00010000:0.0:1772305926.439709:0:55141:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305926.439716:0:55141:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6fad2 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f0f2 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.439743:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6fad9 lrc: 3/1,0 mode: --/CR res: [0x200000408:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.439754:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6fad9 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.439763:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6fad9 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.439774:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6fae0 lrc: 3/1,0 mode: --/PR res: [0x200000408:0x8d:0x0].0xcf31a53d bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.439778:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6fae0 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8d:0x0].0xcf31a53d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.439783:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6fae0 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8d:0x0].0xcf31a53d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.439822:0:55141:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6fad9 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.439826:0:55141:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6fad9 lrc: 2/0,0 mode: CR/CR res: [0x200000408:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.439830:0:55141:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6fad9 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.439834:0:55141:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c7dfb548 already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305926.439836:0:55141:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6fad9 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.439840:0:55141:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6fad9 lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.439847:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8d:0x0].0x0 (0000000088c8ea8b) 00010000:00010000:0.0:1772305926.439849:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305926.439852:0:55141:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6fad9 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.439856:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6fad9 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.439861:0:55141:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6fae0 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8d:0x0].0xcf31a53d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.439864:0:55141:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6fae0 lrc: 2/0,0 mode: PR/PR res: [0x200000408:0x8d:0x0].0xcf31a53d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.439867:0:55141:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6fae0 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8d:0x0].0xcf31a53d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.439871:0:55141:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006e08f961 already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305926.439872:0:55141:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6fae0 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8d:0x0].0xcf31a53d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.439876:0:55141:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6fae0 lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x8d:0x0].0xcf31a53d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.439879:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8d:0x0].0xcf31a53d (00000000f939e468) 00010000:00010000:0.0:1772305926.439881:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305926.439882:0:55141:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6fae0 lrc: 2/0,0 mode: --/PR res: [0x200000408:0x8d:0x0].0xcf31a53d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.439885:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6fae0 lrc: 0/0,0 mode: --/PR res: [0x200000408:0x8d:0x0].0xcf31a53d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.439904:0:55141:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6fad2 lrc: 1/0,0 mode: --/CR res: [0x200000408:0x8d:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0f2 expref: 58 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.439910:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6fad2 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x8d:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0f2 expref: 58 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.439917:0:55141:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001e903b7f, rc 0) 00000100:00100000:0.0:1772305926.439951:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000eae1ffd6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+57:99184:x1858396225396032:12345-192.168.203.30@tcp:101:tar.0 Request processed in 250us (328us total) trans 0 rc 301/301 00000100:00100000:0.0:1772305926.439959:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1081 00000100:00100000:1.0:1772305926.440928:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305926.440970:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225396160 00000100:00100000:0.0:1772305926.440999:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1082 00000100:00100000:0.0:1772305926.441003:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000d82e3c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+57:99184:x1858396225396160:12345-192.168.203.30@tcp:36:tar.0 00010000:00010000:0.0:1772305926.441023:0:55141:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1772305926.441033:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e8ea7e31/0xa5e9c8c58c6f9cf lrc: 0/0,0 mode: --/PR res: [0x200000408:0x8d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f090 expref: 57 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.441041:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8d:0x0].0x0 (0000000088c8ea8b) 00010000:00010000:0.0:1772305926.441045:0:55141:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1772305926.441073:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6fae7 lrc: 3/0,1 mode: --/CW res: [0x200000408:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.441079:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6fae7 lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.441084:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6fae7 lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.441093:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6faee lrc: 3/0,1 mode: --/PW res: [0x200000408:0x8d:0x0].0xcf31a53d bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.441097:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6faee lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x8d:0x0].0xcf31a53d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.441101:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6faee lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x8d:0x0].0xcf31a53d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305926.441502:0:55141:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000408:0x92:0x0]: returning size 512 00010000:00010000:0.0:1772305926.441507:0:55141:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6fae7 lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.441512:0:55141:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6fae7 lrc: 2/0,0 mode: CW/CW res: [0x200000408:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.441516:0:55141:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6fae7 lrc: 3/0,0 mode: CW/CW res: [0x200000408:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.441519:0:55141:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000f7a426e already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305926.441521:0:55141:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6fae7 lrc: 3/0,0 mode: CW/CW res: [0x200000408:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.441524:0:55141:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6fae7 lrc: 4/0,0 mode: CW/CW res: [0x200000408:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.441530:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8d:0x0].0x0 (0000000029823b66) 00010000:00010000:0.0:1772305926.441531:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305926.441532:0:55141:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6fae7 lrc: 2/0,0 mode: --/CW res: [0x200000408:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.441537:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6fae7 lrc: 0/0,0 mode: --/CW res: [0x200000408:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1772305926.441545:0:55141:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000000d82e3c5 reply state 000000004c8f463d transno 8589934936 ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6faee lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x8d:0x0].0xcf31a53d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305926.441587:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000d82e3c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+58:99184:x1858396225396160:12345-192.168.203.30@tcp:36:tar.0 Request processed in 583us (662us total) trans 8589934936 rc 0/0 00000100:00100000:0.0:1772305926.441592:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1082 00010000:00010000:1.0:1772305926.442317:0:2977:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6faee lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x8d:0x0].0xcf31a53d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305926.442328:0:2977:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6faee lrc: 2/0,0 mode: PW/PW res: [0x200000408:0x8d:0x0].0xcf31a53d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305926.442336:0:2977:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6faee lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x8d:0x0].0xcf31a53d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305926.442342:0:2977:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000082c88ffe already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305926.442345:0:2977:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6faee lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x8d:0x0].0xcf31a53d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305926.442352:0:2977:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6faee lrc: 4/0,0 mode: PW/PW res: [0x200000408:0x8d:0x0].0xcf31a53d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305926.442363:0:2977:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8d:0x0].0xcf31a53d (00000000f605459a) 00010000:00010000:1.0:1772305926.442366:0:2977:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305926.442368:0:2977:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6faee lrc: 2/0,0 mode: --/PW res: [0x200000408:0x8d:0x0].0xcf31a53d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305926.442388:0:2977:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6faee lrc: 0/0,0 mode: --/PW res: [0x200000408:0x8d:0x0].0xcf31a53d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305926.442515:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305926.442563:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225396224 00000100:00100000:0.0:1772305926.442599:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1083 00000100:00100000:0.0:1772305926.442607:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006824eabf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+57:99184:x1858396225396224:12345-192.168.203.30@tcp:101:tar.0 00010000:00010000:0.0:1772305926.442618:0:55141:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305926.442666:0:55141:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6faf5 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f0f9 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.442694:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c12bdb6b/0xa5e9c8c58c6fafc lrc: 3/1,0 mode: --/CR res: [0x200000408:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.442701:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c12bdb6b/0xa5e9c8c58c6fafc lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.442706:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c12bdb6b/0xa5e9c8c58c6fafc lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.442714:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000a8209eab/0xa5e9c8c58c6fb03 lrc: 3/1,0 mode: --/PR res: [0x200000408:0x8d:0x0].0xcf31a53d bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.442722:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a8209eab/0xa5e9c8c58c6fb03 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8d:0x0].0xcf31a53d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.442726:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a8209eab/0xa5e9c8c58c6fb03 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8d:0x0].0xcf31a53d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.442765:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000466ce4ab/0xa5e9c8c58c6fb0a lrc: 3/1,0 mode: --/PR res: [0x200000408:0x92:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.442770:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000466ce4ab/0xa5e9c8c58c6fb0a lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x92:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.442773:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000466ce4ab/0xa5e9c8c58c6fb0a lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x92:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305926.442787:0:55141:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000408:0x92:0x0]: returning size 512 00000004:00200000:0.0:1772305926.442789:0:55141:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1772305926.442799:0:55141:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000466ce4ab/0xa5e9c8c58c6fb0a lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x92:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.442805:0:55141:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c12bdb6b/0xa5e9c8c58c6fafc lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.442809:0:55141:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c12bdb6b/0xa5e9c8c58c6fafc lrc: 2/0,0 mode: CR/CR res: [0x200000408:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.442813:0:55141:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c12bdb6b/0xa5e9c8c58c6fafc lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.442816:0:55141:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c12bdb6b already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305926.442818:0:55141:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c12bdb6b/0xa5e9c8c58c6fafc lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.442823:0:55141:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c12bdb6b/0xa5e9c8c58c6fafc lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.442828:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8d:0x0].0x0 (00000000b41b4871) 00010000:00010000:0.0:1772305926.442830:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305926.442831:0:55141:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c12bdb6b/0xa5e9c8c58c6fafc lrc: 2/0,0 mode: --/CR res: [0x200000408:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.442834:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c12bdb6b/0xa5e9c8c58c6fafc lrc: 0/0,0 mode: --/CR res: [0x200000408:0x8d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.442841:0:55141:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000a8209eab/0xa5e9c8c58c6fb03 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8d:0x0].0xcf31a53d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.442845:0:55141:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a8209eab/0xa5e9c8c58c6fb03 lrc: 2/0,0 mode: PR/PR res: [0x200000408:0x8d:0x0].0xcf31a53d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.442849:0:55141:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000a8209eab/0xa5e9c8c58c6fb03 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8d:0x0].0xcf31a53d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.442852:0:55141:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a8209eab already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305926.442853:0:55141:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a8209eab/0xa5e9c8c58c6fb03 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8d:0x0].0xcf31a53d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.442856:0:55141:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a8209eab/0xa5e9c8c58c6fb03 lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x8d:0x0].0xcf31a53d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.442859:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8d:0x0].0xcf31a53d (000000009cd0f8c2) 00010000:00010000:0.0:1772305926.442861:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305926.442862:0:55141:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000a8209eab/0xa5e9c8c58c6fb03 lrc: 2/0,0 mode: --/PR res: [0x200000408:0x8d:0x0].0xcf31a53d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.442866:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a8209eab/0xa5e9c8c58c6fb03 lrc: 0/0,0 mode: --/PR res: [0x200000408:0x8d:0x0].0xcf31a53d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.442880:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6faf5 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x8d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0f9 expref: 59 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.442888:0:55141:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000466ce4ab/0xa5e9c8c58c6fb0a lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x92:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0f9 expref: 58 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.442892:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x92:0x0].0x0 (000000000c14a94e) 00010000:00010000:0.0:1772305926.442893:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1772305926.442895:0:55141:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000466ce4ab, rc 0) 00000100:00100000:0.0:1772305926.442924:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006824eabf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+58:99184:x1858396225396224:12345-192.168.203.30@tcp:101:tar.0 Request processed in 318us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305926.442932:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1083 00000100:00100000:2.0:1772305926.443684:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305926.443716:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225396352 00000100:00100000:0.0:1772305926.443740:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1084 00000100:00100000:0.0:1772305926.443744:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008066f4bf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+58:99184:x1858396225396352:12345-192.168.203.30@tcp:36:tar.0 00010000:00010000:0.0:1772305926.443786:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d05ed1ee/0xa5e9c8c58c6fb11 lrc: 3/0,1 mode: --/CW res: [0x200000408:0x92:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.443794:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d05ed1ee/0xa5e9c8c58c6fb11 lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x92:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.443799:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d05ed1ee/0xa5e9c8c58c6fb11 lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x92:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.443806:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f90c3eda/0xa5e9c8c58c6fb18 lrc: 3/0,1 mode: --/PW res: [0x200000408:0x92:0x0].0xcd1d5780 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.443810:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f90c3eda/0xa5e9c8c58c6fb18 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x92:0x0].0xcd1d5780 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.443814:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f90c3eda/0xa5e9c8c58c6fb18 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x92:0x0].0xcd1d5780 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305926.444073:0:55141:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000408:0x93:0x0]: returning size 512 00010000:00010000:0.0:1772305926.444077:0:55141:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d05ed1ee/0xa5e9c8c58c6fb11 lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x92:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.444082:0:55141:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d05ed1ee/0xa5e9c8c58c6fb11 lrc: 2/0,0 mode: CW/CW res: [0x200000408:0x92:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.444085:0:55141:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d05ed1ee/0xa5e9c8c58c6fb11 lrc: 3/0,0 mode: CW/CW res: [0x200000408:0x92:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.444089:0:55141:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d05ed1ee already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305926.444090:0:55141:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d05ed1ee/0xa5e9c8c58c6fb11 lrc: 3/0,0 mode: CW/CW res: [0x200000408:0x92:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.444094:0:55141:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d05ed1ee/0xa5e9c8c58c6fb11 lrc: 4/0,0 mode: CW/CW res: [0x200000408:0x92:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.444100:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x92:0x0].0x0 (000000000c14a94e) 00010000:00010000:0.0:1772305926.444101:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305926.444102:0:55141:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d05ed1ee/0xa5e9c8c58c6fb11 lrc: 2/0,0 mode: --/CW res: [0x200000408:0x92:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.444106:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d05ed1ee/0xa5e9c8c58c6fb11 lrc: 0/0,0 mode: --/CW res: [0x200000408:0x92:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1772305926.444113:0:55141:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000008066f4bf reply state 00000000bd8ca373 transno 8589934937 ns: mdt-lustre-MDT0000_UUID lock: 00000000f90c3eda/0xa5e9c8c58c6fb18 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x92:0x0].0xcd1d5780 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305926.444151:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008066f4bf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+60:99184:x1858396225396352:12345-192.168.203.30@tcp:36:tar.0 Request processed in 407us (469us total) trans 8589934937 rc 0/0 00000100:00100000:0.0:1772305926.444156:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1084 00010000:00010000:3.0:1772305926.444740:0:2978:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f90c3eda/0xa5e9c8c58c6fb18 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x92:0x0].0xcd1d5780 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305926.444756:0:2978:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f90c3eda/0xa5e9c8c58c6fb18 lrc: 2/0,0 mode: PW/PW res: [0x200000408:0x92:0x0].0xcd1d5780 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305926.444762:0:2978:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f90c3eda/0xa5e9c8c58c6fb18 lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x92:0x0].0xcd1d5780 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305926.444766:0:2978:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f90c3eda already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305926.444769:0:2978:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f90c3eda/0xa5e9c8c58c6fb18 lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x92:0x0].0xcd1d5780 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305926.444773:0:2978:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f90c3eda/0xa5e9c8c58c6fb18 lrc: 4/0,0 mode: PW/PW res: [0x200000408:0x92:0x0].0xcd1d5780 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305926.444814:0:2978:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x92:0x0].0xcd1d5780 (000000005046deb8) 00010000:00010000:3.0:1772305926.444816:0:2978:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305926.444819:0:2978:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f90c3eda/0xa5e9c8c58c6fb18 lrc: 2/0,0 mode: --/PW res: [0x200000408:0x92:0x0].0xcd1d5780 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305926.444824:0:2978:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f90c3eda/0xa5e9c8c58c6fb18 lrc: 0/0,0 mode: --/PW res: [0x200000408:0x92:0x0].0xcd1d5780 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305926.445025:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305926.445059:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225396416 00000100:00100000:0.0:1772305926.445085:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1085 00000100:00100000:0.0:1772305926.445089:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a6b9f11f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+59:99184:x1858396225396416:12345-192.168.203.30@tcp:101:tar.0 00010000:00010000:0.0:1772305926.445100:0:55141:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305926.445110:0:55141:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c80483f6/0xa5e9c8c58c6fb1f lrc: 2/0,0 mode: --/CR res: [0x200000408:0x92:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f100 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.445130:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000dc2935b7/0xa5e9c8c58c6fb26 lrc: 3/1,0 mode: --/CR res: [0x200000408:0x92:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.445136:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000dc2935b7/0xa5e9c8c58c6fb26 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x92:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.445142:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000dc2935b7/0xa5e9c8c58c6fb26 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x92:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.445148:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000cf20b42a/0xa5e9c8c58c6fb2d lrc: 3/1,0 mode: --/PR res: [0x200000408:0x92:0x0].0xcd1d5780 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.445156:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cf20b42a/0xa5e9c8c58c6fb2d lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x92:0x0].0xcd1d5780 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.445160:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cf20b42a/0xa5e9c8c58c6fb2d lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x92:0x0].0xcd1d5780 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.445208:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000a06418df/0xa5e9c8c58c6fb34 lrc: 3/1,0 mode: --/PR res: [0x200000408:0x93:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.445217:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a06418df/0xa5e9c8c58c6fb34 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x93:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.445224:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a06418df/0xa5e9c8c58c6fb34 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x93:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305926.445243:0:55141:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000408:0x93:0x0]: returning size 512 00000004:00200000:0.0:1772305926.445245:0:55141:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1772305926.445255:0:55141:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000a06418df/0xa5e9c8c58c6fb34 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x93:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.445260:0:55141:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000dc2935b7/0xa5e9c8c58c6fb26 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x92:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.445264:0:55141:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000dc2935b7/0xa5e9c8c58c6fb26 lrc: 2/0,0 mode: CR/CR res: [0x200000408:0x92:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.445269:0:55141:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000dc2935b7/0xa5e9c8c58c6fb26 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x92:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.445272:0:55141:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000dc2935b7 already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305926.445274:0:55141:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000dc2935b7/0xa5e9c8c58c6fb26 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x92:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.445279:0:55141:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000dc2935b7/0xa5e9c8c58c6fb26 lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x92:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.445284:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x92:0x0].0x0 (000000000c14a94e) 00010000:00010000:0.0:1772305926.445286:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305926.445288:0:55141:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000dc2935b7/0xa5e9c8c58c6fb26 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x92:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.445291:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000dc2935b7/0xa5e9c8c58c6fb26 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x92:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.445298:0:55141:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000cf20b42a/0xa5e9c8c58c6fb2d lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x92:0x0].0xcd1d5780 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.445302:0:55141:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cf20b42a/0xa5e9c8c58c6fb2d lrc: 2/0,0 mode: PR/PR res: [0x200000408:0x92:0x0].0xcd1d5780 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.445305:0:55141:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cf20b42a/0xa5e9c8c58c6fb2d lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x92:0x0].0xcd1d5780 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.445308:0:55141:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cf20b42a already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305926.445309:0:55141:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cf20b42a/0xa5e9c8c58c6fb2d lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x92:0x0].0xcd1d5780 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.445313:0:55141:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cf20b42a/0xa5e9c8c58c6fb2d lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x92:0x0].0xcd1d5780 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.445316:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x92:0x0].0xcd1d5780 (000000003892ce01) 00010000:00010000:0.0:1772305926.445318:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305926.445319:0:55141:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cf20b42a/0xa5e9c8c58c6fb2d lrc: 2/0,0 mode: --/PR res: [0x200000408:0x92:0x0].0xcd1d5780 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.445323:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cf20b42a/0xa5e9c8c58c6fb2d lrc: 0/0,0 mode: --/PR res: [0x200000408:0x92:0x0].0xcd1d5780 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.445338:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c80483f6/0xa5e9c8c58c6fb1f lrc: 0/0,0 mode: --/CR res: [0x200000408:0x92:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f100 expref: 61 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.445344:0:55141:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000a06418df/0xa5e9c8c58c6fb34 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x93:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f100 expref: 60 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.445348:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x93:0x0].0x0 (0000000010da78e2) 00010000:00010000:0.0:1772305926.445350:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1772305926.445351:0:55141:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a06418df, rc 0) 00000100:00100000:0.0:1772305926.445389:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a6b9f11f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+60:99184:x1858396225396416:12345-192.168.203.30@tcp:101:tar.0 Request processed in 298us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305926.445394:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1085 00000100:00100000:1.0:1772305926.446419:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305926.446456:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225396544 00000100:00100000:0.0:1772305926.446480:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1086 00000100:00100000:0.0:1772305926.446483:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000097325d89 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+60:99184:x1858396225396544:12345-192.168.203.30@tcp:101:tar.0 00010000:00010000:0.0:1772305926.446491:0:55141:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305926.446500:0:55141:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000002baedb3/0xa5e9c8c58c6fb3b lrc: 2/0,0 mode: --/CW res: [0x200000408:0x93:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f107 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.446568:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000869c9ee7/0xa5e9c8c58c6fb42 lrc: 3/0,1 mode: --/CW res: [0x200000408:0x93:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.446578:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000869c9ee7/0xa5e9c8c58c6fb42 lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x93:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.446583:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000869c9ee7/0xa5e9c8c58c6fb42 lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x93:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.446591:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000047eac72e/0xa5e9c8c58c6fb49 lrc: 3/0,1 mode: --/PW res: [0x200000408:0x93:0x0].0x6325532c bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.446595:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000047eac72e/0xa5e9c8c58c6fb49 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x93:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.446599:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000047eac72e/0xa5e9c8c58c6fb49 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x93:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1772305926.446969:0:55141:0:(osp_object.c:1645:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x100000000:0x1b1:0x0], index 0: 0 00010000:00010000:0.0:1772305926.447055:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fb50 lrc: 3/1,0 mode: --/CR res: [0x200000408:0x94:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.447061:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fb50 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x94:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.447066:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fb50 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x94:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.447083:0:55141:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000869c9ee7/0xa5e9c8c58c6fb42 lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x93:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.447087:0:55141:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000869c9ee7/0xa5e9c8c58c6fb42 lrc: 2/0,0 mode: CW/CW res: [0x200000408:0x93:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.447092:0:55141:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000869c9ee7/0xa5e9c8c58c6fb42 lrc: 3/0,0 mode: CW/CW res: [0x200000408:0x93:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.447095:0:55141:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000869c9ee7 already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305926.447097:0:55141:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000869c9ee7/0xa5e9c8c58c6fb42 lrc: 3/0,0 mode: CW/CW res: [0x200000408:0x93:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.447100:0:55141:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000869c9ee7/0xa5e9c8c58c6fb42 lrc: 4/0,0 mode: CW/CW res: [0x200000408:0x93:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.447105:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x93:0x0].0x0 (0000000010da78e2) 00010000:00010000:0.0:1772305926.447106:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305926.447107:0:55141:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000869c9ee7/0xa5e9c8c58c6fb42 lrc: 2/0,0 mode: --/CW res: [0x200000408:0x93:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.447110:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000869c9ee7/0xa5e9c8c58c6fb42 lrc: 0/0,0 mode: --/CW res: [0x200000408:0x93:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1772305926.447116:0:55141:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000097325d89 reply state 0000000027b0307c transno 8589934938 ns: mdt-lustre-MDT0000_UUID lock: 0000000047eac72e/0xa5e9c8c58c6fb49 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x93:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.447128:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000002baedb3/0xa5e9c8c58c6fb3b lrc: 0/0,0 mode: --/CW res: [0x200000408:0x93:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f107 expref: 63 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.447135:0:55141:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fb50 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x94:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f107 expref: 62 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.447139:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x94:0x0].0x0 (00000000d18b8883) 00010000:00010000:0.0:1772305926.447141:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1772305926.447142:0:55141:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c571a25b, rc 0) 00000100:00100000:0.0:1772305926.447170:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000097325d89 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+63:99184:x1858396225396544:12345-192.168.203.30@tcp:101:tar.0 Request processed in 685us (753us total) trans 8589934938 rc 0/0 00000100:00100000:0.0:1772305926.447177:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1086 00010000:00010000:2.0:1772305926.447778:0:2977:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000047eac72e/0xa5e9c8c58c6fb49 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x93:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305926.447786:0:2977:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000047eac72e/0xa5e9c8c58c6fb49 lrc: 2/0,0 mode: PW/PW res: [0x200000408:0x93:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305926.447791:0:2977:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000047eac72e/0xa5e9c8c58c6fb49 lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x93:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305926.447795:0:2977:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000047eac72e already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305926.447797:0:2977:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000047eac72e/0xa5e9c8c58c6fb49 lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x93:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305926.447800:0:2977:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000047eac72e/0xa5e9c8c58c6fb49 lrc: 4/0,0 mode: PW/PW res: [0x200000408:0x93:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305926.447808:0:2977:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x93:0x0].0x6325532c (00000000322bd48e) 00010000:00010000:2.0:1772305926.447809:0:2977:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305926.447811:0:2977:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000047eac72e/0xa5e9c8c58c6fb49 lrc: 2/0,0 mode: --/PW res: [0x200000408:0x93:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305926.447815:0:2977:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000047eac72e/0xa5e9c8c58c6fb49 lrc: 0/0,0 mode: --/PW res: [0x200000408:0x93:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305926.448483:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305926.448524:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225396608 00000100:00100000:0.0:1772305926.448560:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5751 00000100:00100000:0.0:1772305926.448565:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b97a8f0f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f935b4d0-e17f-49c8-8011-4be99ba75430+161:99184:x1858396225396608:12345-192.168.203.30@tcp:101:tar.0 00010000:00010000:0.0:1772305926.448572:0:21400:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305926.448586:0:21400:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003af72948/0xa5e9c8c58c6fb5e lrc: 2/0,0 mode: --/PW res: [0x1b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f10e expref: -99 pid: 21400 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1772305926.448600:0:21400:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x1b1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1772305926.448610:0:21400:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305926.448611:0:21400:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305926.448617:0:21400:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003af72948/0xa5e9c8c58c6fb5e lrc: 3/0,0 mode: PW/PW res: [0x1b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f10e expref: 162 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.448651:0:21400:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003af72948/0xa5e9c8c58c6fb5e lrc: 3/0,0 mode: PW/PW res: [0x1b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f10e expref: 162 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.448659:0:21400:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003af72948, rc 0) 00000100:00100000:0.0:1772305926.448688:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b97a8f0f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f935b4d0-e17f-49c8-8011-4be99ba75430+162:99184:x1858396225396608:12345-192.168.203.30@tcp:101:tar.0 Request processed in 122us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305926.448693:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5751 00000100:00100000:1.0:1772305926.522127:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305926.522218:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225396672 00000100:00100000:0.0:1772305926.522271:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1087 00000100:00100000:0.0:1772305926.522277:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008908aaf6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+62:99183:x1858396225396672:12345-192.168.203.30@tcp:101:tar.0 00010000:00010000:0.0:1772305926.522300:0:55141:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305926.522318:0:55141:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c6fb65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f115 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.522395:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000007700e1ce/0xa5e9c8c58c6fb6c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.522406:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007700e1ce/0xa5e9c8c58c6fb6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.522414:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007700e1ce/0xa5e9c8c58c6fb6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305926.522446:0:55141:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x32b:0x0]: returning size 1048576 00000004:00200000:0.0:1772305926.522449:0:55141:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1772305926.522463:0:55141:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 000000007700e1ce/0xa5e9c8c58c6fb6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.522470:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007700e1ce/0xa5e9c8c58c6fb6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.522486:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c6fb65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f115 expref: 64 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.522500:0:55141:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000007700e1ce/0xa5e9c8c58c6fb6c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f115 expref: 63 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.522506:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32b:0x0].0x0 (0000000076ea1b5e) 00010000:00010000:0.0:1772305926.522508:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1772305926.522510:0:55141:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007700e1ce, rc 0) 00000100:00100000:0.0:1772305926.522562:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008908aaf6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+63:99183:x1858396225396672:12345-192.168.203.30@tcp:101:tar.0 Request processed in 285us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305926.522567:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1087 00000100:00100000:1.0:1772305926.524114:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305926.524163:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225396800 00000100:00100000:3.0:1772305926.524195:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 136 00000100:00100000:3.0:1772305926.524200:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002ad7a53e pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+63:99183:x1858396225396800:12345-192.168.203.30@tcp:35:tar.0 00000100:00100000:3.0:1772305926.524337:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002ad7a53e pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+64:99183:x1858396225396800:12345-192.168.203.30@tcp:35:tar.0 Request processed in 136us (226us total) trans 8589934939 rc 0/0 00000100:00100000:3.0:1772305926.524343:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 136 00000100:00100000:1.0:1772305926.526891:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305926.526931:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225396992 00000100:00100000:0.0:1772305926.526961:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1088 00000100:00100000:0.0:1772305926.526965:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b4db4a55 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+64:99184:x1858396225396992:12345-192.168.203.30@tcp:36:tar.0 00010000:00010000:0.0:1772305926.527010:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000066b8a8ab/0xa5e9c8c58c6fb73 lrc: 3/0,1 mode: --/PW res: [0x200000408:0x94:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.527021:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000066b8a8ab/0xa5e9c8c58c6fb73 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x94:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.527031:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000066b8a8ab/0xa5e9c8c58c6fb73 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x94:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1772305926.527102:0:55141:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000b4db4a55 reply state 00000000834595c0 transno 8589934940 ns: mdt-lustre-MDT0000_UUID lock: 0000000066b8a8ab/0xa5e9c8c58c6fb73 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x94:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305926.527152:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b4db4a55 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+66:99184:x1858396225396992:12345-192.168.203.30@tcp:36:tar.0 Request processed in 186us (263us total) trans 8589934940 rc 0/0 00000100:00100000:0.0:1772305926.527158:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1088 00000100:00100000:1.0:1772305926.527763:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305926.527801:0:21399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225397056 00002000:00100000:0.0:1772305926.527825:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1b1:0x0] (0->1048575) req@00000000b243bfc2 x1858396225397056/t0(0) o4->f935b4d0-e17f-49c8-8011-4be99ba75430@192.168.203.30@tcp:57/0 lens 488/0 e 0 to 0 dl 1772305932 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tar.0' 00002000:00100000:0.0:1772305926.527833:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 00000000b243bfc2 with x1858396225397056 ext(0->1048575) 00010000:00010000:3.0:1772305926.527835:0:2978:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000066b8a8ab/0xa5e9c8c58c6fb73 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x94:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1772305926.527836:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000b243bfc2 00010000:00010000:3.0:1772305926.527849:0:2978:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000066b8a8ab/0xa5e9c8c58c6fb73 lrc: 2/0,0 mode: PW/PW res: [0x200000408:0x94:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305926.527858:0:21399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2051 00010000:00010000:3.0:1772305926.527862:0:2978:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000066b8a8ab/0xa5e9c8c58c6fb73 lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x94:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305926.527865:0:21399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b243bfc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+162:2218:x1858396225397056:12345-192.168.203.30@tcp:4:tar.0 00010000:00010000:3.0:1772305926.527953:0:2978:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000066b8a8ab already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305926.527958:0:2978:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000066b8a8ab/0xa5e9c8c58c6fb73 lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x94:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305926.527968:0:2978:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000066b8a8ab/0xa5e9c8c58c6fb73 lrc: 4/0,0 mode: PW/PW res: [0x200000408:0x94:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305926.527993:0:2978:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x94:0x0].0x0 (00000000d18b8883) 00010000:00010000:3.0:1772305926.527998:0:2978:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305926.528002:0:2978:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000066b8a8ab/0xa5e9c8c58c6fb73 lrc: 2/0,0 mode: --/PW res: [0x200000408:0x94:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305926.528009:0:2978:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000066b8a8ab/0xa5e9c8c58c6fb73 lrc: 0/0,0 mode: --/PW res: [0x200000408:0x94:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305926.528039:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305926.528099:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225397120 00000100:00100000:2.0:1772305926.528138:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5752 00000100:00100000:2.0:1772305926.528143:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004d4b96ce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f935b4d0-e17f-49c8-8011-4be99ba75430+163:2215:x1858396225397120:12345-192.168.203.30@tcp:2:tar.0 00002000:00010000:2.0:1772305926.528584:0:21400:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x1b1:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1772305926.528588:0:21400:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x1b1:0x0] updating lvb mtime from disk: 0 -> 1772305923 00002000:00010000:2.0:1772305926.528590:0:21400:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x1b1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1772305926.528591:0:21400:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x1b1:0x0] updating lvb ctime from disk: 0 -> 1772305926 00002000:00010000:2.0:1772305926.528592:0:21400:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x1b1:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1772305926.528613:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004d4b96ce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f935b4d0-e17f-49c8-8011-4be99ba75430+165:2215:x1858396225397120:12345-192.168.203.30@tcp:2:tar.0 Request processed in 470us (579us total) trans 4294968314 rc 0/0 00000100:00100000:2.0:1772305926.528619:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5752 00000100:00100000:2.0:1772305926.530728:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305926.530779:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225397248 00000100:00100000:0.0:1772305926.530824:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1089 00000100:00100000:0.0:1772305926.530832:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000af392ea5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+65:99184:x1858396225397248:12345-192.168.203.30@tcp:55:tar.0 00010000:00010000:0.0:1772305926.530873:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c6fb7a lrc: 3/0,1 mode: --/PW res: [0x200000408:0x94:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.530886:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c6fb7a lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x94:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.530897:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c6fb7a lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x94:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.530914:0:55141:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c6fb7a lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x94:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.530918:0:55141:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c6fb7a lrc: 2/0,0 mode: PW/PW res: [0x200000408:0x94:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.530923:0:55141:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c6fb7a lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x94:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.530926:0:55141:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a68ed1bf already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305926.530928:0:55141:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c6fb7a lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x94:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.530932:0:55141:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c6fb7a lrc: 4/0,0 mode: PW/PW res: [0x200000408:0x94:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.530938:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x94:0x0].0x0 (00000000d18b8883) 00010000:00010000:0.0:1772305926.530940:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1772305926.530942:0:55141:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c6fb7a lrc: 2/0,0 mode: --/PW res: [0x200000408:0x94:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.530946:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c6fb7a lrc: 0/0,0 mode: --/PW res: [0x200000408:0x94:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305926.530990:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000af392ea5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+65:99184:x1858396225397248:12345-192.168.203.30@tcp:55:tar.0 Request processed in 159us (264us total) trans 0 rc -22/-22 00000100:00100000:0.0:1772305926.530995:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1089 00000100:00100000:1.0:1772305926.531758:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305926.531794:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225397312 00000100:00100000:0.0:1772305926.531831:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1090 00000100:00100000:0.0:1772305926.531838:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c8d8b056 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+65:99184:x1858396225397312:12345-192.168.203.30@tcp:101:tar.0 00010000:00010000:0.0:1772305926.531848:0:55141:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305926.531861:0:55141:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c0d6152b/0xa5e9c8c58c6fb81 lrc: 2/0,0 mode: --/PR res: [0x200000408:0x94:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f11c expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.531880:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000b4d02a02/0xa5e9c8c58c6fb88 lrc: 3/1,0 mode: --/PR res: [0x200000408:0x94:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.531888:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b4d02a02/0xa5e9c8c58c6fb88 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x94:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.531897:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b4d02a02/0xa5e9c8c58c6fb88 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x94:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.531981:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c0d6152b/0xa5e9c8c58c6fb81 lrc: 0/0,0 mode: --/PR res: [0x200000408:0x94:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f11c expref: 67 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.531995:0:55141:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000b4d02a02/0xa5e9c8c58c6fb88 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x94:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f11c expref: 66 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.532001:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x94:0x0].0x0 (00000000d18b8883) 00010000:00010000:0.0:1772305926.532003:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1772305926.532005:0:55141:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b4d02a02, rc 0) 00000100:00100000:0.0:1772305926.532038:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c8d8b056 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+66:99184:x1858396225397312:12345-192.168.203.30@tcp:101:tar.0 Request processed in 200us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305926.532045:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1090 00000100:00100000:1.0:1772305926.532851:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305926.532886:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225397440 00000100:00100000:0.0:1772305926.532930:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1091 00000100:00100000:0.0:1772305926.532938:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009f99046b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+66:99184:x1858396225397440:12345-192.168.203.30@tcp:36:tar.0 00010000:00010000:0.0:1772305926.532962:0:55141:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1772305926.532973:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fb50 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x94:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f107 expref: 66 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.532981:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x94:0x0].0x0 (00000000d18b8883) 00010000:00010000:0.0:1772305926.532984:0:55141:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1772305926.532998:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c6fb8f lrc: 3/0,1 mode: --/PW res: [0x200000408:0x94:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.533004:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c6fb8f lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x94:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.533010:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c6fb8f lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x94:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305926.533069:0:21399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b243bfc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+165:2218:x1858396225397056:12345-192.168.203.30@tcp:4:tar.0 Request processed in 5204us (5305us total) trans 4294968315 rc 0/0 00000100:00100000:2.0:1772305926.533078:0:21399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2051 00002000:00100000:2.0:1772305926.533085:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1b1:0x0] (0->1048575) req@00000000b243bfc2 x1858396225397056/t4294968315(0) o4->f935b4d0-e17f-49c8-8011-4be99ba75430@192.168.203.30@tcp:57/0 lens 488/448 e 0 to 0 dl 1772305932 ref 1 fl Complete:/0/0 rc 0/0 job:'tar.0' 00002000:00100000:2.0:1772305926.533092:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 00000000b243bfc2 with x1858396225397056 ext(0->1048575) 00002000:00010000:2.0:1772305926.533096:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000b243bfc2 00000040:00080000:0.0:1772305926.533202:0:55141:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xb:0x0].12, 88 off9056 00000004:00080000:0.0:1772305926.533208:0:55141:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1238427580205ns, next at 1239427578218ns, rc = 0 00000004:00010000:0.0:1772305926.533255:0:55141:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000009f99046b reply state 00000000e0ad398e transno 8589934941 ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c6fb8f lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x94:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305926.533319:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009f99046b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+67:99184:x1858396225397440:12345-192.168.203.30@tcp:36:tar.0 Request processed in 380us (469us total) trans 8589934941 rc 0/0 00000100:00100000:0.0:1772305926.533327:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1091 00010000:00010000:2.0:1772305926.533825:0:2977:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c6fb8f lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x94:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305926.533834:0:2977:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c6fb8f lrc: 2/0,0 mode: PW/PW res: [0x200000408:0x94:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305926.533839:0:2977:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c6fb8f lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x94:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305926.533843:0:2977:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000005803c629 already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305926.533844:0:2977:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c6fb8f lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x94:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305926.533848:0:2977:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c6fb8f lrc: 4/0,0 mode: PW/PW res: [0x200000408:0x94:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305926.533856:0:2977:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x94:0x0].0x0 (00000000d18b8883) 00010000:00010000:2.0:1772305926.533858:0:2977:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1772305926.533859:0:2977:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c6fb8f lrc: 2/0,0 mode: --/PW res: [0x200000408:0x94:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305926.533863:0:2977:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c6fb8f lrc: 0/0,0 mode: --/PW res: [0x200000408:0x94:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305926.534064:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305926.534099:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225397504 00000100:00100000:0.0:1772305926.534123:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1092 00000100:00100000:0.0:1772305926.534127:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ff1d690e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+66:99184:x1858396225397504:12345-192.168.203.30@tcp:101:tar.0 00010000:00010000:0.0:1772305926.534135:0:55141:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305926.534142:0:55141:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000019232299/0xa5e9c8c58c6fb96 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x94:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f123 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.534163:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000019232299/0xa5e9c8c58c6fb96 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x94:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f123 expref: 67 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.534170:0:55141:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000019232299/0xa5e9c8c58c6fb96 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x94:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f123 expref: 67 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.534181:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x94:0x0].0x0 (00000000d18b8883) 00010000:00010000:0.0:1772305926.534183:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1772305926.534185:0:55141:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000019232299, rc 0) 00000100:00100000:0.0:1772305926.534208:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ff1d690e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+67:99184:x1858396225397504:12345-192.168.203.30@tcp:101:tar.0 Request processed in 81us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305926.534213:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1092 00000100:00100000:1.0:1772305926.534905:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305926.534940:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225397568 00000100:00100000:2.0:1772305926.534964:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5753 00000100:00100000:2.0:1772305926.534969:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c8db4b09 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f935b4d0-e17f-49c8-8011-4be99ba75430+165:2215:x1858396225397568:12345-192.168.203.30@tcp:2:tar.0 00002000:00010000:2.0:1772305926.535032:0:21400:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x1b1:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:2.0:1772305926.535035:0:21400:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x1b1:0x0] updating lvb mtime from disk: 1772305923 -> 1772305923 00002000:00010000:2.0:1772305926.535036:0:21400:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x1b1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1772305926.535037:0:21400:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x1b1:0x0] updating lvb ctime from disk: 1772305926 -> 1772305926 00002000:00010000:2.0:1772305926.535039:0:21400:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x1b1:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1772305926.535064:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c8db4b09 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f935b4d0-e17f-49c8-8011-4be99ba75430+166:2215:x1858396225397568:12345-192.168.203.30@tcp:2:tar.0 Request processed in 95us (160us total) trans 4294968316 rc 0/0 00000100:00100000:2.0:1772305926.535069:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5753 00000100:00100000:1.0:1772305926.535736:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305926.535766:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225397696 00000100:00100000:0.0:1772305926.535793:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1093 00000100:00100000:0.0:1772305926.535798:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000065469dd5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+67:99184:x1858396225397696:12345-192.168.203.30@tcp:36:tar.0 00010000:00010000:0.0:1772305926.535828:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000096601b0a/0xa5e9c8c58c6fb9d lrc: 3/0,1 mode: --/PW res: [0x200000408:0x94:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.535836:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000096601b0a/0xa5e9c8c58c6fb9d lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x94:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.535841:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000096601b0a/0xa5e9c8c58c6fb9d lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x94:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1772305926.535915:0:55141:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000065469dd5 reply state 00000000166d89ac transno 8589934942 ns: mdt-lustre-MDT0000_UUID lock: 0000000096601b0a/0xa5e9c8c58c6fb9d lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x94:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305926.535976:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000065469dd5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+69:99184:x1858396225397696:12345-192.168.203.30@tcp:36:tar.0 Request processed in 177us (240us total) trans 8589934942 rc 0/0 00000100:00100000:0.0:1772305926.535984:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1093 00010000:00010000:3.0:1772305926.536670:0:2978:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000096601b0a/0xa5e9c8c58c6fb9d lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x94:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305926.536682:0:2978:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000096601b0a/0xa5e9c8c58c6fb9d lrc: 2/0,0 mode: PW/PW res: [0x200000408:0x94:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305926.536689:0:2978:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000096601b0a/0xa5e9c8c58c6fb9d lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x94:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305926.536696:0:2978:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000096601b0a already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305926.536699:0:2978:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000096601b0a/0xa5e9c8c58c6fb9d lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x94:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305926.536706:0:2978:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000096601b0a/0xa5e9c8c58c6fb9d lrc: 4/0,0 mode: PW/PW res: [0x200000408:0x94:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305926.536718:0:2978:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x94:0x0].0x0 (00000000d18b8883) 00000100:00100000:1.0:1772305926.536724:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00010000:3.0:1772305926.536725:0:2978:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1772305926.536729:0:2978:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000096601b0a/0xa5e9c8c58c6fb9d lrc: 2/0,0 mode: --/PW res: [0x200000408:0x94:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305926.536737:0:2978:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000096601b0a/0xa5e9c8c58c6fb9d lrc: 0/0,0 mode: --/PW res: [0x200000408:0x94:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305926.536753:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225397760 00000100:00100000:2.0:1772305926.536784:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5754 00000100:00100000:2.0:1772305926.536789:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ac13a99c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f935b4d0-e17f-49c8-8011-4be99ba75430+166:2215:x1858396225397760:12345-192.168.203.30@tcp:2:tar.0 00002000:00010000:2.0:1772305926.536867:0:21400:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x1b1:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1772305926.536870:0:21400:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x1b1:0x0] updating lvb mtime from disk: 1772305923 -> 1772305923 00002000:00010000:2.0:1772305926.536872:0:21400:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x1b1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1772305926.536874:0:21400:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x1b1:0x0] updating lvb ctime from disk: 1772305926 -> 1772305926 00002000:00010000:2.0:1772305926.536876:0:21400:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x1b1:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1772305926.536907:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ac13a99c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f935b4d0-e17f-49c8-8011-4be99ba75430+167:2215:x1858396225397760:12345-192.168.203.30@tcp:2:tar.0 Request processed in 118us (188us total) trans 4294968317 rc 0/0 00000100:00100000:2.0:1772305926.536913:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5754 00000100:00100000:1.0:1772305926.537571:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305926.537609:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225397888 00000100:00100000:3.0:1772305926.537657:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 137 00000100:00100000:3.0:1772305926.537663:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000077c62deb pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+68:99184:x1858396225397888:12345-192.168.203.30@tcp:35:tar.0 00000100:00100000:3.0:1772305926.537822:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000077c62deb pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+69:99184:x1858396225397888:12345-192.168.203.30@tcp:35:tar.0 Request processed in 159us (251us total) trans 8589934943 rc 0/0 00000100:00100000:3.0:1772305926.537828:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 137 00000100:00100000:1.0:1772305926.539244:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305926.539274:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225398016 00000100:00100000:3.0:1772305926.539298:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 138 00000100:00100000:3.0:1772305926.539301:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f12f604e pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+69:99184:x1858396225398016:12345-192.168.203.30@tcp:35:tar.0 00000100:00100000:3.0:1772305926.539401:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f12f604e pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+70:99184:x1858396225398016:12345-192.168.203.30@tcp:35:tar.0 Request processed in 98us (157us total) trans 8589934944 rc 0/0 00000100:00100000:3.0:1772305926.539406:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 138 00000100:00100000:1.0:1772305926.543356:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305926.543405:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225398144 00000100:00100000:0.0:1772305926.543440:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1094 00000100:00100000:0.0:1772305926.543445:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e09ae93a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+70:99186:x1858396225398144:12345-192.168.203.30@tcp:101:cmp.0 00010000:00010000:0.0:1772305926.543458:0:55141:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305926.543473:0:55141:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c0d6152b/0xa5e9c8c58c6fba4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f12a expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.543534:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c6fbab lrc: 3/1,0 mode: --/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.543543:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c6fbab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.543549:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c6fbab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305926.543558:0:55141:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x32b:0x0]: returning size 1048576 00010000:00010000:0.0:1772305926.543612:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c0d6152b/0xa5e9c8c58c6fba4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f12a expref: 73 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.543622:0:55141:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c6fbab lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x32b:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f12a expref: 72 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.543660:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32b:0x0].0x0 (0000000076ea1b5e) 00010000:00010000:0.0:1772305926.543663:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1772305926.543665:0:55141:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a68ed1bf, rc 0) 00000100:00100000:0.0:1772305926.543692:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e09ae93a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+72:99186:x1858396225398144:12345-192.168.203.30@tcp:101:cmp.0 Request processed in 246us (337us total) trans 8589934945 rc 0/0 00000100:00100000:0.0:1772305926.543697:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1094 00000100:00100000:1.0:1772305926.544750:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305926.544787:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225398208 00000100:00100000:0.0:1772305926.544814:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1095 00000100:00100000:0.0:1772305926.544818:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fc5ade3a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+72:99186:x1858396225398208:12345-192.168.203.30@tcp:101:cmp.0 00010000:00010000:0.0:1772305926.544828:0:55141:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305926.544835:0:55141:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fbb9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f131 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.544861:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000067c6c66d/0xa5e9c8c58c6fbc0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.544868:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000067c6c66d/0xa5e9c8c58c6fbc0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.544874:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000067c6c66d/0xa5e9c8c58c6fbc0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.544883:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fbc7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.544888:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fbc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.544895:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fbc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.544988:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000f346ea17/0xa5e9c8c58c6fbce lrc: 3/1,0 mode: --/PR res: [0x200000408:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.544994:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f346ea17/0xa5e9c8c58c6fbce lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.544999:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f346ea17/0xa5e9c8c58c6fbce lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305926.545013:0:55141:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000408:0x8d:0x0]: returning size 11776 00000004:00200000:0.0:1772305926.545016:0:55141:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1772305926.545027:0:55141:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000f346ea17/0xa5e9c8c58c6fbce lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x8d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.545033:0:55141:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000067c6c66d/0xa5e9c8c58c6fbc0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.545037:0:55141:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000067c6c66d/0xa5e9c8c58c6fbc0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.545041:0:55141:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000067c6c66d/0xa5e9c8c58c6fbc0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.545046:0:55141:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000067c6c66d already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305926.545048:0:55141:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000067c6c66d/0xa5e9c8c58c6fbc0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.545051:0:55141:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000067c6c66d/0xa5e9c8c58c6fbc0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.545057:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:0.0:1772305926.545058:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305926.545060:0:55141:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000067c6c66d/0xa5e9c8c58c6fbc0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.545063:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000067c6c66d/0xa5e9c8c58c6fbc0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.545069:0:55141:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fbc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.545073:0:55141:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fbc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.545077:0:55141:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fbc7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.545080:0:55141:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000009a7ee7d5 already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305926.545081:0:55141:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fbc7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.545085:0:55141:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fbc7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.545089:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3f22ae9b (0000000013d42fff) 00010000:00010000:0.0:1772305926.545091:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305926.545092:0:55141:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fbc7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.545095:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fbc7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3f22ae9b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.545108:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fbb9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f131 expref: 74 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.545115:0:55141:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000f346ea17/0xa5e9c8c58c6fbce lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x8d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f131 expref: 73 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.545119:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8d:0x0].0x0 (00000000444a0a6b) 00010000:00010000:0.0:1772305926.545120:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1772305926.545121:0:55141:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f346ea17, rc 0) 00000100:00100000:0.0:1772305926.545148:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fc5ade3a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+73:99186:x1858396225398208:12345-192.168.203.30@tcp:101:cmp.0 Request processed in 329us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305926.545153:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1095 00000100:00100000:1.0:1772305926.545903:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305926.545945:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225398336 00000100:00100000:0.0:1772305926.545977:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1096 00000100:00100000:0.0:1772305926.545982:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000257ed89 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+73:99186:x1858396225398336:12345-192.168.203.30@tcp:101:cmp.0 00010000:00010000:0.0:1772305926.545990:0:55141:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305926.545997:0:55141:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cb557b9d/0xa5e9c8c58c6fbd5 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x93:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f138 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.546029:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000004402aedf/0xa5e9c8c58c6fbdc lrc: 3/1,0 mode: --/CR res: [0x200000408:0x93:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.546039:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000004402aedf/0xa5e9c8c58c6fbdc lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x93:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.546047:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004402aedf/0xa5e9c8c58c6fbdc lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x93:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.546060:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c6fbe3 lrc: 3/1,0 mode: --/PR res: [0x200000408:0x93:0x0].0x6325532c bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.546067:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c6fbe3 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x93:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.546074:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c6fbe3 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x93:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.546150:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000009aff2f07/0xa5e9c8c58c6fbea lrc: 3/1,0 mode: --/CR res: [0x200000408:0x94:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.546165:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000009aff2f07/0xa5e9c8c58c6fbea lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x94:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.546173:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000009aff2f07/0xa5e9c8c58c6fbea lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x94:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305926.546179:0:55141:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000408:0x94:0x0]: returning size 1044992 00010000:00010000:0.0:1772305926.546215:0:55141:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000004402aedf/0xa5e9c8c58c6fbdc lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x93:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.546220:0:55141:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000004402aedf/0xa5e9c8c58c6fbdc lrc: 2/0,0 mode: CR/CR res: [0x200000408:0x93:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.546224:0:55141:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000004402aedf/0xa5e9c8c58c6fbdc lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x93:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.546228:0:55141:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000004402aedf already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305926.546229:0:55141:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004402aedf/0xa5e9c8c58c6fbdc lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x93:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.546233:0:55141:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004402aedf/0xa5e9c8c58c6fbdc lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x93:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.546238:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x93:0x0].0x0 (0000000010da78e2) 00010000:00010000:0.0:1772305926.546239:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305926.546240:0:55141:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000004402aedf/0xa5e9c8c58c6fbdc lrc: 2/0,0 mode: --/CR res: [0x200000408:0x93:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.546244:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004402aedf/0xa5e9c8c58c6fbdc lrc: 0/0,0 mode: --/CR res: [0x200000408:0x93:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.546250:0:55141:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c6fbe3 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x93:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.546253:0:55141:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c6fbe3 lrc: 2/0,0 mode: PR/PR res: [0x200000408:0x93:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.546257:0:55141:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c6fbe3 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x93:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.546264:0:55141:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b8f73038 already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305926.546265:0:55141:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c6fbe3 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x93:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.546268:0:55141:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c6fbe3 lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x93:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.546272:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x93:0x0].0x6325532c (00000000176e8e72) 00010000:00010000:0.0:1772305926.546273:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305926.546274:0:55141:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c6fbe3 lrc: 2/0,0 mode: --/PR res: [0x200000408:0x93:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.546277:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c6fbe3 lrc: 0/0,0 mode: --/PR res: [0x200000408:0x93:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.546292:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cb557b9d/0xa5e9c8c58c6fbd5 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x93:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f138 expref: 76 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.546298:0:55141:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000009aff2f07/0xa5e9c8c58c6fbea lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x94:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f138 expref: 75 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.546302:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x94:0x0].0x0 (00000000d18b8883) 00010000:00010000:0.0:1772305926.546303:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1772305926.546304:0:55141:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009aff2f07, rc 0) 00000100:00100000:0.0:1772305926.546329:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000257ed89 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+75:99186:x1858396225398336:12345-192.168.203.30@tcp:101:cmp.0 Request processed in 347us (430us total) trans 8589934946 rc 0/0 00000100:00100000:0.0:1772305926.546334:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1096 00000100:00100000:1.0:1772305926.547191:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305926.547231:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225398400 00000100:00100000:0.0:1772305926.547255:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1097 00000100:00100000:0.0:1772305926.547258:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009f043825 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+75:99186:x1858396225398400:12345-192.168.203.30@tcp:101:cmp.0 00010000:00010000:0.0:1772305926.547267:0:55141:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305926.547274:0:55141:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fbf8 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x93:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f13f expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.547309:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000b6bfd075/0xa5e9c8c58c6fbff lrc: 3/1,0 mode: --/PR res: [0x200000408:0x94:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.547316:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b6bfd075/0xa5e9c8c58c6fbff lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x94:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.547321:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b6bfd075/0xa5e9c8c58c6fbff lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x94:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305926.547333:0:55141:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000408:0x94:0x0]: returning size 1044992 00000004:00200000:0.0:1772305926.547335:0:55141:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1772305926.547341:0:55141:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000b6bfd075/0xa5e9c8c58c6fbff lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x94:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.547347:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b6bfd075/0xa5e9c8c58c6fbff lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x94:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.547356:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fbf8 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x93:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f13f expref: 77 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.547363:0:55141:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000b6bfd075/0xa5e9c8c58c6fbff lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x94:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f13f expref: 76 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.547368:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x94:0x0].0x0 (00000000d18b8883) 00010000:00010000:0.0:1772305926.547370:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1772305926.547371:0:55141:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6bfd075, rc 0) 00000100:00100000:0.0:1772305926.547408:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009f043825 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+76:99186:x1858396225398400:12345-192.168.203.30@tcp:101:cmp.0 Request processed in 149us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305926.547413:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1097 00000100:00100000:1.0:1772305926.552234:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305926.552273:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225398528 00000100:00100000:3.0:1772305926.552314:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 139 00000100:00100000:3.0:1772305926.552321:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002cd499a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+76:99186:x1858396225398528:12345-192.168.203.30@tcp:35:cmp.0 00000100:00100000:3.0:1772305926.552560:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002cd499a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+77:99186:x1858396225398528:12345-192.168.203.30@tcp:35:cmp.0 Request processed in 240us (328us total) trans 8589934947 rc 0/0 00000100:00100000:3.0:1772305926.552567:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 139 00000100:00100000:1.0:1772305926.557678:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305926.557731:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225398656 00000100:00100000:3.0:1772305926.557764:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 140 00000100:00100000:3.0:1772305926.557770:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008ea406c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+77:99187:x1858396225398656:12345-192.168.203.30@tcp:35:rm.0 00000100:00100000:3.0:1772305926.557908:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008ea406c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+78:99187:x1858396225398656:12345-192.168.203.30@tcp:35:rm.0 Request processed in 137us (234us total) trans 8589934948 rc 0/0 00000100:00100000:3.0:1772305926.557932:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 140 00000100:00100000:1.0:1772305926.558858:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305926.558906:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225398784 00000100:00100000:0.0:1772305926.558939:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1098 00000100:00100000:0.0:1772305926.558943:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005f7abb81 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+78:99187:x1858396225398784:12345-192.168.203.30@tcp:36:rm.0 00010000:00010000:0.0:1772305926.558969:0:55141:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1772305926.558988:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007700e1ce/0xa5e9c8c58c6fb6c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f115 expref: 78 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.559003:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c6fbab lrc: 0/0,0 mode: --/CR res: [0x200000402:0x32b:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f12a expref: 77 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.559009:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6fa00 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0a5 expref: 76 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.559016:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32b:0x0].0x0 (0000000076ea1b5e) 00010000:00010000:0.0:1772305926.559022:0:55141:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1772305926.559042:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fc06 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.559052:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fc06 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.559059:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fc06 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.559071:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cb557b9d/0xa5e9c8c58c6fc0d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6325532c bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.559075:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cb557b9d/0xa5e9c8c58c6fc0d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.559079:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cb557b9d/0xa5e9c8c58c6fc0d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.559148:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c6fc14 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.559153:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c6fc14 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.559157:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c6fc14 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1772305926.559417:0:55141:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xd:0x0].12, 64 off9008 00000004:00080000:0.0:1772305926.559424:0:55141:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1238453796064ns, next at 1239453793783ns, rc = 0 00010000:00010000:0.0:1772305926.559467:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000004402aedf/0xa5e9c8c58c6fc1b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.559473:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000004402aedf/0xa5e9c8c58c6fc1b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446631284783364544 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.559479:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004402aedf/0xa5e9c8c58c6fc1b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446631284783364544 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.559487:0:55141:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000004402aedf/0xa5e9c8c58c6fc1b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x32b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446631284783364544 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.559492:0:55141:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000004402aedf/0xa5e9c8c58c6fc1b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x32b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446631284783364544 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.559495:0:55141:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000004402aedf/0xa5e9c8c58c6fc1b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x32b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446631284783364544 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.559509:0:55141:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1772305926.559518:0:55141:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000005f7abb81 reply state 0000000019c92d7a transno 8589934949 ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c6fc14 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305926.559535:0:6322:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1772305926.559540:0:6322:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000004402aedf/0xa5e9c8c58c6fc1b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x32b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446631284783364544 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305926.559548:0:6322:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000004402aedf already unused, calling callback (00000000b5e4f3c0) 00010000:00010000:3.0:1772305926.559551:0:6322:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004402aedf/0xa5e9c8c58c6fc1b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x32b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446631284783364544 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305926.559557:0:6322:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004402aedf/0xa5e9c8c58c6fc1b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x32b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446631284783364544 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.559559:0:55141:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fc06 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.559567:0:55141:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fc06 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305926.559568:0:6322:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32b:0x0].0x0 (0000000013d42fff) 00010000:00010000:3.0:1772305926.559574:0:6322:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1772305926.559577:0:6322:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000004402aedf/0xa5e9c8c58c6fc1b lrc: 1/0,0 mode: --/PW res: [0x200000402:0x32b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446631284783364544 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.559577:0:55141:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fc06 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305926.559592:0:6322:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004402aedf/0xa5e9c8c58c6fc1b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x32b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446631284783364544 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.559593:0:55141:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000809cda8f already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305926.559597:0:55141:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fc06 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.559605:0:55141:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fc06 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305926.559607:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1772305926.559609:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1772305926.559610:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1772305926.559617:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:0.0:1772305926.559619:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305926.559621:0:55141:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fc06 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.559624:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fc06 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1772305926.559657:0:55141:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000005f7abb81 reply state 0000000019c92d7a transno 8589934949 ns: mdt-lustre-MDT0000_UUID lock: 00000000cb557b9d/0xa5e9c8c58c6fc0d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305926.559697:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005f7abb81 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+77:99187:x1858396225398784:12345-192.168.203.30@tcp:36:rm.0 Request processed in 751us (839us total) trans 8589934949 rc 0/0 00000100:00100000:0.0:1772305926.559705:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1098 00010000:00010000:2.0:1772305926.560272:0:2977:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cb557b9d/0xa5e9c8c58c6fc0d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305926.560281:0:2977:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cb557b9d/0xa5e9c8c58c6fc0d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305926.560286:0:2977:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cb557b9d/0xa5e9c8c58c6fc0d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305926.560289:0:2977:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cb557b9d already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305926.560291:0:2977:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cb557b9d/0xa5e9c8c58c6fc0d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305926.560295:0:2977:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cb557b9d/0xa5e9c8c58c6fc0d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305926.560302:0:2977:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6325532c (00000000176e8e72) 00010000:00010000:2.0:1772305926.560304:0:2977:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305926.560306:0:2977:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cb557b9d/0xa5e9c8c58c6fc0d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305926.560310:0:2977:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cb557b9d/0xa5e9c8c58c6fc0d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6325532c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305926.560319:0:2977:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c6fc14 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305926.560323:0:2977:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c6fc14 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305926.560327:0:2977:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c6fc14 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305926.560330:0:2977:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b8f73038 already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305926.560331:0:2977:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c6fc14 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305926.560334:0:2977:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c6fc14 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305926.560338:0:2977:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32b:0x0].0x0 (0000000013d42fff) 00010000:00010000:2.0:1772305926.560339:0:2977:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1772305926.560340:0:2977:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c6fc14 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305926.560343:0:2977:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c6fc14 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x32b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305926.561739:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305926.561769:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225398912 00000100:00100000:3.0:1772305926.561823:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 141 00000100:00100000:3.0:1772305926.561827:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b187ddcb pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+76:99187:x1858396225398912:12345-192.168.203.30@tcp:35:rm.0 00000100:00100000:3.0:1772305926.561916:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b187ddcb pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+77:99187:x1858396225398912:12345-192.168.203.30@tcp:35:rm.0 Request processed in 87us (178us total) trans 8589934950 rc 0/0 00000100:00100000:3.0:1772305926.561935:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 141 00000100:00100000:1.0:1772305926.562551:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305926.562593:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225399040 00000100:00100000:0.0:1772305926.562621:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1099 00000100:00100000:0.0:1772305926.562645:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001de570f7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+77:99187:x1858396225399040:12345-192.168.203.30@tcp:36:rm.0 00010000:00010000:0.0:1772305926.562671:0:55141:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1772305926.562683:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000020fba8b5/0xa5e9c8c58c6f832 lrc: 0/0,0 mode: --/PR res: [0x200000408:0x8f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f00b expref: 77 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.562701:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6f951 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x8f:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f074 expref: 76 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.562709:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000eca741a1/0xa5e9c8c58c6f81d lrc: 0/0,0 mode: --/CR res: [0x200000408:0x8f:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f004 expref: 75 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.562717:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8f:0x0].0x0 (00000000955bccbc) 00010000:00010000:0.0:1772305926.562722:0:55141:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1772305926.562732:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fc22 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.562738:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fc22 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.562743:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fc22 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.562750:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fc29 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.562754:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fc29 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.562758:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fc29 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.562804:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000067c6c66d/0xa5e9c8c58c6fc30 lrc: 3/0,1 mode: --/EX res: [0x200000408:0x8f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.562810:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000067c6c66d/0xa5e9c8c58c6fc30 lrc: 3/0,1 mode: EX/EX res: [0x200000408:0x8f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.562814:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000067c6c66d/0xa5e9c8c58c6fc30 lrc: 3/0,1 mode: EX/EX res: [0x200000408:0x8f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1772305926.562936:0:55141:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xd:0x0].13, 64 off9072 00010000:00010000:0.0:1772305926.562965:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c0d6152b/0xa5e9c8c58c6fc37 lrc: 3/0,1 mode: --/PW res: [0x200000408:0x8f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.562972:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c0d6152b/0xa5e9c8c58c6fc37 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x8f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446631284783364544 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.562976:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c0d6152b/0xa5e9c8c58c6fc37 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x8f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446631284783364544 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.562980:0:55141:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c0d6152b/0xa5e9c8c58c6fc37 lrc: 4/0,1 mode: PW/PW res: [0x200000408:0x8f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446631284783364544 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.562984:0:55141:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c0d6152b/0xa5e9c8c58c6fc37 lrc: 4/0,1 mode: PW/PW res: [0x200000408:0x8f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446631284783364544 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.562988:0:55141:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c0d6152b/0xa5e9c8c58c6fc37 lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x8f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446631284783364544 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.563001:0:55141:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1772305926.563008:0:55141:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000001de570f7 reply state 00000000229fc725 transno 8589934951 ns: mdt-lustre-MDT0000_UUID lock: 0000000067c6c66d/0xa5e9c8c58c6fc30 lrc: 3/0,1 mode: EX/EX res: [0x200000408:0x8f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305926.563022:0:5496:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1772305926.563028:0:5496:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c0d6152b/0xa5e9c8c58c6fc37 lrc: 2/0,0 mode: PW/PW res: [0x200000408:0x8f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446631284783364544 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.563035:0:55141:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fc22 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305926.563038:0:5496:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c0d6152b already unused, calling callback (00000000b5e4f3c0) 00010000:00010000:2.0:1772305926.563043:0:5496:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c0d6152b/0xa5e9c8c58c6fc37 lrc: 2/0,0 mode: PW/PW res: [0x200000408:0x8f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446631284783364544 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.563043:0:55141:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fc22 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.563062:0:55141:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fc22 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305926.563085:0:5496:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c0d6152b/0xa5e9c8c58c6fc37 lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x8f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446631284783364544 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.563086:0:55141:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c571a25b already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305926.563090:0:55141:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fc22 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.563104:0:55141:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fc22 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305926.563108:0:5496:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8f:0x0].0x0 (00000000499b0bdb) 00010000:00010000:0.0:1772305926.563112:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:2.0:1772305926.563114:0:5496:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1772305926.563116:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305926.563118:0:5496:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c0d6152b/0xa5e9c8c58c6fc37 lrc: 1/0,0 mode: --/PW res: [0x200000408:0x8f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446631284783364544 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.563120:0:55141:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fc22 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305926.563134:0:5496:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c0d6152b/0xa5e9c8c58c6fc37 lrc: 0/0,0 mode: --/PW res: [0x200000408:0x8f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446631284783364544 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305926.563136:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fc22 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1772305926.563160:0:55141:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000001de570f7 reply state 00000000229fc725 transno 8589934951 ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fc29 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305926.563161:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1772305926.563163:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1772305926.563165:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1772305926.563198:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001de570f7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+76:99187:x1858396225399040:12345-192.168.203.30@tcp:36:rm.0 Request processed in 570us (647us total) trans 8589934951 rc 0/0 00000100:00100000:0.0:1772305926.563206:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1099 00010000:00010000:3.0:1772305926.563795:0:2978:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fc29 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305926.563806:0:2978:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fc29 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305926.563812:0:2978:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fc29 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305926.563818:0:2978:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000009a7ee7d5 already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305926.563821:0:2978:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fc29 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305926.563828:0:2978:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fc29 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305926.563837:0:2978:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb9a0e35e (00000000bbfe3173) 00010000:00010000:3.0:1772305926.563840:0:2978:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305926.563842:0:2978:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fc29 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305926.563847:0:2978:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fc29 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb9a0e35e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305926.563860:0:2978:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000067c6c66d/0xa5e9c8c58c6fc30 lrc: 3/0,1 mode: EX/EX res: [0x200000408:0x8f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305926.563866:0:2978:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000067c6c66d/0xa5e9c8c58c6fc30 lrc: 2/0,0 mode: EX/EX res: [0x200000408:0x8f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305926.563880:0:2978:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000067c6c66d/0xa5e9c8c58c6fc30 lrc: 3/0,0 mode: EX/EX res: [0x200000408:0x8f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305926.563886:0:2978:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000067c6c66d already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305926.563888:0:2978:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000067c6c66d/0xa5e9c8c58c6fc30 lrc: 3/0,0 mode: EX/EX res: [0x200000408:0x8f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305926.563894:0:2978:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000067c6c66d/0xa5e9c8c58c6fc30 lrc: 4/0,0 mode: EX/EX res: [0x200000408:0x8f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305926.563903:0:2978:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x8f:0x0].0x0 (00000000499b0bdb) 00010000:00010000:3.0:1772305926.563905:0:2978:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1772305926.563907:0:2978:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000067c6c66d/0xa5e9c8c58c6fc30 lrc: 2/0,0 mode: --/EX res: [0x200000408:0x8f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305926.563912:0:2978:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000067c6c66d/0xa5e9c8c58c6fc30 lrc: 0/0,0 mode: --/EX res: [0x200000408:0x8f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305926.600799:0:2993:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1772305926.600805:0:2992:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1772305926.600817:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000216f6f28 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216608256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1772305926.600818:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d9b971a4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216608192:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1772305926.600888:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305926.600950:0:6309:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216608256 00000100:00100000:2.0:1772305926.600966:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305926.601002:0:6309:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216608192 00000100:00100000:3.0:1772305926.601014:0:55611:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 457 00000100:00100000:3.0:1772305926.601022:0:55611:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e97202db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:2993:x1858396216608256:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1772305926.601036:0:6309:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 458 00002000:00000024:3.0:1772305926.601042:0:55611:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 695271424 pending 0 free 3606052864 avail 3601858560 00000100:00100000:1.0:1772305926.601042:0:6309:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006bac7351 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:2992:x1858396216608192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1772305926.601057:0:6309:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 1703936 granted 746520576 pending 1703936 free 3829399552 avail 3825205248 00000100:00100000:3.0:1772305926.601089:0:55611:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e97202db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:2993:x1858396216608256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305926.601096:0:55611:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 457 00000100:00100000:1.0:1772305926.601111:0:6309:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006bac7351 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:2992:x1858396216608192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305926.601122:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000216f6f28 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216608256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1772305926.601123:0:6309:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 458 00000100:00100000:0.0:1772305926.601162:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d9b971a4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216608192:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1772305926.856767:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1772305927.112786:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005666e412 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:70aae467-c860-409f-ba1b-742f4d042da6:2992:1858396216608320:0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772305927.112811:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000080700327 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:2993:1858396216608384:0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772305927.112836:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000060c5d597 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:2994:1858396216608448:0@lo:400:kworker/u8:4.0 00000100:00100000:0.0:1772305927.112860:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772305927.112870:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000da8afc0a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216608512:0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772305927.112879:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772305927.112902:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000054615e61 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216608576:0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772305927.112908:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216608320 00000100:00100000:1.0:1772305927.112916:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000044129035 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:2993:1858396216608640:0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772305927.112936:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305927.112949:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305927.112964:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1772305927.112966:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216608384 00000100:00100000:3.0:1772305927.112973:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007cf34914 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2992:x1858396216608320:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772305927.112995:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772305927.113005:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216608512 00000100:00100000:0.0:1772305927.113009:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216608640 00000100:00100000:3.0:1772305927.113037:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007cf34914 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2992:x1858396216608320:12345-0@lo:400:kworker/u8:4.0 Request processed in 62us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305927.113041:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216608448 00000100:00100000:3.0:1772305927.113051:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1772305927.113052:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1772305927.113053:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1186 00000100:00100000:1.0:1772305927.113066:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000af4ced1c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:2993:x1858396216608384:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772305927.113067:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b94be3cb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:2991:x1858396216608512:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:0.0:1772305927.113073:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1772305927.113082:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d9b971a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:2993:x1858396216608640:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772305927.113108:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1772305927.113116:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002ad7a53e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:2994:x1858396216608448:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772305927.113128:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000af4ced1c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:2993:x1858396216608384:12345-0@lo:400:kworker/u8:4.0 Request processed in 66us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305927.113138:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1772305927.113143:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b94be3cb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:2991:x1858396216608512:12345-0@lo:400:kworker/u8:4.0 Request processed in 79us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305927.113153:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1186 00000100:00100000:0.0:1772305927.113158:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d9b971a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:2993:x1858396216608640:12345-0@lo:400:kworker/u8:4.0 Request processed in 75us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305927.113168:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1772305927.113192:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002ad7a53e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:2994:x1858396216608448:12345-0@lo:400:kworker/u8:4.0 Request processed in 74us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305927.113196:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000044129035 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:2993:1858396216608640:0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772305927.113204:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000da8afc0a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216608512:0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772305927.113209:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1772305927.113215:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000080700327 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:2993:1858396216608384:0@lo:400:kworker/u8:4.0 00000100:00100000:0.0:1772305927.113241:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000060c5d597 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:2994:1858396216608448:0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772305927.113243:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305927.113262:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216608576 00000100:00100000:2.0:1772305927.113275:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005666e412 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:70aae467-c860-409f-ba1b-742f4d042da6:2992:1858396216608320:0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772305927.113287:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1187 00000100:00100000:1.0:1772305927.113292:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000da8afc0a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:2992:x1858396216608576:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772305927.113331:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000da8afc0a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:2992:x1858396216608576:12345-0@lo:400:kworker/u8:4.0 Request processed in 40us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305927.113336:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1187 00000100:00100000:2.0:1772305927.113359:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000054615e61 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216608576:0@lo:400:kworker/u8:4.0 00010000:00010000:0.0:1772305927.880775:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772305928.126773:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305928.126848:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225399104 00000100:00100000:3.0:1772305928.126947:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1100 00000100:00100000:3.0:1772305928.126953:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000077c62deb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+68:99132:x1858396225399104:12345-192.168.203.30@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1772305928.127037:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000077c62deb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+68:99132:x1858396225399104:12345-192.168.203.30@tcp:60:lhsmtool_posix.0 Request processed in 84us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305928.127043:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1100 00000400:00000080:2.0:1772305928.651953:0:70781:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:2.0:1772305928.651958:0:70781:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 250: Coordinator max request ========== 14:12:08 (1772305928) 00010000:00010000:3.0:1772305928.904772:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772305929.283796:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305929.283838:0:54689:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225399168 00000100:00100000:1.0:1772305929.283878:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305929.283901:0:54689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 148 00000100:00100000:2.0:1772305929.283910:0:54689:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000952ce909 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2215:x1858396225399168:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1772305929.283920:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225399296 00000100:00100000:1.0:1772305929.283941:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305929.283969:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1188 00000100:00100000:2.0:1772305929.283974:0:54689:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000952ce909 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2215:x1858396225399168:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 64us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305929.283981:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f12f604e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+225:2215:x1858396225399296:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1772305929.283989:0:54689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 148 00000100:00100000:0.0:1772305929.284002:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225399424 00000100:00100000:3.0:1772305929.284033:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f12f604e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+225:2215:x1858396225399296:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 54us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305929.284040:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 158 00000100:00100000:0.0:1772305929.284047:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002cd499a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+75:2215:x1858396225399424:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1772305929.284063:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1188 00000100:00100000:2.0:1772305929.284080:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305929.284092:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002cd499a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+75:2215:x1858396225399424:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 45us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305929.284099:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 158 00000100:00100000:3.0:1772305929.284110:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225399552 00000100:00100000:0.0:1772305929.284186:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305929.284216:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305929.284218:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225399232 00000100:00100000:0.0:1772305929.284242:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305929.284262:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 159 00000100:00100000:1.0:1772305929.284269:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000c3382b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+68:2215:x1858396225399232:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:0.0:1772305929.284269:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225399360 00000100:00100000:3.0:1772305929.284308:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225399488 00000100:00100000:1.0:1772305929.284310:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000c3382b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+68:2215:x1858396225399232:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 40us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305929.284316:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1189 00000100:00100000:1.0:1772305929.284320:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 159 00000100:00100000:0.0:1772305929.284327:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000054615e61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+142:2215:x1858396225399552:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1772305929.284352:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1190 00000100:00100000:0.0:1772305929.284371:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000054615e61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+142:2215:x1858396225399552:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 46us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305929.284379:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000005e96666 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+228:2215:x1858396225399360:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:0.0:1772305929.284385:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1189 00000100:00100000:0.0:1772305929.284407:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1191 00000100:00100000:0.0:1772305929.284414:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008068be20 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+167:2215:x1858396225399488:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:0.0:1772305929.284445:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008068be20 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+167:2215:x1858396225399488:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 31us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305929.284450:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1191 00000100:00100000:3.0:1772305929.284714:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000005e96666 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+228:2215:x1858396225399360:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 51us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305929.284724:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1190 00010000:00010000:2.0:1772305929.929686:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772305929.945934:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305929.945995:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225399616 00000100:00100000:0.0:1772305929.946038:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1101 00000100:00100000:0.0:1772305929.946044:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b97a8f0f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+68:99827:x1858396225399616:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1772305929.946064:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305929.946081:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fc3e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f146 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.946127:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fc45 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.946139:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fc45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.946154:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fc45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305929.946204:0:54698:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:0.0:1772305929.946206:0:54698:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 109 stripe count 1 MDT count 1 00000004:00010000:0.0:1772305929.946222:0:54698:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fc45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.946241:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fc3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f146 expref: 70 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.946252:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fc45 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f146 expref: 69 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.946259:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:0.0:1772305929.946261:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1772305929.946264:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000809cda8f, rc 0) 00000100:00100000:0.0:1772305929.946315:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b97a8f0f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:99827:x1858396225399616:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 269us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305929.946322:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1101 00000100:00100000:1.0:1772305929.949326:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305929.949382:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225399744 00000100:00100000:0.0:1772305929.949417:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1102 00000100:00100000:0.0:1772305929.949424:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e0d19a66 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+69:99828:x1858396225399744:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1772305929.949438:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305929.949453:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c6fc4c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f14d expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.949506:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000007700e1ce/0xa5e9c8c58c6fc53 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.949519:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007700e1ce/0xa5e9c8c58c6fc53 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.949528:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007700e1ce/0xa5e9c8c58c6fc53 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.949574:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fc5a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.949580:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fc5a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.949588:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fc5a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305929.949690:0:54698:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 10752 00010000:00010000:0.0:1772305929.949766:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000007700e1ce/0xa5e9c8c58c6fc53 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.949772:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000007700e1ce/0xa5e9c8c58c6fc53 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.949776:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000007700e1ce/0xa5e9c8c58c6fc53 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.949780:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000007700e1ce already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305929.949782:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007700e1ce/0xa5e9c8c58c6fc53 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.949787:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007700e1ce/0xa5e9c8c58c6fc53 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.949794:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (000000006b52a2ed) 00010000:00010000:0.0:1772305929.949796:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305929.949798:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000007700e1ce/0xa5e9c8c58c6fc53 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.949802:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007700e1ce/0xa5e9c8c58c6fc53 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.949808:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fc5a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.949813:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fc5a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.949817:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fc5a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.949820:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b501871d already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305929.949821:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fc5a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.949824:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fc5a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.949828:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (000000003362a53c) 00010000:00010000:0.0:1772305929.949829:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305929.949830:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fc5a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.949833:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fc5a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.949855:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c6fc4c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f14d expref: 71 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.949862:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c6fc4c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f14d expref: 71 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.949870:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a68ed1bf, rc 0) 00000100:00100000:0.0:1772305929.949911:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e0d19a66 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+70:99828:x1858396225399744:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 486us (587us total) trans 8589934952 rc 301/301 00000100:00100000:0.0:1772305929.949917:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1102 00000100:00100000:2.0:1772305929.950901:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305929.950955:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225399872 00000100:00100000:3.0:1772305929.950982:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 142 00000100:00100000:3.0:1772305929.950987:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005666e412 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+70:99828:x1858396225399872:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1772305929.951093:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005666e412 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+71:99828:x1858396225399872:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 105us (195us total) trans 8589934953 rc 0/0 00000100:00100000:3.0:1772305929.951099:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 142 00000100:00100000:1.0:1772305929.952025:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305929.952070:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225399936 00000100:00100000:0.0:1772305929.952106:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1103 00000100:00100000:0.0:1772305929.952113:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e6635d8a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+71:99828:x1858396225399936:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1772305929.952187:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e6635d8a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+71:99828:x1858396225399936:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 Request processed in 74us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305929.952196:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1103 00000100:00100000:1.0:1772305929.960138:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305929.960208:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225400000 00000100:00100000:0.0:1772305929.960261:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1104 00000100:00100000:0.0:1772305929.960268:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000002171660 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+75:99829:x1858396225400000:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1772305929.960288:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305929.960308:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fc68 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f154 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.960382:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c0d6152b/0xa5e9c8c58c6fc6f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.960397:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c0d6152b/0xa5e9c8c58c6fc6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.960408:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c0d6152b/0xa5e9c8c58c6fc6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.960468:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000067c6c66d/0xa5e9c8c58c6fc76 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.960481:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000067c6c66d/0xa5e9c8c58c6fc76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.960487:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000067c6c66d/0xa5e9c8c58c6fc76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.960547:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c0d6152b/0xa5e9c8c58c6fc6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.960554:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c0d6152b/0xa5e9c8c58c6fc6f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.960560:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c0d6152b/0xa5e9c8c58c6fc6f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.960566:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c0d6152b already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305929.960569:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c0d6152b/0xa5e9c8c58c6fc6f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.960575:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c0d6152b/0xa5e9c8c58c6fc6f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.960585:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:0.0:1772305929.960588:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305929.960591:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c0d6152b/0xa5e9c8c58c6fc6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.960597:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c0d6152b/0xa5e9c8c58c6fc6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.960612:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000067c6c66d/0xa5e9c8c58c6fc76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.960618:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000067c6c66d/0xa5e9c8c58c6fc76 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.960623:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000067c6c66d/0xa5e9c8c58c6fc76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.960670:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000067c6c66d already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305929.960673:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000067c6c66d/0xa5e9c8c58c6fc76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.960680:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000067c6c66d/0xa5e9c8c58c6fc76 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.960689:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6e432aa8 (00000000d9ebda3c) 00010000:00010000:0.0:1772305929.960691:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305929.960694:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000067c6c66d/0xa5e9c8c58c6fc76 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.960700:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000067c6c66d/0xa5e9c8c58c6fc76 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.960729:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fc68 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f154 expref: 76 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.960737:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fc68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f154 expref: 76 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.960749:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c571a25b, rc 0) 00000100:00100000:0.0:1772305929.960802:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000002171660 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+75:99829:x1858396225400000:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 534us (673us total) trans 0 rc 301/301 00000100:00100000:0.0:1772305929.960810:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1104 00000100:00100000:2.0:1772305929.961994:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305929.962037:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225400064 00000100:00100000:0.0:1772305929.962067:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1105 00000100:00100000:0.0:1772305929.962072:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004dd780f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+75:99829:x1858396225400064:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1772305929.962081:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305929.962091:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c6fc7d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f15b expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.962117:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fc84 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.962126:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fc84 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.962134:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fc84 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.962144:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000007700e1ce/0xa5e9c8c58c6fc8b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.962163:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007700e1ce/0xa5e9c8c58c6fc8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.962170:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007700e1ce/0xa5e9c8c58c6fc8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.962199:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fc84 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.962206:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fc84 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.962213:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fc84 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.962218:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b501871d already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305929.962221:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fc84 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.962227:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fc84 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.962235:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:0.0:1772305929.962238:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305929.962240:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fc84 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.962246:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fc84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.962256:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000007700e1ce/0xa5e9c8c58c6fc8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.962261:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000007700e1ce/0xa5e9c8c58c6fc8b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.962269:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000007700e1ce/0xa5e9c8c58c6fc8b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.962273:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000007700e1ce already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305929.962274:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007700e1ce/0xa5e9c8c58c6fc8b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.962277:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007700e1ce/0xa5e9c8c58c6fc8b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.962281:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6e432aa8 (000000003362a53c) 00010000:00010000:0.0:1772305929.962283:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305929.962284:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000007700e1ce/0xa5e9c8c58c6fc8b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.962287:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007700e1ce/0xa5e9c8c58c6fc8b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.962301:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c6fc7d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f15b expref: 76 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.962306:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c6fc7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f15b expref: 76 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.962311:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a68ed1bf, rc 0) 00000100:00100000:0.0:1772305929.962337:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004dd780f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+75:99829:x1858396225400064:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 265us (346us total) trans 0 rc 301/301 00000100:00100000:0.0:1772305929.962342:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1105 00000100:00100000:1.0:1772305929.963273:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305929.963316:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225400128 00000100:00100000:0.0:1772305929.963350:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1106 00000100:00100000:0.0:1772305929.963369:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006e7b3ee8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+75:99829:x1858396225400128:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1772305929.963380:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305929.963390:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fc92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f162 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.963423:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c6fc99 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.963434:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c6fc99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.963442:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c6fc99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305929.963480:0:54698:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:0.0:1772305929.963484:0:54698:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 109 stripe count 1 MDT count 1 00000004:00010000:0.0:1772305929.963508:0:54698:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c6fc99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.963527:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fc92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f162 expref: 77 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.963540:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c6fc99 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f162 expref: 76 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.963548:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:0.0:1772305929.963551:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1772305929.963553:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b8f73038, rc 0) 00000100:00100000:0.0:1772305929.963585:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006e7b3ee8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+76:99829:x1858396225400128:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 217us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305929.963593:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1106 00000100:00100000:1.0:1772305929.965136:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305929.965221:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225400256 00000100:00100000:0.0:1772305929.965254:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1107 00000100:00100000:0.0:1772305929.965260:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ab80ba74 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+76:99829:x1858396225400256:12345-192.168.203.30@tcp:36:lfs.0 00010000:00010000:0.0:1772305929.965288:0:54698:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1772305929.965301:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c6fc99 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f162 expref: 76 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.965313:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:0.0:1772305929.965316:0:54698:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1772305929.965374:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cb557b9d/0xa5e9c8c58c6fca0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.965385:0:54698:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fc45 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f146 expref: 70 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.965392:0:54698:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cb557b9d/0xa5e9c8c58c6fca0 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.965421:0:54698:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fc45 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f146 expref: 70 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.965433:0:54698:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fc45 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f146 expref: 70 pid: 54698 timeout: 1341 lvb_type: 0 00000100:00100000:0.0:1772305929.965456:0:54698:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003fdd35f4 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:54698:1858396216608704:192.168.203.30@tcp:104: 00000100:00100000:0.0:1772305929.965511:0:54698:0:(client.c:2500:ptlrpc_set_wait()) set 00000000a5a7fd18 going to sleep for 6 seconds 00000100:00100000:0.0:1772305929.966392:0:54698:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003fdd35f4 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:54698:1858396216608704:192.168.203.30@tcp:104: 00010000:00010000:0.0:1772305929.966412:0:54698:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 00000000cb557b9d/0xa5e9c8c58c6fca0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305929.966587:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305929.966658:0:5493:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225400320 00010000:00010000:0.0:1772305929.966679:0:5493:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fc45 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f146 expref: 71 pid: 54698 timeout: 1341 lvb_type: 0 00000100:00100000:0.0:1772305929.966711:0:5493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3137 00000100:00100000:0.0:1772305929.966717:0:5493:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002e3a97d2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+71:2215:x1858396225400320:12345-192.168.203.30@tcp:103:ldlm_bl_07.0 00010000:00010000:0.0:1772305929.966728:0:5493:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1772305929.966733:0:5493:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fc45 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f146 expref: 71 pid: 54698 timeout: 1341 lvb_type: 0 00010000:00010000:0.0:1772305929.966742:0:5493:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fc45 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f146 expref: 71 pid: 54698 timeout: 1341 lvb_type: 0 00010000:00010000:0.0:1772305929.966755:0:5493:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fc45 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f146 expref: 71 pid: 54698 timeout: 1341 lvb_type: 0 00010000:00010000:0.0:1772305929.966766:0:5493:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:0.0:1772305929.966769:0:5493:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: 00000000cb557b9d/0xa5e9c8c58c6fca0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.966776:0:5493:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000cb557b9d/0xa5e9c8c58c6fca0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.966787:0:5493:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cb557b9d/0xa5e9c8c58c6fca0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.966811:0:5493:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1772305929.966844:0:5493:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002e3a97d2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+70:2215:x1858396225400320:12345-192.168.203.30@tcp:103:ldlm_bl_07.0 Request processed in 126us (258us total) trans 0 rc 0/0 00010000:00010000:1.0:1772305929.966846:0:54698:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 00000000cb557b9d/0xa5e9c8c58c6fca0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305929.966856:0:5493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3137 00010000:00010000:1.0:1772305929.966863:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cb557b9d/0xa5e9c8c58c6fca0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305929.966884:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6fca7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305929.966893:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6fca7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305929.966902:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6fca7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1772305929.967467:0:54698:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000408:0x95:0x0]: returning size 512 00010000:00010000:1.0:1772305929.967474:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cb557b9d/0xa5e9c8c58c6fca0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305929.967481:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cb557b9d/0xa5e9c8c58c6fca0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305929.967488:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cb557b9d/0xa5e9c8c58c6fca0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305929.967495:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cb557b9d already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305929.967498:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cb557b9d/0xa5e9c8c58c6fca0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305929.967504:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cb557b9d/0xa5e9c8c58c6fca0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305929.967520:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:1.0:1772305929.967524:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305929.967527:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cb557b9d/0xa5e9c8c58c6fca0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305929.967534:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cb557b9d/0xa5e9c8c58c6fca0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1772305929.967545:0:54698:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000ab80ba74 reply state 00000000bf40af4e transno 8589934954 ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6fca7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305929.967598:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ab80ba74 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+77:99829:x1858396225400256:12345-192.168.203.30@tcp:36:lfs.0 Request processed in 2337us (2464us total) trans 8589934954 rc 0/0 00000100:00100000:1.0:1772305929.967606:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1107 00010000:00010000:2.0:1772305929.968203:0:2977:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6fca7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305929.968210:0:2977:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6fca7 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305929.968215:0:2977:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6fca7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305929.968218:0:2977:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000043f9fbca already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305929.968220:0:2977:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6fca7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305929.968227:0:2977:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6fca7 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305929.968234:0:2977:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6e432aa8 (0000000067720f33) 00010000:00010000:2.0:1772305929.968236:0:2977:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305929.968237:0:2977:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6fca7 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305929.968241:0:2977:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6fca7 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305929.982611:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305929.982689:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225400448 00000100:00100000:1.0:1772305929.982737:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1108 00000100:00100000:1.0:1772305929.982742:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002754ee10 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+70:99833:x1858396225400448:12345-192.168.203.30@tcp:36:mkdir.0 00000100:00100000:1.0:1772305929.982906:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002754ee10 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+70:99833:x1858396225400448:12345-192.168.203.30@tcp:36:mkdir.0 Request processed in 164us (301us total) trans 0 rc -17/-17 00000100:00100000:1.0:1772305929.982913:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1108 00000100:00100000:1.0:1772305929.983671:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305929.983719:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225400512 00000100:00100000:0.0:1772305929.983755:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1109 00000100:00100000:0.0:1772305929.983761:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b07205c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+70:99833:x1858396225400512:12345-192.168.203.30@tcp:101:mkdir.0 00010000:00010000:0.0:1772305929.983773:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305929.983790:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fcae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f169 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.983830:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c6fcb5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.983844:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c6fcb5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.983855:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c6fcb5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.983867:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fcbc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.983873:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fcbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.983883:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fcbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.983981:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c6fcc3 lrc: 3/1,0 mode: --/PR res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.983988:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c6fcc3 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.983995:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c6fcc3 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305929.984030:0:54698:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000408:0x95:0x0]: returning size 512 00000004:00200000:0.0:1772305929.984034:0:54698:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1772305929.984052:0:54698:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c6fcc3 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.984062:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c6fcb5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.984068:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c6fcb5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.984073:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c6fcb5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.984078:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b8f73038 already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305929.984082:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c6fcb5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.984092:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c6fcb5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.984102:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:0.0:1772305929.984104:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305929.984107:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c6fcb5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.984113:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c6fcb5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.984124:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fcbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.984128:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fcbc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.984133:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fcbc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.984138:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000009a7ee7d5 already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305929.984140:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fcbc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.984145:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fcbc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.984151:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6e432aa8 (000000003362a53c) 00010000:00010000:0.0:1772305929.984153:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305929.984155:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fcbc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.984160:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fcbc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.984184:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fcae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f169 expref: 72 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.984196:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c6fcc3 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f169 expref: 71 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.984204:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0x0 (00000000d9ebda3c) 00010000:00010000:0.0:1772305929.984206:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1772305929.984208:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a68ed1bf, rc 0) 00000100:00100000:0.0:1772305929.984240:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b07205c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+71:99833:x1858396225400512:12345-192.168.203.30@tcp:101:mkdir.0 Request processed in 479us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305929.984246:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1109 00000100:00100000:2.0:1772305929.988863:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305929.988913:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225400576 00000100:00100000:0.0:1772305929.988952:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1110 00000100:00100000:0.0:1772305929.988957:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000051fa7b56 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+71:99834:x1858396225400576:12345-192.168.203.30@tcp:101:rm.0 00010000:00010000:0.0:1772305929.988971:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305929.988985:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007700e1ce/0xa5e9c8c58c6fcca lrc: 2/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f170 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.989026:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fcd1 lrc: 3/1,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.989035:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fcd1 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.989043:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fcd1 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.989052:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fcd8 lrc: 3/1,0 mode: --/PR res: [0x200000408:0x95:0x0].0xd86b4ffe bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.989057:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fcd8 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0xd86b4ffe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.989060:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fcd8 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0xd86b4ffe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.989111:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fcd1 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.989115:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fcd1 lrc: 2/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.989119:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fcd1 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.989123:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b501871d already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305929.989125:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fcd1 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.989129:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fcd1 lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.989136:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0x0 (00000000d9ebda3c) 00010000:00010000:0.0:1772305929.989138:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305929.989140:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fcd1 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.989144:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fcd1 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.989159:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fcd8 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0xd86b4ffe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.989162:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fcd8 lrc: 2/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0xd86b4ffe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.989166:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fcd8 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0xd86b4ffe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.989169:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c571a25b already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305929.989170:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fcd8 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0xd86b4ffe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.989173:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fcd8 lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0xd86b4ffe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.989177:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0xd86b4ffe (000000001ccb4b89) 00010000:00010000:0.0:1772305929.989179:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305929.989180:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fcd8 lrc: 2/0,0 mode: --/PR res: [0x200000408:0x95:0x0].0xd86b4ffe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.989183:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fcd8 lrc: 0/0,0 mode: --/PR res: [0x200000408:0x95:0x0].0xd86b4ffe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.989207:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000007700e1ce/0xa5e9c8c58c6fcca lrc: 1/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f170 expref: 72 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.989212:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007700e1ce/0xa5e9c8c58c6fcca lrc: 0/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f170 expref: 72 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.989218:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007700e1ce, rc 0) 00000100:00100000:0.0:1772305929.989256:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000051fa7b56 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+71:99834:x1858396225400576:12345-192.168.203.30@tcp:101:rm.0 Request processed in 298us (399us total) trans 0 rc 301/301 00000100:00100000:0.0:1772305929.989261:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1110 00000100:00100000:2.0:1772305929.993747:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305929.993788:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225400704 00000100:00100000:0.0:1772305929.993823:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1111 00000100:00100000:0.0:1772305929.993828:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000247170f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+71:99835:x1858396225400704:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:0.0:1772305929.993840:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305929.993843:0:54698:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1772305929.993863:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c6fcc3 lrc: 0/0,0 mode: --/PR res: [0x200000408:0x95:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f169 expref: 71 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.993879:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0x0 (00000000d9ebda3c) 00010000:00010000:0.0:1772305929.993887:0:54698:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1772305929.993899:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fcdf lrc: 2/0,0 mode: --/CW res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f177 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.993996:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fce6 lrc: 3/0,1 mode: --/CW res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.994005:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fce6 lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.994012:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fce6 lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.994019:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c6fced lrc: 3/0,1 mode: --/PW res: [0x200000408:0x95:0x0].0xd86b4ffe bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.994023:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c6fced lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x95:0x0].0xd86b4ffe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.994027:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c6fced lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x95:0x0].0xd86b4ffe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305929.994235:0:54722:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000216f6f28 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:54722:1858396216608768:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1772305929.994276:0:54722:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305929.994299:0:54722:0:(client.c:2500:ptlrpc_set_wait()) set 00000000c444c79d going to sleep for 6 seconds 00000100:00100000:1.0:1772305929.994333:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216608768 00000100:00100000:1.0:1772305929.994389:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5755 00000100:00100000:1.0:1772305929.994395:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000004a705af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:54722:x1858396216608768:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1772305929.994438:0:10520:0:(ofd_dev.c:1706:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x0 at 450 00000004:00080000:0.0:1772305929.994939:0:54698:0:(osp_object.c:1645:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x100010000:0x1b2:0x0], index 1: 0 00010000:00010000:0.0:1772305929.995124:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000067c6c66d/0xa5e9c8c58c6fcf4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x32f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.995134:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000067c6c66d/0xa5e9c8c58c6fcf4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x32f:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.995143:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000067c6c66d/0xa5e9c8c58c6fcf4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x32f:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.995180:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fce6 lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.995189:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fce6 lrc: 2/0,0 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.995196:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fce6 lrc: 3/0,0 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.995203:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000009a7ee7d5 already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305929.995206:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fce6 lrc: 3/0,0 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.995213:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fce6 lrc: 4/0,0 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.995221:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0x0 (000000003362a53c) 00010000:00010000:0.0:1772305929.995223:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305929.995226:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fce6 lrc: 2/0,0 mode: --/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.995231:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fce6 lrc: 0/0,0 mode: --/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1772305929.995239:0:54698:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000247170f2 reply state 00000000a9a56aba transno 8589934955 ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c6fced lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x95:0x0].0xd86b4ffe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.995257:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fcdf lrc: 0/0,0 mode: --/CW res: [0x200000408:0x95:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f177 expref: 73 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.995271:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000067c6c66d/0xa5e9c8c58c6fcf4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x32f:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f177 expref: 72 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305929.995275:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32f:0x0].0x0 (0000000008f76014) 00010000:00010000:0.0:1772305929.995277:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1772305929.995278:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000067c6c66d, rc 0) 00000100:00100000:0.0:1772305929.995319:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000247170f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+73:99835:x1858396225400704:12345-192.168.203.30@tcp:101:dd.0 Request processed in 1490us (1577us total) trans 8589934955 rc 0/0 00000100:00100000:0.0:1772305929.995325:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1111 00010000:00010000:3.0:1772305929.996063:0:2978:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c6fced lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x95:0x0].0xd86b4ffe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305929.996075:0:2978:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c6fced lrc: 2/0,0 mode: PW/PW res: [0x200000408:0x95:0x0].0xd86b4ffe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305929.996083:0:2978:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c6fced lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x95:0x0].0xd86b4ffe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305929.996103:0:2978:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b8f73038 already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305929.996105:0:2978:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c6fced lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x95:0x0].0xd86b4ffe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305929.996114:0:2978:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c6fced lrc: 4/0,0 mode: PW/PW res: [0x200000408:0x95:0x0].0xd86b4ffe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305929.996125:0:2978:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0xd86b4ffe (00000000a56a60e5) 00010000:00010000:3.0:1772305929.996128:0:2978:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305929.996130:0:2978:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c6fced lrc: 2/0,0 mode: --/PW res: [0x200000408:0x95:0x0].0xd86b4ffe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305929.996134:0:2978:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c6fced lrc: 0/0,0 mode: --/PW res: [0x200000408:0x95:0x0].0xd86b4ffe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305929.996577:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305929.996667:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225400832 00000100:00100000:3.0:1772305929.996703:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 143 00000100:00100000:3.0:1772305929.996709:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007b4cc173 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+72:99835:x1858396225400832:12345-192.168.203.30@tcp:35:dd.0 00000100:00100000:3.0:1772305929.996900:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007b4cc173 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+73:99835:x1858396225400832:12345-192.168.203.30@tcp:35:dd.0 Request processed in 189us (325us total) trans 8589934956 rc 0/0 00000100:00100000:3.0:1772305929.996914:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 143 00000100:00100000:1.0:1772305930.000091:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000004a705af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:54722:x1858396216608768:12345-0@lo:5:osp-pre-1-0.0 Request processed in 5695us (5813us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305930.000102:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5755 00000100:00100000:3.0:1772305930.000132:0:54722:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000216f6f28 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:54722:1858396216608768:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1772305930.000145:0:54722:0:(osp_precreate.c:722:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x100010000:0x1b2:0x0]-[0x100010000:0x1e1:0x0] 00000100:00100000:2.0:1772305930.004656:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305930.004695:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225400896 00000100:00100000:0.0:1772305930.004746:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1112 00000100:00100000:0.0:1772305930.004755:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ab9fc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+73:99836:x1858396225400896:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1772305930.004777:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305930.004795:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007700e1ce/0xa5e9c8c58c6fd02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f17e expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.004849:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fd09 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.004864:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fd09 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.004875:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fd09 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.004888:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fd10 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.004896:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fd10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.004902:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fd10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.004999:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c0d6152b/0xa5e9c8c58c6fd17 lrc: 3/1,0 mode: --/PR res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.005014:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c0d6152b/0xa5e9c8c58c6fd17 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.005020:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c0d6152b/0xa5e9c8c58c6fd17 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305930.005048:0:54698:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000408:0x95:0x0]: returning size 512 00000004:00200000:0.0:1772305930.005052:0:54698:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1772305930.005075:0:54698:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000c0d6152b/0xa5e9c8c58c6fd17 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.005085:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fd09 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.005091:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fd09 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.005097:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fd09 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.005103:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c571a25b already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305930.005107:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fd09 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.005113:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fd09 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.005123:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:0.0:1772305930.005126:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305930.005130:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fd09 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.005135:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fd09 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.005145:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fd10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.005150:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fd10 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.005156:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fd10 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.005162:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b501871d already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305930.005164:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fd10 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.005169:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fd10 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.005176:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6e432aa8 (000000001ccb4b89) 00010000:00010000:0.0:1772305930.005179:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305930.005181:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fd10 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.005187:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fd10 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.005214:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007700e1ce/0xa5e9c8c58c6fd02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f17e expref: 75 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.005227:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000c0d6152b/0xa5e9c8c58c6fd17 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f17e expref: 74 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.005234:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0x0 (00000000fbf66531) 00010000:00010000:0.0:1772305930.005236:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1772305930.005238:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c0d6152b, rc 0) 00000100:00100000:0.0:1772305930.005284:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ab9fc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+74:99836:x1858396225400896:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 529us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305930.005292:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1112 00000100:00100000:2.0:1772305930.019205:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305930.019278:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225400960 00000100:00100000:0.0:1772305930.019325:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1113 00000100:00100000:0.0:1772305930.019331:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000001ffe0a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+74:99841:x1858396225400960:12345-192.168.203.30@tcp:101:mkdir.0 00010000:00010000:0.0:1772305930.019371:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305930.019390:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007700e1ce/0xa5e9c8c58c6fd1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f185 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.019441:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fd25 lrc: 3/1,0 mode: --/PR res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.019452:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fd25 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.019460:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fd25 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305930.019515:0:54698:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000408:0x95:0x0]: returning size 512 00000004:00200000:0.0:1772305930.019518:0:54698:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1772305930.019534:0:54698:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fd25 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.019553:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007700e1ce/0xa5e9c8c58c6fd1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f185 expref: 76 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.019564:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fd25 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f185 expref: 75 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.019570:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0x0 (00000000fbf66531) 00010000:00010000:0.0:1772305930.019572:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1772305930.019574:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b501871d, rc 0) 00000100:00100000:0.0:1772305930.019620:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000001ffe0a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+75:99841:x1858396225400960:12345-192.168.203.30@tcp:101:mkdir.0 Request processed in 289us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305930.019650:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1113 00000100:00100000:2.0:1772305930.023405:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305930.023440:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225401024 00000100:00100000:0.0:1772305930.023465:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1114 00000100:00100000:0.0:1772305930.023470:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004bd7f675 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+75:99842:x1858396225401024:12345-192.168.203.30@tcp:101:rm.0 00010000:00010000:0.0:1772305930.023483:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305930.023491:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fd2c lrc: 2/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f18c expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.023517:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fd33 lrc: 3/1,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.023523:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fd33 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.023529:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fd33 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.023571:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fd3a lrc: 3/1,0 mode: --/PR res: [0x200000408:0x95:0x0].0xa2905c76 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.023577:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fd3a lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0xa2905c76 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.023581:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fd3a lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0xa2905c76 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.023617:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fd33 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.023622:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fd33 lrc: 2/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.023650:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fd33 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.023655:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000809cda8f already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305930.023658:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fd33 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.023663:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fd33 lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.023672:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0x0 (00000000fbf66531) 00010000:00010000:0.0:1772305930.023674:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305930.023676:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fd33 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.023684:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fd33 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.023692:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fd3a lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0xa2905c76 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.023695:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fd3a lrc: 2/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0xa2905c76 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.023699:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fd3a lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0xa2905c76 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.023702:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000009a7ee7d5 already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305930.023703:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fd3a lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0xa2905c76 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.023706:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fd3a lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0xa2905c76 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.023710:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0xa2905c76 (000000001ccb4b89) 00010000:00010000:0.0:1772305930.023712:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305930.023713:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fd3a lrc: 2/0,0 mode: --/PR res: [0x200000408:0x95:0x0].0xa2905c76 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.023716:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fd3a lrc: 0/0,0 mode: --/PR res: [0x200000408:0x95:0x0].0xa2905c76 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.023731:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fd2c lrc: 1/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f18c expref: 76 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.023741:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fd2c lrc: 0/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f18c expref: 76 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.023750:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c571a25b, rc 0) 00000100:00100000:0.0:1772305930.023785:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004bd7f675 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+75:99842:x1858396225401024:12345-192.168.203.30@tcp:101:rm.0 Request processed in 314us (382us total) trans 0 rc 301/301 00000100:00100000:0.0:1772305930.023793:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1114 00000100:00100000:2.0:1772305930.027325:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305930.027382:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225401152 00000100:00100000:0.0:1772305930.027418:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1115 00000100:00100000:0.0:1772305930.027423:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ddcf1b3f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+75:99843:x1858396225401152:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:0.0:1772305930.027433:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305930.027435:0:54698:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1772305930.027449:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fd25 lrc: 0/0,0 mode: --/PR res: [0x200000408:0x95:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f185 expref: 75 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.027462:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0x0 (00000000fbf66531) 00010000:00010000:0.0:1772305930.027465:0:54698:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1772305930.027472:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c6fd41 lrc: 2/0,0 mode: --/CW res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f193 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.027533:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000004402aedf/0xa5e9c8c58c6fd48 lrc: 3/0,1 mode: --/CW res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.027541:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000004402aedf/0xa5e9c8c58c6fd48 lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.027546:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004402aedf/0xa5e9c8c58c6fd48 lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.027554:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000096601b0a/0xa5e9c8c58c6fd4f lrc: 3/0,1 mode: --/PW res: [0x200000408:0x95:0x0].0xa2905c76 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.027559:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000096601b0a/0xa5e9c8c58c6fd4f lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x95:0x0].0xa2905c76 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.027562:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000096601b0a/0xa5e9c8c58c6fd4f lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x95:0x0].0xa2905c76 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305930.027769:0:54720:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004f8db88b pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:54720:1858396216608832:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1772305930.027814:0:54720:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305930.027835:0:54720:0:(client.c:2500:ptlrpc_set_wait()) set 00000000e1b9b3a0 going to sleep for 6 seconds 00000100:00100000:3.0:1772305930.027875:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216608832 00000004:00080000:0.0:1772305930.027896:0:54698:0:(osp_object.c:1645:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x100000000:0x1b2:0x0], index 0: 0 00000100:00100000:3.0:1772305930.027914:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5756 00000100:00100000:3.0:1772305930.027918:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000028c6430b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:54720:x1858396216608832:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1772305930.027966:0:10520:0:(ofd_dev.c:1706:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x0 at 450 00010000:00010000:0.0:1772305930.028045:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000007700e1ce/0xa5e9c8c58c6fd56 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x330:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.028054:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007700e1ce/0xa5e9c8c58c6fd56 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x330:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.028061:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007700e1ce/0xa5e9c8c58c6fd56 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x330:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.028100:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000004402aedf/0xa5e9c8c58c6fd48 lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.028107:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000004402aedf/0xa5e9c8c58c6fd48 lrc: 2/0,0 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.028114:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000004402aedf/0xa5e9c8c58c6fd48 lrc: 3/0,0 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.028120:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000004402aedf already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305930.028123:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004402aedf/0xa5e9c8c58c6fd48 lrc: 3/0,0 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.028130:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004402aedf/0xa5e9c8c58c6fd48 lrc: 4/0,0 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.028138:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0x0 (00000000fbf66531) 00010000:00010000:0.0:1772305930.028140:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305930.028142:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000004402aedf/0xa5e9c8c58c6fd48 lrc: 2/0,0 mode: --/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.028147:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004402aedf/0xa5e9c8c58c6fd48 lrc: 0/0,0 mode: --/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1772305930.028156:0:54698:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000ddcf1b3f reply state 000000008970b985 transno 8589934957 ns: mdt-lustre-MDT0000_UUID lock: 0000000096601b0a/0xa5e9c8c58c6fd4f lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x95:0x0].0xa2905c76 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.028177:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c6fd41 lrc: 0/0,0 mode: --/CW res: [0x200000408:0x95:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f193 expref: 77 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.028189:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000007700e1ce/0xa5e9c8c58c6fd56 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x330:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f193 expref: 76 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.028196:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x330:0x0].0x0 (00000000d9ebda3c) 00010000:00010000:0.0:1772305930.028198:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1772305930.028200:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007700e1ce, rc 0) 00000100:00100000:0.0:1772305930.028242:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ddcf1b3f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+77:99843:x1858396225401152:12345-192.168.203.30@tcp:101:dd.0 Request processed in 817us (919us total) trans 8589934957 rc 0/0 00000100:00100000:0.0:1772305930.028250:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1115 00010000:00010000:1.0:1772305930.028839:0:2977:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000096601b0a/0xa5e9c8c58c6fd4f lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x95:0x0].0xa2905c76 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305930.028851:0:2977:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000096601b0a/0xa5e9c8c58c6fd4f lrc: 2/0,0 mode: PW/PW res: [0x200000408:0x95:0x0].0xa2905c76 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305930.028866:0:2977:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000096601b0a/0xa5e9c8c58c6fd4f lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x95:0x0].0xa2905c76 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305930.028873:0:2977:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000096601b0a already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305930.028876:0:2977:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000096601b0a/0xa5e9c8c58c6fd4f lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x95:0x0].0xa2905c76 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305930.028885:0:2977:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000096601b0a/0xa5e9c8c58c6fd4f lrc: 4/0,0 mode: PW/PW res: [0x200000408:0x95:0x0].0xa2905c76 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305930.028896:0:2977:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0xa2905c76 (000000003362a53c) 00010000:00010000:1.0:1772305930.028899:0:2977:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305930.028901:0:2977:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000096601b0a/0xa5e9c8c58c6fd4f lrc: 2/0,0 mode: --/PW res: [0x200000408:0x95:0x0].0xa2905c76 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305930.028907:0:2977:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000096601b0a/0xa5e9c8c58c6fd4f lrc: 0/0,0 mode: --/PW res: [0x200000408:0x95:0x0].0xa2905c76 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305930.029431:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305930.029475:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225401280 00000100:00100000:0.0:1772305930.029504:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 144 00000100:00100000:0.0:1772305930.029509:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007194ab5d pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+76:99843:x1858396225401280:12345-192.168.203.30@tcp:35:dd.0 00000100:00100000:0.0:1772305930.029706:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007194ab5d pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+77:99843:x1858396225401280:12345-192.168.203.30@tcp:35:dd.0 Request processed in 196us (276us total) trans 8589934958 rc 0/0 00000100:00100000:0.0:1772305930.029713:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 144 00000100:00100000:3.0:1772305930.033538:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000028c6430b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:54720:x1858396216608832:12345-0@lo:5:osp-pre-0-0.0 Request processed in 5617us (5722us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305930.033547:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5756 00000100:00100000:1.0:1772305930.033585:0:54720:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004f8db88b pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:54720:1858396216608832:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1772305930.033598:0:54720:0:(osp_precreate.c:722:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x100000000:0x1b2:0x0]-[0x100000000:0x1e1:0x0] 00000100:00100000:2.0:1772305930.051399:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305930.051440:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225401344 00000100:00100000:0.0:1772305930.051489:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1116 00000100:00100000:0.0:1772305930.051495:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c4b697c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+77:99849:x1858396225401344:12345-192.168.203.30@tcp:101:mkdir.0 00010000:00010000:0.0:1772305930.051522:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305930.051542:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c6fd64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f19a expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.051594:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000004402aedf/0xa5e9c8c58c6fd6b lrc: 3/1,0 mode: --/PR res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.051606:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000004402aedf/0xa5e9c8c58c6fd6b lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.051614:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004402aedf/0xa5e9c8c58c6fd6b lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305930.051691:0:54698:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000408:0x95:0x0]: returning size 512 00000004:00200000:0.0:1772305930.051694:0:54698:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1772305930.051710:0:54698:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 000000004402aedf/0xa5e9c8c58c6fd6b lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.051728:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c6fd64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f19a expref: 79 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.051744:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000004402aedf/0xa5e9c8c58c6fd6b lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f19a expref: 78 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.051750:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0x0 (00000000fbf66531) 00010000:00010000:0.0:1772305930.051752:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1772305930.051754:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004402aedf, rc 0) 00000100:00100000:0.0:1772305930.051799:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c4b697c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+78:99849:x1858396225401344:12345-192.168.203.30@tcp:101:mkdir.0 Request processed in 305us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305930.051804:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1116 00000100:00100000:2.0:1772305930.055303:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305930.055343:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225401408 00000100:00100000:0.0:1772305930.055385:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1117 00000100:00100000:0.0:1772305930.055390:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000021838e42 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+78:99850:x1858396225401408:12345-192.168.203.30@tcp:101:rm.0 00010000:00010000:0.0:1772305930.055403:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305930.055414:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fd72 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f1a1 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.055442:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fd79 lrc: 3/1,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.055450:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fd79 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.055456:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fd79 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.055471:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fd80 lrc: 3/1,0 mode: --/PR res: [0x200000408:0x95:0x0].0x9838e759 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.055480:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fd80 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.055484:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fd80 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.055522:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fd79 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.055527:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fd79 lrc: 2/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.055531:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fd79 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.055535:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c571a25b already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305930.055538:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fd79 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.055543:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fd79 lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.055549:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0x0 (00000000fbf66531) 00010000:00010000:0.0:1772305930.055551:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305930.055553:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fd79 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.055556:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fd79 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.055567:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fd80 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.055571:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fd80 lrc: 2/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.055575:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fd80 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.055578:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000009a7ee7d5 already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305930.055579:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fd80 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.055582:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fd80 lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.055586:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0x9838e759 (000000001ccb4b89) 00010000:00010000:0.0:1772305930.055587:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305930.055588:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fd80 lrc: 2/0,0 mode: --/PR res: [0x200000408:0x95:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.055591:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fd80 lrc: 0/0,0 mode: --/PR res: [0x200000408:0x95:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.055606:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fd72 lrc: 1/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1a1 expref: 79 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.055611:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fd72 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1a1 expref: 79 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.055620:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b501871d, rc 0) 00000100:00100000:0.0:1772305930.055666:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000021838e42 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+78:99850:x1858396225401408:12345-192.168.203.30@tcp:101:rm.0 Request processed in 275us (366us total) trans 0 rc 301/301 00000100:00100000:0.0:1772305930.055672:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1117 00000100:00100000:2.0:1772305930.059588:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305930.059653:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225401536 00000100:00100000:0.0:1772305930.059697:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1118 00000100:00100000:0.0:1772305930.059705:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a22e9c5f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+78:99851:x1858396225401536:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:0.0:1772305930.059719:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305930.059722:0:54698:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1772305930.059742:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004402aedf/0xa5e9c8c58c6fd6b lrc: 0/0,0 mode: --/PR res: [0x200000408:0x95:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f19a expref: 78 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.059757:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0x0 (00000000fbf66531) 00010000:00010000:0.0:1772305930.059761:0:54698:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1772305930.059770:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fd87 lrc: 2/0,0 mode: --/CW res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f1a8 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.059869:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c6fd8e lrc: 3/0,1 mode: --/CW res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.059881:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c6fd8e lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.059890:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c6fd8e lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.059902:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000066b8a8ab/0xa5e9c8c58c6fd95 lrc: 3/0,1 mode: --/PW res: [0x200000408:0x95:0x0].0x9838e759 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.059910:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000066b8a8ab/0xa5e9c8c58c6fd95 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x95:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.059917:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000066b8a8ab/0xa5e9c8c58c6fd95 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x95:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1772305930.060833:0:54698:0:(osp_object.c:1645:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x100010000:0x1b3:0x0], index 1: 0 00010000:00010000:0.0:1772305930.060984:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c6fd9c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x331:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.060994:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c6fd9c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x331:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.061002:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c6fd9c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x331:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.061035:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c6fd8e lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.061040:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c6fd8e lrc: 2/0,0 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.061045:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c6fd8e lrc: 3/0,0 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.061048:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000005803c629 already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305930.061050:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c6fd8e lrc: 3/0,0 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.061058:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c6fd8e lrc: 4/0,0 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.061064:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0x0 (00000000fbf66531) 00010000:00010000:0.0:1772305930.061066:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305930.061067:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c6fd8e lrc: 2/0,0 mode: --/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.061071:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c6fd8e lrc: 0/0,0 mode: --/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1772305930.061078:0:54698:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000a22e9c5f reply state 000000009ea2e622 transno 8589934959 ns: mdt-lustre-MDT0000_UUID lock: 0000000066b8a8ab/0xa5e9c8c58c6fd95 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x95:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.061094:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fd87 lrc: 0/0,0 mode: --/CW res: [0x200000408:0x95:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1a8 expref: 80 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.061102:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c6fd9c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x331:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1a8 expref: 79 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.061106:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x331:0x0].0x0 (00000000499b0bdb) 00010000:00010000:0.0:1772305930.061108:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1772305930.061109:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a68ed1bf, rc 0) 00000100:00100000:0.0:1772305930.061148:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a22e9c5f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+80:99851:x1858396225401536:12345-192.168.203.30@tcp:101:dd.0 Request processed in 1445us (1563us total) trans 8589934959 rc 0/0 00000100:00100000:0.0:1772305930.061153:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1118 00010000:00010000:3.0:1772305930.061749:0:2978:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000066b8a8ab/0xa5e9c8c58c6fd95 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x95:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305930.061758:0:2978:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000066b8a8ab/0xa5e9c8c58c6fd95 lrc: 2/0,0 mode: PW/PW res: [0x200000408:0x95:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305930.061763:0:2978:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000066b8a8ab/0xa5e9c8c58c6fd95 lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x95:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305930.061767:0:2978:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000066b8a8ab already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305930.061768:0:2978:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000066b8a8ab/0xa5e9c8c58c6fd95 lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x95:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305930.061772:0:2978:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000066b8a8ab/0xa5e9c8c58c6fd95 lrc: 4/0,0 mode: PW/PW res: [0x200000408:0x95:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305930.061780:0:2978:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0x9838e759 (000000002cd22d98) 00010000:00010000:3.0:1772305930.061782:0:2978:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305930.061783:0:2978:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000066b8a8ab/0xa5e9c8c58c6fd95 lrc: 2/0,0 mode: --/PW res: [0x200000408:0x95:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305930.061787:0:2978:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000066b8a8ab/0xa5e9c8c58c6fd95 lrc: 0/0,0 mode: --/PW res: [0x200000408:0x95:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305930.062153:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305930.062210:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225401664 00000100:00100000:0.0:1772305930.062245:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 145 00000100:00100000:0.0:1772305930.062250:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ae945845 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+79:99851:x1858396225401664:12345-192.168.203.30@tcp:35:dd.0 00000100:00100000:0.0:1772305930.062404:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ae945845 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+80:99851:x1858396225401664:12345-192.168.203.30@tcp:35:dd.0 Request processed in 153us (252us total) trans 8589934960 rc 0/0 00000100:00100000:0.0:1772305930.062410:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 145 00000100:00100000:2.0:1772305930.080071:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305930.080130:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225401728 00000100:00100000:0.0:1772305930.080172:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1119 00000100:00100000:0.0:1772305930.080178:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bbc49ac3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+80:99857:x1858396225401728:12345-192.168.203.30@tcp:101:mkdir.0 00010000:00010000:0.0:1772305930.080204:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305930.080220:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fdaa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f1af expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.080287:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c6fdb1 lrc: 3/1,0 mode: --/PR res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.080298:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c6fdb1 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.080306:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c6fdb1 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305930.080367:0:54698:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000408:0x95:0x0]: returning size 512 00000004:00200000:0.0:1772305930.080371:0:54698:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1772305930.080394:0:54698:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c6fdb1 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.080422:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fdaa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1af expref: 82 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.080435:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c6fdb1 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1af expref: 81 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.080442:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0x0 (00000000fbf66531) 00010000:00010000:0.0:1772305930.080444:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1772305930.080446:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005803c629, rc 0) 00000100:00100000:0.0:1772305930.080495:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bbc49ac3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+81:99857:x1858396225401728:12345-192.168.203.30@tcp:101:mkdir.0 Request processed in 316us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305930.080500:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1119 00000100:00100000:2.0:1772305930.083762:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305930.083804:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225401792 00000100:00100000:0.0:1772305930.083832:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1120 00000100:00100000:0.0:1772305930.083837:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007f8629ff pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+81:99858:x1858396225401792:12345-192.168.203.30@tcp:101:rm.0 00010000:00010000:0.0:1772305930.083845:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305930.083854:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004402aedf/0xa5e9c8c58c6fdb8 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f1b6 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.083887:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fdbf lrc: 3/1,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.083895:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fdbf lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.083901:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fdbf lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.083909:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fdc6 lrc: 3/1,0 mode: --/PR res: [0x200000408:0x95:0x0].0x1313e569 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.083914:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fdc6 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.083922:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fdc6 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.083964:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fdbf lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.083969:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fdbf lrc: 2/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.083974:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fdbf lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.083978:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b501871d already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305930.083980:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fdbf lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.083984:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fdbf lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.083990:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0x0 (00000000fbf66531) 00010000:00010000:0.0:1772305930.083992:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305930.083994:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fdbf lrc: 2/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.083998:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fdbf lrc: 0/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.084005:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fdc6 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.084013:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fdc6 lrc: 2/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.084016:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fdc6 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.084019:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000009a7ee7d5 already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305930.084020:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fdc6 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.084024:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fdc6 lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.084030:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0x1313e569 (000000001ccb4b89) 00010000:00010000:0.0:1772305930.084032:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305930.084034:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fdc6 lrc: 2/0,0 mode: --/PR res: [0x200000408:0x95:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.084039:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fdc6 lrc: 0/0,0 mode: --/PR res: [0x200000408:0x95:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.084061:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000004402aedf/0xa5e9c8c58c6fdb8 lrc: 1/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1b6 expref: 82 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.084069:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004402aedf/0xa5e9c8c58c6fdb8 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1b6 expref: 82 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.084078:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004402aedf, rc 0) 00000100:00100000:0.0:1772305930.084120:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007f8629ff pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+81:99858:x1858396225401792:12345-192.168.203.30@tcp:101:rm.0 Request processed in 282us (359us total) trans 0 rc 301/301 00000100:00100000:0.0:1772305930.084126:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1120 00000100:00100000:2.0:1772305930.087959:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305930.088004:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225401920 00000100:00100000:0.0:1772305930.088035:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1121 00000100:00100000:0.0:1772305930.088040:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000060c5d597 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+81:99859:x1858396225401920:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:0.0:1772305930.088052:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305930.088054:0:54698:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1772305930.088070:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c6fdb1 lrc: 0/0,0 mode: --/PR res: [0x200000408:0x95:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1af expref: 81 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.088083:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0x0 (00000000fbf66531) 00010000:00010000:0.0:1772305930.088086:0:54698:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1772305930.088099:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fdcd lrc: 2/0,0 mode: --/CW res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f1bd expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.088177:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fdd4 lrc: 3/0,1 mode: --/CW res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.088185:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fdd4 lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.088191:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fdd4 lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.088199:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000066b8a8ab/0xa5e9c8c58c6fddb lrc: 3/0,1 mode: --/PW res: [0x200000408:0x95:0x0].0x1313e569 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.088204:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000066b8a8ab/0xa5e9c8c58c6fddb lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x95:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.088208:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000066b8a8ab/0xa5e9c8c58c6fddb lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x95:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1772305930.088476:0:54698:0:(osp_object.c:1645:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x100000000:0x1b3:0x0], index 0: 0 00010000:00010000:0.0:1772305930.088603:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000096601b0a/0xa5e9c8c58c6fde2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x332:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.088610:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000096601b0a/0xa5e9c8c58c6fde2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x332:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.088615:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000096601b0a/0xa5e9c8c58c6fde2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x332:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.088659:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fdd4 lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.088664:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fdd4 lrc: 2/0,0 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.088668:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fdd4 lrc: 3/0,0 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.088672:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c571a25b already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305930.088674:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fdd4 lrc: 3/0,0 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.088678:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fdd4 lrc: 4/0,0 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.088687:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0x0 (00000000fbf66531) 00010000:00010000:0.0:1772305930.088689:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305930.088691:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fdd4 lrc: 2/0,0 mode: --/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.088694:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fdd4 lrc: 0/0,0 mode: --/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1772305930.088701:0:54698:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000060c5d597 reply state 000000000f838601 transno 8589934961 ns: mdt-lustre-MDT0000_UUID lock: 0000000066b8a8ab/0xa5e9c8c58c6fddb lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x95:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.088716:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fdcd lrc: 0/0,0 mode: --/CW res: [0x200000408:0x95:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1bd expref: 83 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.088723:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000096601b0a/0xa5e9c8c58c6fde2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x332:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1bd expref: 82 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.088728:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x332:0x0].0x0 (0000000013d42fff) 00010000:00010000:0.0:1772305930.088729:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1772305930.088730:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000096601b0a, rc 0) 00000100:00100000:0.0:1772305930.088768:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000060c5d597 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+83:99859:x1858396225401920:12345-192.168.203.30@tcp:101:dd.0 Request processed in 727us (812us total) trans 8589934961 rc 0/0 00000100:00100000:0.0:1772305930.088773:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1121 00010000:00010000:1.0:1772305930.089311:0:2977:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000066b8a8ab/0xa5e9c8c58c6fddb lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x95:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305930.089323:0:2977:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000066b8a8ab/0xa5e9c8c58c6fddb lrc: 2/0,0 mode: PW/PW res: [0x200000408:0x95:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305930.089330:0:2977:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000066b8a8ab/0xa5e9c8c58c6fddb lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x95:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305930.089337:0:2977:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000066b8a8ab already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305930.089340:0:2977:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000066b8a8ab/0xa5e9c8c58c6fddb lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x95:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305930.089347:0:2977:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000066b8a8ab/0xa5e9c8c58c6fddb lrc: 4/0,0 mode: PW/PW res: [0x200000408:0x95:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305930.089373:0:2977:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0x1313e569 (00000000bbfe3173) 00010000:00010000:1.0:1772305930.089376:0:2977:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305930.089379:0:2977:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000066b8a8ab/0xa5e9c8c58c6fddb lrc: 2/0,0 mode: --/PW res: [0x200000408:0x95:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305930.089385:0:2977:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000066b8a8ab/0xa5e9c8c58c6fddb lrc: 0/0,0 mode: --/PW res: [0x200000408:0x95:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305930.089831:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305930.089863:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225402048 00000100:00100000:0.0:1772305930.089892:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 146 00000100:00100000:0.0:1772305930.089896:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002e1b92f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+82:99859:x1858396225402048:12345-192.168.203.30@tcp:35:dd.0 00000100:00100000:0.0:1772305930.090084:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002e1b92f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+83:99859:x1858396225402048:12345-192.168.203.30@tcp:35:dd.0 Request processed in 186us (254us total) trans 8589934962 rc 0/0 00000100:00100000:0.0:1772305930.090095:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 146 00000100:00100000:2.0:1772305930.104490:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305930.104549:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225402112 00000100:00100000:0.0:1772305930.104595:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1122 00000100:00100000:0.0:1772305930.104601:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007849933b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+76:99862:x1858396225402112:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1772305930.104623:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305930.104659:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fdf0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f1c4 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.104707:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fdf7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.104718:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fdf7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.104727:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fdf7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.104737:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c6fdfe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.104741:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c6fdfe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.104745:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c6fdfe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.104870:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000004402aedf/0xa5e9c8c58c6fe05 lrc: 3/1,0 mode: --/PR res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.104886:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000004402aedf/0xa5e9c8c58c6fe05 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.104894:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004402aedf/0xa5e9c8c58c6fe05 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305930.104927:0:54698:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000408:0x95:0x0]: returning size 512 00000004:00200000:0.0:1772305930.104931:0:54698:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1772305930.104964:0:54698:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 000000004402aedf/0xa5e9c8c58c6fe05 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.104976:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fdf7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.104983:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fdf7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.104990:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fdf7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.104996:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c571a25b already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305930.105000:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fdf7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.105008:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fdf7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.105020:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:0.0:1772305930.105024:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305930.105028:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fdf7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.105035:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fdf7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.105047:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c6fdfe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.105054:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c6fdfe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.105062:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c6fdfe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.105067:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000005803c629 already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305930.105069:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c6fdfe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.105076:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c6fdfe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.105084:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6e432aa8 (000000001ccb4b89) 00010000:00010000:0.0:1772305930.105086:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305930.105088:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c6fdfe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.105095:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c6fdfe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6e432aa8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.105123:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fdf0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1c4 expref: 78 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.105137:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000004402aedf/0xa5e9c8c58c6fe05 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1c4 expref: 77 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.105158:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0x0 (00000000fbf66531) 00010000:00010000:0.0:1772305930.105160:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1772305930.105162:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004402aedf, rc 0) 00000100:00100000:0.0:1772305930.105221:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007849933b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+77:99862:x1858396225402112:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 619us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305930.105229:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1122 00000100:00100000:2.0:1772305930.106320:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305930.106374:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225402176 00000100:00100000:1.0:1772305930.106415:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1123 00000100:00100000:1.0:1772305930.106420:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000080700327 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+77:99862:x1858396225402176:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1772305930.106430:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305930.106440:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ee5a0681/0xa5e9c8c58c6fe0c lrc: 2/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f1cb expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305930.106465:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6fe13 lrc: 3/1,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305930.106472:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6fe13 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305930.106478:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6fe13 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305930.106486:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6fe1a lrc: 3/1,0 mode: --/PR res: [0x200000408:0x95:0x0].0x9838e759 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305930.106491:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6fe1a lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305930.106496:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6fe1a lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305930.106546:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6fe21 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x331:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305930.106551:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6fe21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305930.106556:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6fe21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1772305930.106572:0:54697:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x331:0x0]: returning size 0 00000004:00200000:1.0:1772305930.106574:0:54697:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1772305930.106582:0:54697:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6fe21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305930.106588:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6fe21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305930.106593:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6fe13 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305930.106597:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6fe13 lrc: 2/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305930.106601:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6fe13 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305930.106605:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000043f9fbca already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305930.106606:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6fe13 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305930.106610:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6fe13 lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305930.106616:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0x0 (00000000fbf66531) 00010000:00010000:1.0:1772305930.106618:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305930.106620:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6fe13 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305930.106624:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6fe13 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305930.106664:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6fe1a lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305930.106669:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6fe1a lrc: 2/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305930.106673:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6fe1a lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305930.106677:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a84c62ba already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305930.106679:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6fe1a lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305930.106683:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6fe1a lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305930.106691:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0x9838e759 (0000000027e5c018) 00010000:00010000:1.0:1772305930.106693:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305930.106694:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6fe1a lrc: 2/0,0 mode: --/PR res: [0x200000408:0x95:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305930.106698:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6fe1a lrc: 0/0,0 mode: --/PR res: [0x200000408:0x95:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305930.106716:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ee5a0681/0xa5e9c8c58c6fe0c lrc: 0/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1cb expref: 79 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305930.106724:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6fe21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1cb expref: 78 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305930.106729:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x331:0x0].0x0 (00000000499b0bdb) 00010000:00010000:1.0:1772305930.106731:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1772305930.106732:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000048d87789, rc 0) 00000100:00100000:1.0:1772305930.106760:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000080700327 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+78:99862:x1858396225402176:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 340us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305930.106767:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1123 00000100:00100000:2.0:1772305930.107850:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305930.107900:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225402240 00000100:00100000:3.0:1772305930.107938:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5757 00000100:00100000:3.0:1772305930.107942:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000044129035 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+142:2218:x1858396225402240:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1772305930.107950:0:10520:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305930.107963:0:10520:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6fe28 lrc: 2/0,0 mode: --/PR res: [0x1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f1d2 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1772305930.107979:0:10520:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x1b3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1772305930.107990:0:10520:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1772305930.107992:0:10520:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1772305930.107997:0:10520:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6fe28 lrc: 3/0,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1d2 expref: 143 pid: 10520 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1772305930.108007:0:10520:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6fe28 lrc: 3/0,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1d2 expref: 143 pid: 10520 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1772305930.108015:0:10520:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000051c27e8b, rc 0) 00000100:00100000:3.0:1772305930.108040:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000044129035 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2218:x1858396225402240:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 98us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305930.108046:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5757 00000100:00100000:2.0:1772305930.109031:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305930.109069:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225402304 00000100:00100000:0.0:1772305930.109095:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1124 00000100:00100000:0.0:1772305930.109099:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a6b9f11f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+78:99862:x1858396225402304:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1772305930.109106:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305930.109115:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fe2f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f1d9 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.109137:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fe36 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.109145:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fe36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.109151:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fe36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305930.109175:0:54698:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:0.0:1772305930.109177:0:54698:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 110 stripe count 1 MDT count 1 00000004:00010000:0.0:1772305930.109187:0:54698:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fe36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.109199:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fe2f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1d9 expref: 80 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.109207:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fe36 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1d9 expref: 79 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.109212:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:0.0:1772305930.109214:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1772305930.109216:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b501871d, rc 0) 00000100:00100000:0.0:1772305930.109246:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a6b9f11f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+79:99862:x1858396225402304:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 145us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305930.109253:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1124 00000100:00100000:2.0:1772305930.110083:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305930.110130:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225402368 00000100:00100000:0.0:1772305930.110163:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1125 00000100:00100000:0.0:1772305930.110169:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000af392ea5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+79:99862:x1858396225402368:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1772305930.110180:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305930.110190:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c6fe3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f1e0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.110220:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000cb557b9d/0xa5e9c8c58c6fe44 lrc: 3/1,0 mode: --/PR res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.110230:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cb557b9d/0xa5e9c8c58c6fe44 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.110239:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cb557b9d/0xa5e9c8c58c6fe44 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305930.110265:0:54698:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000408:0x95:0x0]: returning size 512 00000004:00200000:0.0:1772305930.110268:0:54698:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1772305930.110282:0:54698:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000cb557b9d/0xa5e9c8c58c6fe44 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.110299:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c6fe3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1e0 expref: 81 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.110313:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000cb557b9d/0xa5e9c8c58c6fe44 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1e0 expref: 80 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.110320:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0x0 (00000000fbf66531) 00010000:00010000:0.0:1772305930.110322:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1772305930.110324:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000cb557b9d, rc 0) 00000100:00100000:0.0:1772305930.110368:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000af392ea5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+80:99862:x1858396225402368:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 198us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305930.110377:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1125 00000100:00100000:2.0:1772305930.112068:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305930.112112:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225402496 00000100:00100000:0.0:1772305930.112146:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1126 00000100:00100000:0.0:1772305930.112152:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004dd780f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+80:99862:x1858396225402496:12345-192.168.203.30@tcp:58:lfs.0 00000040:00080000:0.0:1772305930.112329:0:54698:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xf:0x0].42, 136 off13904 00000100:00100000:0.0:1772305930.112401:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004dd780f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+80:99862:x1858396225402496:12345-192.168.203.30@tcp:58:lfs.0 Request processed in 249us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305930.112410:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1126 00000040:00080000:0.0:1772305930.396547:0:71022:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772305930.396553:0:71022:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772305930.396619:0:71022:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 43 count 15 00000040:00080000:0.0:1772305930.396623:0:71022:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:1.0:1772305930.504814:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305930.504820:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305930.504856:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 43 count 15 00000040:00080000:1.0:1772305930.504863:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:1.0:1772305930.505057:0:54732:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004f8db88b pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:54732:1858396216608896:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1772305930.505124:0:54732:0:(client.c:2500:ptlrpc_set_wait()) set 00000000ef0768cf going to sleep for 6 seconds 00000100:00100000:1.0:1772305930.506604:0:54732:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004f8db88b pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:54732:1858396216608896:192.168.203.30@tcp:107:hsm_cdtr.0 00000040:00080000:1.0:1772305930.506675:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305930.506677:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305930.506720:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 43 count 15 00000040:00080000:1.0:1772305930.506725:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:2.0:1772305930.507052:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305930.507116:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225402560 00000100:00100000:0.0:1772305930.507168:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1127 00000100:00100000:0.0:1772305930.507176:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002754ee10 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+83:99873:x1858396225402560:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1772305930.507207:0:54698:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x331:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1772305930.507275:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002754ee10 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+83:99873:x1858396225402560:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 99us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305930.507284:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1127 00000100:00100000:2.0:1772305930.508411:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305930.508459:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225402688 00000100:00100000:0.0:1772305930.508487:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1128 00000100:00100000:0.0:1772305930.508492:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000051fa7b56 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+83:99873:x1858396225402688:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1772305930.508504:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305930.508522:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c6fe4b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f1e7 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.508576:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fe52 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.508592:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fe52 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.508603:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fe52 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.508618:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fe59 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x85ccc03 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.508660:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fe59 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x85ccc03 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.508673:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fe59 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x85ccc03 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.508715:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c6fe60 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x331:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.508725:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c6fe60 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x331:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.508732:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c6fe60 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x331:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305930.508742:0:54698:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x331:0x0]: returning size 0 00010000:00010000:0.0:1772305930.508816:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fe52 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.508824:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fe52 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.508831:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fe52 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.508839:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000009a7ee7d5 already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305930.508842:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fe52 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.508850:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fe52 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.508863:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (00000000c78481f6) 00010000:00010000:0.0:1772305930.508866:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305930.508870:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fe52 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.508877:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6fe52 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.508890:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fe59 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x85ccc03 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.508897:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fe59 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x85ccc03 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.508903:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fe59 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x85ccc03 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.508910:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000809cda8f already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305930.508912:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fe59 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x85ccc03 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.508918:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fe59 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x85ccc03 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.508925:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x85ccc03 (000000001ccb4b89) 00010000:00010000:0.0:1772305930.508928:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305930.508930:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fe59 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x85ccc03 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.508936:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fe59 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x85ccc03 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.508971:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c6fe4b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1e7 expref: 86 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.508984:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c6fe60 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x331:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1e7 expref: 85 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.508991:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x331:0x0].0x0 (00000000499b0bdb) 00010000:00010000:0.0:1772305930.508994:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1772305930.508996:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005803c629, rc 0) 00000100:00100000:0.0:1772305930.509029:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000051fa7b56 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+85:99873:x1858396225402688:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 536us (618us total) trans 8589934963 rc 0/0 00000100:00100000:0.0:1772305930.509037:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1128 00000100:00100000:2.0:1772305930.510045:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305930.510090:0:5493:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225402752 00000100:00100000:0.0:1772305930.510130:0:5493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1049 00000100:00100000:0.0:1772305930.510142:0:5493:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000247170f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+85:2215:x1858396225402752:12345-192.168.203.30@tcp:103:ldlm_bl_06.0 00010000:00010000:0.0:1772305930.510154:0:5493:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1772305930.510155:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00010000:0.0:1772305930.510168:0:5493:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c6fe60 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x331:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1e7 expref: 85 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.510182:0:5493:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x331:0x0].0x0 (00000000499b0bdb) 00010000:00010000:0.0:1772305930.510186:0:5493:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1772305930.510217:0:5493:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000247170f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2215:x1858396225402752:12345-192.168.203.30@tcp:103:ldlm_bl_06.0 Request processed in 80us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305930.510226:0:5493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1049 00000100:00100000:3.0:1772305930.510238:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225402816 00000100:00100000:3.0:1772305930.510272:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5758 00000100:00100000:3.0:1772305930.510276:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ab9fc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+228:2216:x1858396225402816:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1772305930.510300:0:10520:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a5c1895c/0xa5e9c8c58c6fe6e lrc: 3/1,0 mode: --/PR res: [0x1b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305930.510310:0:10520:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1772305930.510311:0:10520:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1772305930.510324:0:10520:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5c1895c/0xa5e9c8c58c6fe6e lrc: 3/1,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305930.510332:0:10520:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5c1895c/0xa5e9c8c58c6fe6e lrc: 3/1,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305930.510410:0:10520:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a5c1895c/0xa5e9c8c58c6fe6e lrc: 3/1,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305930.510416:0:10520:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5c1895c/0xa5e9c8c58c6fe6e lrc: 2/0,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305930.510431:0:10520:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1772305930.510459:0:38581:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1772305930.510464:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ab9fc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+228:2216:x1858396225402816:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 Request processed in 186us (327us total) trans 0 rc 0/0 00010000:00010000:1.0:1772305930.510465:0:38581:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5c1895c/0xa5e9c8c58c6fe6e lrc: 2/0,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305930.510474:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5758 00010000:00010000:1.0:1772305930.510481:0:38581:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a5c1895c already unused, calling callback (00000000b5e4f3c0) 00010000:00010000:1.0:1772305930.510485:0:38581:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5c1895c/0xa5e9c8c58c6fe6e lrc: 2/0,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305930.510492:0:38581:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5c1895c/0xa5e9c8c58c6fe6e lrc: 3/0,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305930.510503:0:38581:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5c1895c/0xa5e9c8c58c6fe6e lrc: 1/0,0 mode: --/PR res: [0x1b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305930.510508:0:38581:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5c1895c/0xa5e9c8c58c6fe6e lrc: 0/0,0 mode: --/PR res: [0x1b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305930.510517:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1772305930.510518:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1772305930.510519:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1772305930.511157:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305930.511195:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225402944 00000100:00100000:0.0:1772305930.511226:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1129 00000100:00100000:0.0:1772305930.511232:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000001ffe0a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:99873:x1858396225402944:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1772305930.511285:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000001ffe0a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:99873:x1858396225402944:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 53us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305930.511294:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1129 00000100:00100000:2.0:1772305930.512306:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305930.512362:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225403008 00000100:00100000:0.0:1772305930.512390:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1130 00000100:00100000:0.0:1772305930.512393:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004bd7f675 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:99873:x1858396225403008:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1772305930.512400:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305930.512409:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fe75 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f1ee expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.512435:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000066b8a8ab/0xa5e9c8c58c6fe7c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x331:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.512442:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000066b8a8ab/0xa5e9c8c58c6fe7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.512447:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000066b8a8ab/0xa5e9c8c58c6fe7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305930.512462:0:54698:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x331:0x0]: returning size 0 00000004:00200000:0.0:1772305930.512465:0:54698:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1772305930.512473:0:54698:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 0000000066b8a8ab/0xa5e9c8c58c6fe7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.512487:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000066b8a8ab/0xa5e9c8c58c6fe7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.512501:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fe75 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1ee expref: 86 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.512510:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000066b8a8ab/0xa5e9c8c58c6fe7c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1ee expref: 85 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.512515:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x331:0x0].0x0 (00000000499b0bdb) 00010000:00010000:0.0:1772305930.512517:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1772305930.512518:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000066b8a8ab, rc 0) 00000100:00100000:0.0:1772305930.512542:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004bd7f675 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+85:99873:x1858396225403008:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 148us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305930.512547:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1130 00000100:00100000:2.0:1772305930.513345:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305930.513397:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225403072 00000100:00100000:3.0:1772305930.513422:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5759 00000100:00100000:3.0:1772305930.513426:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ddcf1b3f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+228:2215:x1858396225403072:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1772305930.513433:0:10520:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305930.513441:0:10520:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000403929b5/0xa5e9c8c58c6fe83 lrc: 2/0,0 mode: --/PR res: [0x1b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f1f5 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305930.513453:0:10520:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1772305930.513455:0:10520:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1772305930.513459:0:10520:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000403929b5/0xa5e9c8c58c6fe83 lrc: 3/0,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1f5 expref: 229 pid: 10520 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1772305930.513468:0:10520:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000403929b5/0xa5e9c8c58c6fe83 lrc: 3/0,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1f5 expref: 229 pid: 10520 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1772305930.513483:0:10520:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000403929b5, rc 0) 00000100:00100000:3.0:1772305930.513510:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ddcf1b3f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+229:2215:x1858396225403072:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 82us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305930.513517:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5759 00000100:00100000:2.0:1772305930.514331:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305930.514383:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225403200 00000100:00100000:0.0:1772305930.514416:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1131 00000100:00100000:0.0:1772305930.514422:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c4b697c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+85:99873:x1858396225403200:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1772305930.514473:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c4b697c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+85:99873:x1858396225403200:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 50us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305930.514482:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1131 00000100:00100000:2.0:1772305930.515439:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305930.515476:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225403264 00000100:00100000:0.0:1772305930.515509:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1132 00000100:00100000:0.0:1772305930.515514:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000021838e42 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+85:99873:x1858396225403264:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1772305930.515524:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305930.515534:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c6fe8a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x331:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f1fc expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.515559:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fe91 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x331:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.515568:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fe91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.515577:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fe91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.515664:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c6fe8a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x331:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1fc expref: 87 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.515678:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fe91 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1fc expref: 86 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.515686:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x331:0x0].0x0 (00000000499b0bdb) 00010000:00010000:0.0:1772305930.515689:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1772305930.515691:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000809cda8f, rc 0) 00000100:00100000:0.0:1772305930.515721:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000021838e42 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+86:99873:x1858396225403264:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 206us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305930.515729:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1132 00000100:00100000:2.0:1772305930.516866:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305930.516905:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225403328 00000100:00100000:0.0:1772305930.516935:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1133 00000100:00100000:0.0:1772305930.516941:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a22e9c5f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+86:99873:x1858396225403328:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1772305930.516958:0:54698:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x331:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1772305930.517014:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a22e9c5f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+86:99873:x1858396225403328:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 72us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305930.517027:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1133 00000100:00100000:2.0:1772305930.517933:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305930.517956:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225403392 00000100:00100000:3.0:1772305930.517982:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5760 00000100:00100000:3.0:1772305930.517986:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bbc49ac3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+229:2216:x1858396225403392:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1772305930.518004:0:10520:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000094970864/0xa5e9c8c58c6fe98 lrc: 3/1,0 mode: --/PR res: [0x1b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305930.518012:0:10520:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1772305930.518014:0:10520:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1772305930.518016:0:10520:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094970864/0xa5e9c8c58c6fe98 lrc: 3/1,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305930.518023:0:10520:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094970864/0xa5e9c8c58c6fe98 lrc: 3/1,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305930.518037:0:10520:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000094970864/0xa5e9c8c58c6fe98 lrc: 3/1,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305930.518042:0:10520:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094970864/0xa5e9c8c58c6fe98 lrc: 2/0,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305930.518056:0:10520:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1772305930.518073:0:5497:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1772305930.518079:0:5497:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094970864/0xa5e9c8c58c6fe98 lrc: 2/0,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305930.518086:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bbc49ac3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+229:2216:x1858396225403392:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 Request processed in 98us (152us total) trans 0 rc 0/0 00010000:00010000:0.0:1772305930.518093:0:5497:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000094970864 already unused, calling callback (00000000b5e4f3c0) 00010000:00010000:0.0:1772305930.518098:0:5497:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094970864/0xa5e9c8c58c6fe98 lrc: 2/0,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305930.518107:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5760 00010000:00010000:0.0:1772305930.518115:0:5497:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094970864/0xa5e9c8c58c6fe98 lrc: 3/0,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.518129:0:5497:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094970864/0xa5e9c8c58c6fe98 lrc: 1/0,0 mode: --/PR res: [0x1b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.518137:0:5497:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094970864/0xa5e9c8c58c6fe98 lrc: 0/0,0 mode: --/PR res: [0x1b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305930.518150:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1772305930.518152:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1772305930.518155:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1772305930.518736:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305930.518774:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225403520 00000100:00100000:0.0:1772305930.518818:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1134 00000100:00100000:0.0:1772305930.518823:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007f8629ff pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+86:99873:x1858396225403520:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000040:00080000:0.0:1772305930.519039:0:54698:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772305930.519043:0:54698:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772305930.519105:0:54698:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 43 count 15 00000040:00080000:0.0:1772305930.519111:0:54698:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:0.0:1772305930.519165:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007f8629ff pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+87:99873:x1858396225403520:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 340us (428us total) trans 8589934964 rc 0/0 00000100:00100000:0.0:1772305930.519175:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1134 00000040:00080000:1.0:1772305930.519192:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305930.519196:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305930.519656:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 15 00000040:00080000:1.0:1772305930.519663:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:2.0:1772305930.519853:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305930.519896:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225403648 00000100:00100000:0.0:1772305930.519929:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 147 00000100:00100000:0.0:1772305930.519934:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000060c5d597 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+87:99873:x1858396225403648:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1772305930.520089:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000060c5d597 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+88:99873:x1858396225403648:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 154us (237us total) trans 8589934965 rc 0/0 00000100:00100000:0.0:1772305930.520098:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 147 00000001:00080000:1.0:1772305930.716932:0:6332:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-OST0000: transno 4294968311 is committed 00000001:00080000:1.0:1772305930.716947:0:6332:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-OST0000: transno 4294968317 is committed 00000001:00080000:1.0:1772305930.716962:0:6332:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-OST0000: transno 4294968313 is committed 00010000:00010000:3.0:1772305930.952817:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1772305931.528798:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305931.528806:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305931.528845:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 43 count 15 00000040:00080000:1.0:1772305931.528852:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:1.0:1772305931.696731:0:71073:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305931.696736:0:71073:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305931.696790:0:71073:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 43 count 15 00000040:00080000:1.0:1772305931.696794:0:71073:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:2.0:1772305931.715212:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305931.715254:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225403712 00000100:00100000:0.0:1772305931.715317:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1135 00000100:00100000:0.0:1772305931.715326:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005666e412 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+80:99881:x1858396225403712:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1772305931.715363:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305931.715383:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c6fe9f lrc: 2/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f203 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305931.715453:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fea6 lrc: 3/1,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305931.715469:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fea6 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305931.715483:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fea6 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305931.715500:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c6fead lrc: 3/1,0 mode: --/PR res: [0x200000408:0x95:0x0].0x1313e569 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305931.715514:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c6fead lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305931.715523:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c6fead lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305931.715654:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6feb4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x332:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305931.715666:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6feb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x332:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305931.715675:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6feb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x332:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305931.715709:0:54698:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x332:0x0]: returning size 0 00000004:00200000:0.0:1772305931.715714:0:54698:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1772305931.715732:0:54698:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6feb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x332:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305931.715744:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6feb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x332:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305931.715753:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fea6 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305931.715760:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fea6 lrc: 2/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305931.715767:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fea6 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305931.715773:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c571a25b already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305931.715777:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fea6 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305931.715784:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fea6 lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305931.715795:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0x0 (00000000fbf66531) 00010000:00010000:0.0:1772305931.715798:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305931.715802:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fea6 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305931.715810:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c6fea6 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305931.715823:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c6fead lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305931.715830:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c6fead lrc: 2/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305931.715836:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c6fead lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305931.715842:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000005803c629 already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305931.715845:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c6fead lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305931.715851:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c6fead lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305931.715860:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0x1313e569 (00000000322bd48e) 00010000:00010000:0.0:1772305931.715864:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305931.715866:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c6fead lrc: 2/0,0 mode: --/PR res: [0x200000408:0x95:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305931.715873:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c6fead lrc: 0/0,0 mode: --/PR res: [0x200000408:0x95:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305931.715906:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c6fe9f lrc: 0/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f203 expref: 82 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305931.715923:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6feb4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x332:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f203 expref: 81 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305931.715930:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x332:0x0].0x0 (0000000013d42fff) 00010000:00010000:0.0:1772305931.715932:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1772305931.715935:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a7ee7d5, rc 0) 00000100:00100000:0.0:1772305931.715991:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005666e412 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+81:99881:x1858396225403712:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 665us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305931.716000:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1135 00000100:00100000:2.0:1772305931.717453:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305931.717506:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225403776 00000100:00100000:0.0:1772305931.717538:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5761 00000100:00100000:0.0:1772305931.717542:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007b4cc173 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+162:2215:x1858396225403776:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1772305931.717552:0:10520:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305931.717568:0:10520:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6febb lrc: 2/0,0 mode: --/PR res: [0x1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f20a expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1772305931.717590:0:10520:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x1b3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1772305931.717603:0:10520:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305931.717604:0:10520:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305931.717609:0:10520:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6febb lrc: 3/0,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f20a expref: 163 pid: 10520 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1772305931.717620:0:10520:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6febb lrc: 3/0,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f20a expref: 163 pid: 10520 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1772305931.717655:0:10520:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a7782eea, rc 0) 00000100:00100000:0.0:1772305931.717687:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007b4cc173 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+163:2215:x1858396225403776:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 143us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305931.717693:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5761 00000100:00100000:2.0:1772305931.719828:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305931.719864:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225403904 00000100:00100000:0.0:1772305931.719905:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1136 00000100:00100000:0.0:1772305931.719912:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007194ab5d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+81:99881:x1858396225403904:12345-192.168.203.30@tcp:58:lfs.0 00000040:00080000:0.0:1772305931.720110:0:54698:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xf:0x0].43, 136 off14040 00000100:00100000:0.0:1772305931.720169:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007194ab5d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+81:99881:x1858396225403904:12345-192.168.203.30@tcp:58:lfs.0 Request processed in 257us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305931.720179:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1136 00000004:00080000:3.0:1772305931.720744:0:54722:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1243615115707ns, next at 1244615113422ns, rc = 0 00000100:00100000:0.0:1772305931.720759:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000216f6f28 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216608960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1772305931.720797:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772305931.720837:0:6309:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216608960 00000100:00100000:0.0:1772305931.720866:0:6309:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 459 00000100:00100000:0.0:1772305931.720870:0:6309:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000c3382b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:2994:x1858396216608960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1772305931.720898:0:6309:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 695140352 pending 0 free 3603955712 avail 3601858560 00000100:00100000:0.0:1772305931.720945:0:6309:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000c3382b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:2994:x1858396216608960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305931.720951:0:6309:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 459 00000100:00100000:2.0:1772305931.720994:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000216f6f28 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216608960:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1772305931.722051:0:54720:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1243616422596ns, next at 1244616420328ns, rc = 0 00000100:00100000:2.0:1772305931.722121:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003fdd35f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216609024:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1772305931.722165:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772305931.722370:0:6309:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216609024 00000100:00100000:2.0:1772305931.722412:0:6309:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 460 00000100:00100000:2.0:1772305931.722419:0:6309:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ae945845 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216609024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1772305931.722447:0:6309:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 1703936 granted 744685568 pending 0 free 3827302400 avail 3825205248 00000100:00100000:2.0:1772305931.722539:0:6309:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ae945845 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216609024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305931.722548:0:6309:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 460 00000100:00100000:2.0:1772305931.722594:0:2991:0:(client.c:2868:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968313 gen 2 00000004:00080000:2.0:1772305931.722600:0:2991:0:(osp_trans.c:1044:osp_request_commit_cb()) trans no 4294968312 committed transno 4294968313 00000004:00080000:2.0:1772305931.722654:0:2991:0:(osp_trans.c:1044:osp_request_commit_cb()) trans no 4294968313 committed transno 4294968313 00000100:00100000:2.0:1772305931.722704:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003fdd35f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216609024:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1772305931.748231:0:54724:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934965 is committed 00000001:00080000:3.0:1772305931.748265:0:54724:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934951 is committed 00000004:00080000:3.0:1772305931.748269:0:54724:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 12 committed 00000004:00080000:3.0:1772305931.748289:0:54724:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 11 committed 00000020:00080000:3.0:1772305931.748320:0:54724:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt 00000000d46a6988 refcount 2 committed 0 result 0 batchid 4295052957 00000020:00080000:3.0:1772305931.748324:0:54724:0:(update_trans.c:89:top_multiple_thandle_dump()) st 000000002d13014f obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th 0000000076167ffa 00000020:00080000:3.0:1772305931.748327:0:54724:0:(update_trans.c:89:top_multiple_thandle_dump()) st 0000000059cdea4c obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th 00000000fff592a9 00000001:00080000:3.0:1772305931.748378:0:54724:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934954 is committed 00000020:00080000:3.0:1772305931.748386:0:54724:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 4295052956 batchid updated 00000020:00080000:3.0:1772305931.748396:0:54724:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 4295052955 batchid updated 00000004:00080000:3.0:1772305931.748406:0:54724:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 13 committed 00000100:00100000:1.0:1772305931.748450:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ffc6c4ba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216609216:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1772305931.748462:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000731263eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216609088:0@lo:6:osp-syn-0-0.0 00000020:00080000:3.0:1772305931.748464:0:54735:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4295052957 committed batchid 4295052956 00000100:00100000:1.0:1772305931.748521:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772305931.748523:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d22b18dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216609280:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1772305931.748561:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216609216 00000100:00100000:2.0:1772305931.748564:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305931.748577:0:2994:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1772305931.748589:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004f8db88b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216609152:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1772305931.748608:0:48470:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216609280 00000100:00100000:0.0:1772305931.748616:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5762 00000100:00100000:0.0:1772305931.748624:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003b5a8f12 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:2994:x1858396216609216:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1772305931.748660:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772305931.748663:0:48470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5763 00000100:00100000:2.0:1772305931.748669:0:48470:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e72c7c57 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216609280:12345-0@lo:2:osp-syn-0-0.0 00002000:00080000:0.0:1772305931.748675:0:10520:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:432 count 1 00000100:00100000:1.0:1772305931.748701:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1772305931.748702:0:10520:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079ce3603/0xa5e9c8c58c6fec2 lrc: 3/0,1 mode: --/PW res: [0x1b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305931.748723:0:10520:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6f912 lrc: 2/0,0 mode: PW/PW res: [0x1b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f05f expref: 142 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305931.748731:0:10520:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1772305931.748734:0:10520:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1772305931.748738:0:10520:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079ce3603/0xa5e9c8c58c6fec2 lrc: 4/0,1 mode: --/PW res: [0x1b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00000020:00080000:3.0:1772305931.748765:0:54735:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4295052956 00010000:00010000:0.0:1772305931.748769:0:10520:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6f912 lrc: 3/0,0 mode: PW/PW res: [0x1b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000030020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f05f expref: 142 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305931.748785:0:10520:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6f912 lrc: 4/0,0 mode: PW/PW res: [0x1b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400030020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f05f expref: 142 pid: 21400 timeout: 1343 lvb_type: 0 00000100:00100000:0.0:1772305931.748798:0:10520:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003fdd35f4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:10520:1858396216609344:192.168.203.30@tcp:104: 00002000:00010000:2.0:1772305931.748866:0:48470:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x1b1:0x0] updating lvb size from disk: 1048576 -> 1048576 00000100:00100000:0.0:1772305931.748867:0:10520:0:(client.c:2500:ptlrpc_set_wait()) set 00000000e83f41c5 going to sleep for 6 seconds 00002000:00010000:2.0:1772305931.748869:0:48470:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x1b1:0x0] updating lvb mtime from disk: 1772305923 -> 1772305923 00002000:00010000:2.0:1772305931.748872:0:48470:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x1b1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1772305931.748874:0:48470:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x1b1:0x0] updating lvb ctime from disk: 1772305926 -> 1772305926 00002000:00010000:2.0:1772305931.748877:0:48470:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x1b1:0x0] updating lvb blocks from disk: 1 -> 2051 00000100:00100000:0.0:1772305931.748889:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216609152 00000100:00100000:2.0:1772305931.748918:0:48470:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e72c7c57 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:2991:x1858396216609280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 246us (354us total) trans 4294968318 rc 0/0 00000100:00100000:0.0:1772305931.748922:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216609088 00000100:00100000:2.0:1772305931.748929:0:48470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5763 00000100:00100000:0.0:1772305931.748956:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5764 00000100:00100000:2.0:1772305931.748965:0:48470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5765 00000100:00100000:0.0:1772305931.748966:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007af21754 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:2994:x1858396216609152:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1772305931.748975:0:48470:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000de6d83ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:2992:x1858396216609088:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1772305931.748983:0:6306:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:433 count 1 00002000:00080000:2.0:1772305931.748988:0:48470:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:432 count 1 00010000:00010000:0.0:1772305931.748999:0:6306:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6fec9 lrc: 3/0,1 mode: --/PW res: [0x1b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1772305931.749009:0:48470:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x1b0:0x0] initial LVB size: 1048576, mtime: 0x69a33e03, atime: 0x69a33e03, ctime: 0x69a33e03, blocks: 0x803 00010000:00010000:0.0:1772305931.749014:0:6306:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6fab6 lrc: 2/0,0 mode: PR/PR res: [0x1b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0e4 expref: 142 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305931.749015:0:48470:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6fed0 lrc: 3/0,1 mode: --/PW res: [0x1b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305931.749035:0:48470:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305931.749036:0:6306:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1772305931.749038:0:48470:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305931.749040:0:6306:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1772305931.749042:0:48470:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6fed0 lrc: 3/0,1 mode: PW/PW res: [0x1b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305931.749044:0:6306:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6fec9 lrc: 4/0,1 mode: --/PW res: [0x1b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305931.749063:0:48470:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6fed0 lrc: 3/0,1 mode: PW/PW res: [0x1b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305931.749071:0:48470:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6fed0 lrc: 3/0,1 mode: PW/PW res: [0x1b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305931.749076:0:48470:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6fed0 lrc: 2/0,0 mode: PW/PW res: [0x1b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305931.749080:0:6306:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6fab6 lrc: 3/0,0 mode: PR/PR res: [0x1b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0e4 expref: 142 pid: 21400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305931.749095:0:6306:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6fab6 lrc: 4/0,0 mode: PR/PR res: [0x1b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0e4 expref: 142 pid: 21400 timeout: 1343 lvb_type: 0 00010000:00010000:2.0:1772305931.749096:0:48470:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1772305931.749109:0:6306:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003084e0c8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6306:1858396216609408:192.168.203.30@tcp:104: 00000100:00100000:0.0:1772305931.749154:0:6306:0:(client.c:2500:ptlrpc_set_wait()) set 00000000e006a885 going to sleep for 6 seconds 00010000:00010000:3.0:1772305931.749816:0:5496:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1772305931.749822:0:5496:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6fed0 lrc: 2/0,0 mode: PW/PW res: [0x1b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305931.749830:0:5496:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ad568b72 already unused, calling callback (00000000b5e4f3c0) 00010000:00010000:3.0:1772305931.749833:0:5496:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6fed0 lrc: 2/0,0 mode: PW/PW res: [0x1b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305931.749929:0:5496:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6fed0 lrc: 3/0,0 mode: PW/PW res: [0x1b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305931.749966:0:5496:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6fed0 lrc: 1/0,0 mode: --/PW res: [0x1b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305931.749974:0:5496:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c6fed0 lrc: 0/0,0 mode: --/PW res: [0x1b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305931.750003:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1772305931.750006:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1772305931.750010:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1772305931.750094:0:10520:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003fdd35f4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:10520:1858396216609344:192.168.203.30@tcp:104: 00010000:00010000:0.0:1772305931.750118:0:10520:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000079ce3603/0xa5e9c8c58c6fec2 lrc: 3/0,1 mode: --/PW res: [0x1b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1772305931.750312:0:2991:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000d22b18dd/2, rc 0, transno 1022 00000100:00100000:3.0:1772305931.750320:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d22b18dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216609280:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1772305931.750355:0:6306:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003084e0c8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6306:1858396216609408:192.168.203.30@tcp:104: 00000100:00100000:2.0:1772305931.750363:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00010000:0.0:1772305931.750374:0:6306:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6fec9 lrc: 3/0,1 mode: --/PW res: [0x1b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305931.750397:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305931.750419:0:5493:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225403968 00010000:00010000:2.0:1772305931.750443:0:5493:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6f912 lrc: 4/0,0 mode: PW/PW res: [0x1b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f05f expref: 143 pid: 21400 timeout: 1343 lvb_type: 0 00000100:00100000:2.0:1772305931.750482:0:5493:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225404032 00000100:00100000:0.0:1772305931.750487:0:7104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3138 00000100:00100000:0.0:1772305931.750494:0:7104:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003aaaa097 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+144:2216:x1858396225403968:12345-192.168.203.30@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1772305931.750499:0:5493:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6fab6 lrc: 4/0,0 mode: PR/PR res: [0x1b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0e4 expref: 144 pid: 21400 timeout: 1343 lvb_type: 0 00010000:00010000:0.0:1772305931.750503:0:7104:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1772305931.750510:0:7104:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6f912 lrc: 4/0,0 mode: PW/PW res: [0x1b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f05f expref: 144 pid: 21400 timeout: 1343 lvb_type: 0 00010000:00010000:0.0:1772305931.750520:0:7104:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6f912 lrc: 3/0,0 mode: PW/PW res: [0x1b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400030020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f05f expref: 144 pid: 21400 timeout: 1343 lvb_type: 0 00000100:00100000:2.0:1772305931.750528:0:5493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3139 00000100:00100000:2.0:1772305931.750535:0:5493:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000085acb02d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+144:2218:x1858396225404032:12345-192.168.203.30@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1772305931.750544:0:7104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6f912 lrc: 0/0,0 mode: --/PW res: [0x1b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400030020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f05f expref: 144 pid: 21400 timeout: 1343 lvb_type: 0 00010000:00010000:2.0:1772305931.750545:0:5493:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1772305931.750551:0:5493:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6fab6 lrc: 4/0,0 mode: PR/PR res: [0x1b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0e4 expref: 144 pid: 21400 timeout: 1343 lvb_type: 0 00010000:00010000:0.0:1772305931.750557:0:7104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305931.750560:0:7104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305931.750562:0:7104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000079ce3603/0xa5e9c8c58c6fec2 lrc: 3/0,1 mode: PW/PW res: [0x1b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305931.750563:0:5493:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6fab6 lrc: 3/0,0 mode: PR/PR res: [0x1b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0e4 expref: 143 pid: 21400 timeout: 1343 lvb_type: 0 00010000:00010000:0.0:1772305931.750580:0:7104:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079ce3603/0xa5e9c8c58c6fec2 lrc: 4/0,1 mode: PW/PW res: [0x1b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305931.750596:0:5493:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6fab6 lrc: 0/0,0 mode: --/PR res: [0x1b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f0e4 expref: 143 pid: 21400 timeout: 1343 lvb_type: 0 00010000:00010000:0.0:1772305931.750599:0:7104:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1772305931.750611:0:5493:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1772305931.750613:0:5493:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1772305931.750615:0:5493:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6fec9 lrc: 3/0,1 mode: PW/PW res: [0x1b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305931.750621:0:5493:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6fec9 lrc: 4/0,1 mode: PW/PW res: [0x1b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305931.750656:0:7104:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003aaaa097 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+142:2216:x1858396225403968:12345-192.168.203.30@tcp:103:ldlm_bl_01.0 Request processed in 133us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305931.750664:0:7104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3138 00010000:00010000:2.0:1772305931.750672:0:5493:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1772305931.750705:0:5493:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000085acb02d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+141:2218:x1858396225404032:12345-192.168.203.30@tcp:103:ldlm_bl_04.0 Request processed in 166us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305931.750713:0:5493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3139 00010000:00010000:0.0:1772305931.750726:0:10520:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000079ce3603/0xa5e9c8c58c6fec2 lrc: 3/0,1 mode: PW/PW res: [0x1b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305931.750733:0:10520:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079ce3603/0xa5e9c8c58c6fec2 lrc: 3/0,1 mode: PW/PW res: [0x1b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305931.750738:0:10520:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079ce3603/0xa5e9c8c58c6fec2 lrc: 3/0,1 mode: PW/PW res: [0x1b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305931.750743:0:10520:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000079ce3603/0xa5e9c8c58c6fec2 lrc: 2/0,0 mode: PW/PW res: [0x1b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305931.750758:0:10520:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1772305931.751162:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003b5a8f12 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:2994:x1858396216609216:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2537us (2643us total) trans 4294968351 rc 0/0 00000100:00100000:0.0:1772305931.751170:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5762 00000004:00080000:2.0:1772305931.751195:0:2994:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000ffc6c4ba/2, rc 0, transno 1055 00000100:00100000:2.0:1772305931.751202:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ffc6c4ba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216609216:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1772305931.751279:0:38581:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1772305931.751284:0:38581:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000079ce3603/0xa5e9c8c58c6fec2 lrc: 2/0,0 mode: PW/PW res: [0x1b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305931.751293:0:38581:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000079ce3603 already unused, calling callback (00000000b5e4f3c0) 00010000:00010000:0.0:1772305931.751296:0:38581:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000079ce3603/0xa5e9c8c58c6fec2 lrc: 2/0,0 mode: PW/PW res: [0x1b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305931.751304:0:38581:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000079ce3603/0xa5e9c8c58c6fec2 lrc: 3/0,0 mode: PW/PW res: [0x1b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305931.751319:0:38581:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000079ce3603/0xa5e9c8c58c6fec2 lrc: 1/0,0 mode: --/PW res: [0x1b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305931.751326:0:38581:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079ce3603/0xa5e9c8c58c6fec2 lrc: 0/0,0 mode: --/PW res: [0x1b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305931.751354:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1772305931.751358:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1772305931.751361:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1772305931.751372:0:6306:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6fec9 lrc: 3/0,1 mode: PW/PW res: [0x1b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305931.751377:0:6306:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6fec9 lrc: 3/0,1 mode: PW/PW res: [0x1b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305931.751383:0:6306:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6fec9 lrc: 3/0,1 mode: PW/PW res: [0x1b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305931.751387:0:6306:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6fec9 lrc: 2/0,0 mode: PW/PW res: [0x1b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305931.751399:0:6306:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1772305931.751588:0:48470:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000de6d83ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+7:2992:x1858396216609088:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2612us (2885us total) trans 4294968319 rc 0/0 00000100:00100000:3.0:1772305931.751597:0:48470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5765 00000004:00080000:1.0:1772305931.751612:0:2992:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000731263eb/2, rc 0, transno 1023 00000100:00100000:1.0:1772305931.751621:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000731263eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216609088:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1772305931.751623:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007af21754 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:2994:x1858396216609152:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2659us (2965us total) trans 4294968352 rc 0/0 00000004:00080000:2.0:1772305931.751669:0:2994:0:(osp_sync.c:563:osp_sync_interpret()) reply req 000000004f8db88b/2, rc 0, transno 1056 00000100:00100000:2.0:1772305931.751678:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004f8db88b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216609152:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1772305931.751686:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5764 00010000:00010000:0.0:1772305931.751705:0:5497:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1772305931.751708:0:5497:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6fec9 lrc: 2/0,0 mode: PW/PW res: [0x1b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305931.751715:0:5497:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000fd93d0b1 already unused, calling callback (00000000b5e4f3c0) 00010000:00010000:0.0:1772305931.751717:0:5497:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6fec9 lrc: 2/0,0 mode: PW/PW res: [0x1b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305931.751722:0:5497:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6fec9 lrc: 3/0,0 mode: PW/PW res: [0x1b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305931.751732:0:5497:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6fec9 lrc: 1/0,0 mode: --/PW res: [0x1b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305931.751737:0:5497:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6fec9 lrc: 0/0,0 mode: --/PW res: [0x1b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305931.751751:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1772305931.751752:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1772305931.751754:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1772305931.754317:0:7114:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-OST0001: transno 4294968349 is committed 00000001:00080000:1.0:1772305931.754355:0:7114:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-OST0001: transno 4294968350 is committed 00010000:00010000:3.0:1772305931.976722:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1772305932.008660:0:71127:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305932.008664:0:71127:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305932.008727:0:71127:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 44 count 16 00000040:00080000:3.0:1772305932.008731:0:71127:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:3.0:1772305932.232792:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000854ab26d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:70aae467-c860-409f-ba1b-742f4d042da6:2992:1858396216609472:0@lo:400:kworker/u8:4.0 00000100:00100000:0.0:1772305932.232801:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000093b46947 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216609664:0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772305932.232810:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000090401002 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:2993:1858396216609536:0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772305932.232826:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f635dbf9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:2994:1858396216609600:0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772305932.232864:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305932.232875:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772305932.232875:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305932.232901:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b896dfee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216609728:0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772305932.232916:0:54689:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216609472 00000100:00100000:1.0:1772305932.232923:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f5fe1428 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:2993:1858396216609792:0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772305932.232929:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772305932.232932:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216609664 00000100:00100000:1.0:1772305932.232960:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772305932.232966:0:54689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1772305932.232972:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216609728 00000100:00100000:2.0:1772305932.232975:0:54689:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008147e34f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70aae467-c860-409f-ba1b-742f4d042da6+18:2992:x1858396216609472:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772305932.232981:0:48470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1192 00000100:00100000:3.0:1772305932.232987:0:48470:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003084e0c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+7:2991:x1858396216609664:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:0.0:1772305932.233000:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1193 00000100:00100000:0.0:1772305932.233010:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000453faf57 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:2992:x1858396216609728:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772305932.233024:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216609536 00000100:00100000:2.0:1772305932.233031:0:54689:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008147e34f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70aae467-c860-409f-ba1b-742f4d042da6+18:2992:x1858396216609472:12345-0@lo:400:kworker/u8:4.0 Request processed in 57us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305932.233037:0:54689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1772305932.233062:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216609792 00000100:00100000:0.0:1772305932.233062:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000453faf57 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:2992:x1858396216609728:12345-0@lo:400:kworker/u8:4.0 Request processed in 51us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305932.233069:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1193 00000100:00100000:3.0:1772305932.233073:0:48470:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003084e0c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+7:2991:x1858396216609664:12345-0@lo:400:kworker/u8:4.0 Request processed in 83us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305932.233084:0:48470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1192 00000100:00100000:2.0:1772305932.233094:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1772305932.233103:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1772305932.233104:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b892b34a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:2993:x1858396216609536:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772305932.233113:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006441cdff pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:2993:x1858396216609792:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772305932.233138:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000093b46947 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216609664:0@lo:400:kworker/u8:4.0 00000100:00100000:0.0:1772305932.233147:0:2992:0:(client.c:2868:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968350 gen 2 00000004:00080000:0.0:1772305932.233152:0:2992:0:(osp_trans.c:1044:osp_request_commit_cb()) trans no 4294968350 committed transno 4294968350 00000100:00100000:2.0:1772305932.233164:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b892b34a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:2993:x1858396216609536:12345-0@lo:400:kworker/u8:4.0 Request processed in 63us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305932.233174:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1772305932.233174:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006441cdff pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:2993:x1858396216609792:12345-0@lo:400:kworker/u8:4.0 Request processed in 59us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305932.233177:0:2992:0:(client.c:2894:ptlrpc_free_committed()) @@@ stopping search req@00000000ffc6c4ba x1858396216609216/t4294968351(4294968351) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1772305938 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-1-0.0' 00000100:00100000:3.0:1772305932.233184:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305932.233191:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1772305932.233197:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b896dfee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216609728:0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772305932.233203:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216609600 00000100:00100000:0.0:1772305932.233217:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000854ab26d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:70aae467-c860-409f-ba1b-742f4d042da6:2992:1858396216609472:0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772305932.233237:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1772305932.233243:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c84b7376 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:2994:x1858396216609600:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772305932.233249:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f5fe1428 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:2993:1858396216609792:0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772305932.233262:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000090401002 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:2993:1858396216609536:0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772305932.233283:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c84b7376 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:2994:x1858396216609600:12345-0@lo:400:kworker/u8:4.0 Request processed in 38us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305932.233288:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1772305932.233316:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f635dbf9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:2994:1858396216609600:0@lo:400:kworker/u8:4.0 00000040:00080000:1.0:1772305932.552811:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305932.552819:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305932.552870:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 44 count 16 00000040:00080000:1.0:1772305932.552878:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:1.0:1772305932.553113:0:54732:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d8a50734 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:54732:1858396216609856:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1772305932.553191:0:54732:0:(client.c:2500:ptlrpc_set_wait()) set 00000000d3f65095 going to sleep for 6 seconds 00000100:00100000:1.0:1772305932.554392:0:54732:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d8a50734 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:54732:1858396216609856:192.168.203.30@tcp:107:hsm_cdtr.0 00000040:00080000:1.0:1772305932.554445:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305932.554448:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305932.554518:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 44 count 16 00000040:00080000:1.0:1772305932.554523:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:0.0:1772305932.554724:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305932.554767:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225404096 00000100:00100000:2.0:1772305932.554810:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1137 00000100:00100000:2.0:1772305932.554816:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cc0879e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+73:99892:x1858396225404096:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1772305932.554842:0:54697:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x332:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1772305932.554892:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cc0879e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+73:99892:x1858396225404096:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 77us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305932.554898:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1137 00000100:00100000:2.0:1772305932.555859:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305932.555918:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225404224 00000100:00100000:0.0:1772305932.555957:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1138 00000100:00100000:0.0:1772305932.555964:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001571dacd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+73:99892:x1858396225404224:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1772305932.555976:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305932.555995:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6fed7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f211 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305932.556050:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6fede lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305932.556064:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6fede lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305932.556078:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6fede lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305932.556146:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6fee5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb467831b bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305932.556155:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6fee5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb467831b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305932.556162:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6fee5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb467831b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305932.556202:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6feec lrc: 3/1,0 mode: --/CR res: [0x200000402:0x332:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305932.556211:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6feec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x332:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305932.556219:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6feec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x332:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305932.556227:0:54697:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x332:0x0]: returning size 0 00010000:00010000:0.0:1772305932.556316:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6fede lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305932.556324:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6fede lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305932.556331:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6fede lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305932.556356:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000079ce3603 already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305932.556360:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6fede lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305932.556367:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6fede lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305932.556380:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (00000000c78481f6) 00010000:00010000:0.0:1772305932.556383:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305932.556387:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6fede lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305932.556393:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c6fede lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305932.556405:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6fee5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb467831b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305932.556411:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6fee5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb467831b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305932.556418:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6fee5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb467831b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305932.556424:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000870ce7f2 already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305932.556426:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6fee5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb467831b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305932.556432:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6fee5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb467831b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305932.556439:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xb467831b (00000000322bd48e) 00010000:00010000:0.0:1772305932.556442:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305932.556444:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6fee5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb467831b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305932.556449:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c6fee5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb467831b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305932.556484:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6fed7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f211 expref: 76 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305932.556497:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6feec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x332:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f211 expref: 75 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305932.556504:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x332:0x0].0x0 (0000000013d42fff) 00010000:00010000:0.0:1772305932.556507:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1772305932.556509:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000f7a426e, rc 0) 00000100:00100000:0.0:1772305932.556545:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001571dacd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+75:99892:x1858396225404224:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 581us (685us total) trans 8589934966 rc 0/0 00000100:00100000:0.0:1772305932.556553:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1138 00000100:00100000:3.0:1772305932.557558:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305932.557584:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305932.557602:0:5493:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225404288 00000100:00100000:0.0:1772305932.557647:0:48470:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225404352 00000100:00100000:2.0:1772305932.557674:0:5493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1050 00000100:00100000:2.0:1772305932.557678:0:5493:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f842a169 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+75:2215:x1858396225404288:12345-192.168.203.30@tcp:103:ldlm_bl_05.0 00010000:00010000:2.0:1772305932.557687:0:5493:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1772305932.557697:0:48470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5766 00010000:00010000:2.0:1772305932.557699:0:5493:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c6feec lrc: 0/0,0 mode: --/CR res: [0x200000402:0x332:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f211 expref: 75 pid: 54697 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305932.557708:0:48470:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000830ec897 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:370cd859-ca07-4cc9-a865-ed970d9eaddd+224:2215:x1858396225404352:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1772305932.557710:0:5493:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x332:0x0].0x0 (0000000013d42fff) 00010000:00010000:2.0:1772305932.557716:0:5493:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1772305932.557739:0:48470:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6fefa lrc: 3/1,0 mode: --/PR res: [0x1b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305932.557746:0:5493:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f842a169 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+74:2215:x1858396225404288:12345-192.168.203.30@tcp:103:ldlm_bl_05.0 Request processed in 63us (186us total) trans 0 rc 0/0 00010000:00010000:0.0:1772305932.557757:0:48470:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1772305932.557758:0:5493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1050 00010000:00010000:0.0:1772305932.557760:0:48470:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305932.557766:0:48470:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6fefa lrc: 3/1,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305932.557776:0:48470:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6fefa lrc: 3/1,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305932.557791:0:48470:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6fefa lrc: 3/1,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305932.557797:0:48470:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6fefa lrc: 2/0,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305932.557807:0:48470:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1772305932.557820:0:5496:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1772305932.557825:0:5496:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6fefa lrc: 2/0,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305932.557841:0:48470:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000830ec897 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:370cd859-ca07-4cc9-a865-ed970d9eaddd+224:2215:x1858396225404352:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 Request processed in 136us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305932.557848:0:48470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5766 00010000:00010000:3.0:1772305932.557872:0:5496:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000001e903b7f already unused, calling callback (00000000b5e4f3c0) 00010000:00010000:3.0:1772305932.557875:0:5496:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6fefa lrc: 2/0,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305932.557882:0:5496:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6fefa lrc: 3/0,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305932.557892:0:5496:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6fefa lrc: 1/0,0 mode: --/PR res: [0x1b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305932.557896:0:5496:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c6fefa lrc: 0/0,0 mode: --/PR res: [0x1b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305932.557946:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1772305932.557948:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1772305932.557949:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1772305932.558423:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305932.558455:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225404480 00000100:00100000:0.0:1772305932.558480:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1139 00000100:00100000:0.0:1772305932.558483:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006408bd99 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+74:99892:x1858396225404480:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1772305932.558525:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006408bd99 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+74:99892:x1858396225404480:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 40us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305932.558529:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1139 00000100:00100000:2.0:1772305932.559443:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305932.559484:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225404544 00000100:00100000:0.0:1772305932.559512:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1140 00000100:00100000:0.0:1772305932.559516:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ea1c5fa0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+74:99892:x1858396225404544:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1772305932.559524:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305932.559531:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6ff01 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f218 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305932.559556:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6ff08 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x332:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305932.559563:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6ff08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x332:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305932.559572:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6ff08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x332:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305932.559586:0:54697:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x332:0x0]: returning size 0 00000004:00200000:0.0:1772305932.559589:0:54697:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1772305932.559597:0:54697:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6ff08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x332:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305932.559603:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6ff08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x332:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305932.559612:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6ff01 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f218 expref: 76 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305932.559622:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6ff08 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x332:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f218 expref: 75 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305932.559649:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x332:0x0].0x0 (0000000013d42fff) 00010000:00010000:0.0:1772305932.559652:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1772305932.559654:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c7dfb548, rc 0) 00000100:00100000:0.0:1772305932.559686:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ea1c5fa0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+75:99892:x1858396225404544:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 169us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305932.559695:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1140 00000100:00100000:3.0:1772305932.560393:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305932.560432:0:48470:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225404608 00000100:00100000:0.0:1772305932.560457:0:48470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5767 00000100:00100000:0.0:1772305932.560461:0:48470:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007a587e26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:370cd859-ca07-4cc9-a865-ed970d9eaddd+224:2216:x1858396225404608:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1772305932.560467:0:48470:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305932.560474:0:48470:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6ff0f lrc: 2/0,0 mode: --/PR res: [0x1b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f21f expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305932.560487:0:48470:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305932.560488:0:48470:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305932.560492:0:48470:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6ff0f lrc: 3/0,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f21f expref: 225 pid: 48470 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1772305932.560500:0:48470:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6ff0f lrc: 3/0,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f21f expref: 225 pid: 48470 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1772305932.560507:0:48470:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000082c88ffe, rc 0) 00000100:00100000:0.0:1772305932.560529:0:48470:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007a587e26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:370cd859-ca07-4cc9-a865-ed970d9eaddd+225:2216:x1858396225404608:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 68us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305932.560533:0:48470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5767 00000100:00100000:3.0:1772305932.561176:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305932.561208:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225404736 00000100:00100000:0.0:1772305932.561232:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1141 00000100:00100000:0.0:1772305932.561235:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ae5186f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+75:99892:x1858396225404736:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1772305932.561269:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ae5186f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+75:99892:x1858396225404736:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 33us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305932.561274:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1141 00000100:00100000:2.0:1772305932.562155:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305932.562190:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225404800 00000100:00100000:0.0:1772305932.562213:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1142 00000100:00100000:0.0:1772305932.562217:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fb0c289e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+75:99892:x1858396225404800:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1772305932.562224:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305932.562229:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c6ff16 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x332:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f226 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305932.562246:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6ff1d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x332:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305932.562252:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6ff1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x332:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305932.562257:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6ff1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x332:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305932.562299:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c6ff16 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x332:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f226 expref: 77 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305932.562308:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6ff1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x332:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f226 expref: 76 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305932.562312:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x332:0x0].0x0 (0000000013d42fff) 00010000:00010000:0.0:1772305932.562314:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1772305932.562315:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000034fec1fd, rc 0) 00000100:00100000:0.0:1772305932.562350:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fb0c289e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+76:99892:x1858396225404800:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 132us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305932.562355:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1142 00000100:00100000:3.0:1772305932.563315:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305932.563356:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225404864 00000100:00100000:0.0:1772305932.563381:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1143 00000100:00100000:0.0:1772305932.563386:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000983211d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+76:99892:x1858396225404864:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1772305932.563401:0:54697:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x332:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1772305932.563452:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000983211d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+76:99892:x1858396225404864:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 66us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305932.563461:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1143 00000100:00100000:3.0:1772305932.564138:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305932.564172:0:48470:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225404928 00000100:00100000:0.0:1772305932.564194:0:48470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5768 00000100:00100000:0.0:1772305932.564197:0:48470:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000216f6f28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:370cd859-ca07-4cc9-a865-ed970d9eaddd+225:2215:x1858396225404928:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1772305932.564211:0:48470:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6ff24 lrc: 3/1,0 mode: --/PR res: [0x1b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305932.564217:0:48470:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305932.564219:0:48470:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305932.564222:0:48470:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6ff24 lrc: 3/1,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305932.564229:0:48470:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6ff24 lrc: 3/1,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305932.564239:0:48470:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6ff24 lrc: 3/1,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305932.564244:0:48470:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6ff24 lrc: 2/0,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305932.564256:0:48470:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1772305932.564283:0:38581:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1772305932.564283:0:48470:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000216f6f28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:370cd859-ca07-4cc9-a865-ed970d9eaddd+225:2215:x1858396225404928:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 Request processed in 84us (145us total) trans 0 rc 0/0 00010000:00010000:1.0:1772305932.564290:0:38581:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6ff24 lrc: 2/0,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305932.564294:0:48470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5768 00010000:00010000:1.0:1772305932.564306:0:38581:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000fd93d0b1 already unused, calling callback (00000000b5e4f3c0) 00010000:00010000:1.0:1772305932.564309:0:38581:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6ff24 lrc: 2/0,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305932.564317:0:38581:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6ff24 lrc: 3/0,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305932.564329:0:38581:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6ff24 lrc: 1/0,0 mode: --/PR res: [0x1b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305932.564348:0:38581:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c6ff24 lrc: 0/0,0 mode: --/PR res: [0x1b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305932.564360:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1772305932.564362:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1772305932.564363:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1772305932.564847:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305932.564878:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225405056 00000100:00100000:0.0:1772305932.564906:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1144 00000100:00100000:0.0:1772305932.564914:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d90d4880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+76:99892:x1858396225405056:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000040:00080000:0.0:1772305932.565053:0:54697:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772305932.565056:0:54697:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772305932.565100:0:54697:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 44 count 16 00000040:00080000:0.0:1772305932.565106:0:54697:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:0.0:1772305932.565158:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d90d4880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+77:99892:x1858396225405056:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 244us (312us total) trans 8589934967 rc 0/0 00000100:00100000:0.0:1772305932.565163:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1144 00000040:00080000:1.0:1772305932.565199:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305932.565203:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000100:00100000:3.0:1772305932.565787:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000040:00080000:1.0:1772305932.565793:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 16 00000040:00080000:1.0:1772305932.565803:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:0.0:1772305932.565823:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225405184 00000100:00100000:0.0:1772305932.565850:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 148 00000100:00100000:0.0:1772305932.565854:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000011939cae pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+77:99892:x1858396225405184:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1772305932.565992:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000011939cae pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+78:99892:x1858396225405184:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 137us (207us total) trans 8589934968 rc 0/0 00000100:00100000:0.0:1772305932.565999:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 148 00010000:00010000:0.0:1772305933.000839:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1772305933.290924:0:71179:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305933.290931:0:71179:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305933.291011:0:71179:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 44 count 16 00000040:00080000:2.0:1772305933.291017:0:71179:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:2.0:1772305933.310315:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305933.310374:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225405312 00000100:00100000:1.0:1772305933.310421:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1145 00000100:00100000:1.0:1772305933.310429:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f635dbf9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+63:99900:x1858396225405312:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1772305933.310447:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305933.310465:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ee5a0681/0xa5e9c8c58c6ff2b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x331:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f22d expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.310549:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6ff32 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x331:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.310565:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6ff32 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x331:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.310579:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6ff32 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x331:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1772305933.310592:0:54697:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x331:0x0]: returning size 0 00010000:00010000:1.0:1772305933.310736:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ee5a0681/0xa5e9c8c58c6ff2b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x331:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f22d expref: 66 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.310749:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6ff32 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x331:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f22d expref: 65 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.310755:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x331:0x0].0x0 (00000000499b0bdb) 00010000:00010000:1.0:1772305933.310758:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1772305933.310760:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a84c62ba, rc 0) 00000100:00100000:1.0:1772305933.310808:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f635dbf9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+65:99900:x1858396225405312:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 380us (497us total) trans 8589934969 rc 0/0 00000100:00100000:1.0:1772305933.310816:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1145 00000100:00100000:0.0:1772305933.311934:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305933.311985:0:48470:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225405376 00000100:00100000:0.0:1772305933.312024:0:48470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5769 00000100:00100000:0.0:1772305933.312031:0:48470:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003fdd35f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f935b4d0-e17f-49c8-8011-4be99ba75430+141:2215:x1858396225405376:12345-192.168.203.30@tcp:1:lfs.0 00010000:00010000:0.0:1772305933.312062:0:48470:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004820b6c/0xa5e9c8c58c6ff40 lrc: 3/0,1 mode: --/PW res: [0x1b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305933.312078:0:48470:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6fe28 lrc: 2/0,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1d2 expref: 141 pid: 10520 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1772305933.312088:0:48470:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000403929b5/0xa5e9c8c58c6fe83 lrc: 2/0,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1f5 expref: 227 pid: 10520 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1772305933.312098:0:48470:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305933.312100:0:48470:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305933.312102:0:48470:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004820b6c/0xa5e9c8c58c6ff40 lrc: 5/0,1 mode: --/PW res: [0x1b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305933.312131:0:48470:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000403929b5/0xa5e9c8c58c6fe83 lrc: 3/0,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1f5 expref: 227 pid: 10520 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1772305933.312145:0:48470:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000403929b5/0xa5e9c8c58c6fe83 lrc: 4/0,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1f5 expref: 227 pid: 10520 timeout: 1345 lvb_type: 1 00000100:00100000:0.0:1772305933.312160:0:48470:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000848c45a9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:48470:1858396216609920:192.168.203.30@tcp:104: 00010000:00010000:0.0:1772305933.312228:0:48470:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6fe28 lrc: 3/0,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1d2 expref: 141 pid: 10520 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1772305933.312238:0:48470:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6fe28 lrc: 4/0,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1d2 expref: 141 pid: 10520 timeout: 1345 lvb_type: 1 00000100:00100000:0.0:1772305933.312249:0:48470:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d0ab861f pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:48470:1858396216609984:192.168.203.30@tcp:104: 00000100:00100000:0.0:1772305933.312278:0:48470:0:(client.c:2500:ptlrpc_set_wait()) set 00000000c3c182a4 going to sleep for 6 seconds 00000100:00100000:0.0:1772305933.313056:0:48470:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000848c45a9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:48470:1858396216609920:192.168.203.30@tcp:104: 00000100:00100000:0.0:1772305933.313064:0:48470:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d0ab861f pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:48470:1858396216609984:192.168.203.30@tcp:104: 00010000:00010000:0.0:1772305933.313081:0:48470:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000004820b6c/0xa5e9c8c58c6ff40 lrc: 3/0,1 mode: --/PW res: [0x1b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305933.313418:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305933.313478:0:5493:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225405440 00010000:00010000:1.0:1772305933.313499:0:5493:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6fe28 lrc: 4/0,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1d2 expref: 142 pid: 10520 timeout: 1345 lvb_type: 1 00000100:00100000:1.0:1772305933.313538:0:5493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3140 00000100:00100000:1.0:1772305933.313544:0:5493:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d0ab861f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+142:2216:x1858396225405440:12345-192.168.203.30@tcp:103:ldlm_bl_06.0 00010000:00010000:1.0:1772305933.313557:0:5493:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1772305933.313575:0:5493:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6fe28 lrc: 4/0,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1d2 expref: 142 pid: 10520 timeout: 1345 lvb_type: 1 00010000:00010000:1.0:1772305933.313587:0:5493:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6fe28 lrc: 3/0,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1d2 expref: 142 pid: 10520 timeout: 1345 lvb_type: 1 00010000:00010000:1.0:1772305933.313605:0:5493:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051c27e8b/0xa5e9c8c58c6fe28 lrc: 0/0,0 mode: --/PR res: [0x1b3:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1d2 expref: 142 pid: 10520 timeout: 1345 lvb_type: 1 00010000:00010000:1.0:1772305933.313658:0:5493:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1772305933.313699:0:5493:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d0ab861f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+141:2216:x1858396225405440:12345-192.168.203.30@tcp:103:ldlm_bl_06.0 Request processed in 153us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305933.313710:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305933.313714:0:5493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3140 00000100:00100000:1.0:1772305933.313738:0:5493:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225405504 00010000:00010000:1.0:1772305933.313756:0:5493:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000403929b5/0xa5e9c8c58c6fe83 lrc: 4/0,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1f5 expref: 228 pid: 10520 timeout: 1345 lvb_type: 1 00000100:00100000:1.0:1772305933.313786:0:5493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3141 00000100:00100000:1.0:1772305933.313792:0:5493:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d4d8044c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+228:2216:x1858396225405504:12345-192.168.203.30@tcp:103:ldlm_bl_08.0 00010000:00010000:1.0:1772305933.313801:0:5493:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1772305933.313811:0:5493:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000403929b5/0xa5e9c8c58c6fe83 lrc: 4/0,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1f5 expref: 228 pid: 10520 timeout: 1345 lvb_type: 1 00010000:00010000:1.0:1772305933.313822:0:5493:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000403929b5/0xa5e9c8c58c6fe83 lrc: 3/0,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1f5 expref: 228 pid: 10520 timeout: 1345 lvb_type: 1 00010000:00010000:1.0:1772305933.313848:0:5493:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000403929b5/0xa5e9c8c58c6fe83 lrc: 0/0,0 mode: --/PR res: [0x1b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1f5 expref: 228 pid: 10520 timeout: 1345 lvb_type: 1 00010000:00010000:1.0:1772305933.313858:0:5493:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305933.313860:0:5493:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305933.313863:0:5493:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000004820b6c/0xa5e9c8c58c6ff40 lrc: 3/0,1 mode: PW/PW res: [0x1b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.313872:0:5493:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004820b6c/0xa5e9c8c58c6ff40 lrc: 4/0,1 mode: PW/PW res: [0x1b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.313898:0:5493:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1772305933.313921:0:48470:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000004820b6c/0xa5e9c8c58c6ff40 lrc: 3/0,1 mode: PW/PW res: [0x1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305933.313928:0:48470:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004820b6c/0xa5e9c8c58c6ff40 lrc: 3/0,1 mode: PW/PW res: [0x1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305933.313937:0:5493:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d4d8044c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2216:x1858396225405504:12345-192.168.203.30@tcp:103:ldlm_bl_08.0 Request processed in 143us (231us total) trans 0 rc 0/0 00010000:00010000:0.0:1772305933.313945:0:48470:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004820b6c/0xa5e9c8c58c6ff40 lrc: 3/0,1 mode: PW/PW res: [0x1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305933.313950:0:5493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3141 00010000:00010000:0.0:1772305933.313956:0:48470:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004820b6c/0xa5e9c8c58c6ff40 lrc: 2/0,0 mode: PW/PW res: [0x1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305933.313972:0:48470:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1772305933.313991:0:6322:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1772305933.313998:0:6322:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004820b6c/0xa5e9c8c58c6ff40 lrc: 2/0,0 mode: PW/PW res: [0x1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305933.314009:0:48470:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003fdd35f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f935b4d0-e17f-49c8-8011-4be99ba75430+140:2215:x1858396225405376:12345-192.168.203.30@tcp:1:lfs.0 Request processed in 1975us (2075us total) trans 0 rc 0/0 00010000:00010000:1.0:1772305933.314011:0:6322:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000004820b6c already unused, calling callback (00000000b5e4f3c0) 00010000:00010000:1.0:1772305933.314018:0:6322:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004820b6c/0xa5e9c8c58c6ff40 lrc: 2/0,0 mode: PW/PW res: [0x1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305933.314018:0:48470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5769 00010000:00010000:1.0:1772305933.314030:0:6322:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004820b6c/0xa5e9c8c58c6ff40 lrc: 3/0,0 mode: PW/PW res: [0x1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.314043:0:6322:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004820b6c/0xa5e9c8c58c6ff40 lrc: 1/0,0 mode: --/PW res: [0x1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.314048:0:6322:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004820b6c/0xa5e9c8c58c6ff40 lrc: 0/0,0 mode: --/PW res: [0x1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.314067:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1772305933.314069:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1772305933.314073:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1772305933.314727:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305933.314778:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225405632 00000100:00100000:1.0:1772305933.314818:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 149 00000100:00100000:1.0:1772305933.314825:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000039b4b25e pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+65:99900:x1858396225405632:12345-192.168.203.30@tcp:35:lfs.0 00000004:00010000:1.0:1772305933.314862:0:57054:0:(mdt_open.c:1862:mdt_hsm_release()) ### [0x200000402:0x331:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6ff32 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x331:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f22d expref: 65 pid: 54697 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1772305933.315061:0:57054:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934970 00000001:00080000:1.0:1772305933.315535:0:57054:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934970 00010000:00010000:1.0:1772305933.315583:0:57054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6ff47 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x331:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.315597:0:57054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c6fd9c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x331:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1a8 expref: 77 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.315606:0:57054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6fe21 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1cb expref: 66 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.315614:0:57054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 0000000066b8a8ab/0xa5e9c8c58c6fe7c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1ee expref: 77 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.315622:0:57054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fe91 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1fc expref: 77 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.315662:0:57054:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6ff47 lrc: 7/0,1 mode: --/EX res: [0x200000402:0x331:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.315687:0:57054:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fe91 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1fc expref: 77 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.315699:0:57054:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fe91 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1fc expref: 77 pid: 54698 timeout: 1345 lvb_type: 0 00000100:00100000:1.0:1772305933.315711:0:57054:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d8a50734 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:57054:1858396216610048:192.168.203.30@tcp:104: 00010000:00010000:1.0:1772305933.315767:0:57054:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 0000000066b8a8ab/0xa5e9c8c58c6fe7c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1ee expref: 77 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.315778:0:57054:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 0000000066b8a8ab/0xa5e9c8c58c6fe7c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1ee expref: 77 pid: 54698 timeout: 1345 lvb_type: 0 00000100:00100000:1.0:1772305933.315788:0:57054:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ad79fcd8 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:57054:1858396216610112:192.168.203.30@tcp:104: 00010000:00010000:1.0:1772305933.315839:0:57054:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6fe21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1cb expref: 66 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.315849:0:57054:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6fe21 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1cb expref: 66 pid: 54697 timeout: 1345 lvb_type: 0 00000100:00100000:1.0:1772305933.315860:0:57054:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b1d66a61 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:57054:1858396216610176:192.168.203.30@tcp:104: 00010000:00010000:1.0:1772305933.315898:0:57054:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c6fd9c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x331:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1a8 expref: 77 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.315913:0:57054:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c6fd9c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x331:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1a8 expref: 77 pid: 54698 timeout: 1345 lvb_type: 0 00000100:00100000:1.0:1772305933.315922:0:57054:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1cffce8 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:57054:1858396216610240:192.168.203.30@tcp:104: 00000100:00100000:1.0:1772305933.315957:0:57054:0:(client.c:2500:ptlrpc_set_wait()) set 0000000086838cff going to sleep for 6 seconds 00000100:00100000:1.0:1772305933.316510:0:57054:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d8a50734 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:57054:1858396216610048:192.168.203.30@tcp:104: 00000100:00100000:1.0:1772305933.316522:0:57054:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ad79fcd8 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:57054:1858396216610112:192.168.203.30@tcp:104: 00000100:00100000:3.0:1772305933.316805:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305933.316852:0:5493:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225405696 00000100:00100000:2.0:1772305933.316874:0:57054:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1cffce8 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:57054:1858396216610240:192.168.203.30@tcp:104: 00010000:00010000:1.0:1772305933.316875:0:5493:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fe91 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1fc expref: 78 pid: 54698 timeout: 1345 lvb_type: 0 00000100:00100000:1.0:1772305933.316916:0:5493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3142 00000100:00100000:1.0:1772305933.316923:0:5493:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000af091ea6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+78:2215:x1858396225405696:12345-192.168.203.30@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1772305933.316934:0:5493:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1772305933.316938:0:5493:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fe91 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1fc expref: 78 pid: 54698 timeout: 1345 lvb_type: 0 00010000:00010000:1.0:1772305933.316946:0:5493:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fe91 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1fc expref: 78 pid: 54698 timeout: 1345 lvb_type: 0 00010000:00010000:1.0:1772305933.316958:0:5493:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c6fe91 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x331:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1fc expref: 78 pid: 54698 timeout: 1345 lvb_type: 0 00010000:00010000:1.0:1772305933.316973:0:5493:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x331:0x0].0x0 (00000000499b0bdb) 00010000:00010000:1.0:1772305933.316978:0:5493:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6ff47 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x331:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305933.316980:0:57054:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b1d66a61 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:57054:1858396216610176:192.168.203.30@tcp:104: 00010000:00010000:1.0:1772305933.316999:0:5493:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6ff47 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x331:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.317007:0:5493:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1772305933.317008:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00010000:2.0:1772305933.317029:0:57054:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6ff47 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x331:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305933.317049:0:5493:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000af091ea6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+77:2215:x1858396225405696:12345-192.168.203.30@tcp:103:ldlm_bl_03.0 Request processed in 125us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305933.317058:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305933.317062:0:5493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3142 00000100:00100000:1.0:1772305933.317084:0:5493:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225405760 00000100:00100000:2.0:1772305933.317090:0:16126:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225405888 00010000:00010000:1.0:1772305933.317097:0:5493:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 0000000066b8a8ab/0xa5e9c8c58c6fe7c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1ee expref: 77 pid: 54698 timeout: 1345 lvb_type: 0 00010000:00010000:2.0:1772305933.317111:0:16126:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6fe21 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1cb expref: 67 pid: 54697 timeout: 1345 lvb_type: 0 00000100:00100000:1.0:1772305933.317125:0:5493:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3143 00000100:00100000:1.0:1772305933.317133:0:5493:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000084809c1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+77:2215:x1858396225405760:12345-192.168.203.30@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1772305933.317142:0:5493:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1772305933.317148:0:5493:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 0000000066b8a8ab/0xa5e9c8c58c6fe7c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1ee expref: 77 pid: 54698 timeout: 1345 lvb_type: 0 00000100:00100000:2.0:1772305933.317157:0:16126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3144 00000100:00100000:3.0:1772305933.317163:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00010000:1.0:1772305933.317164:0:5493:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 0000000066b8a8ab/0xa5e9c8c58c6fe7c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1ee expref: 77 pid: 54698 timeout: 1345 lvb_type: 0 00000100:00100000:2.0:1772305933.317169:0:16126:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e7a7367b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2215:x1858396225405888:12345-192.168.203.30@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1772305933.317185:0:16126:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1772305933.317191:0:5493:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000066b8a8ab/0xa5e9c8c58c6fe7c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1ee expref: 77 pid: 54698 timeout: 1345 lvb_type: 0 00010000:00010000:2.0:1772305933.317193:0:16126:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6fe21 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1cb expref: 67 pid: 54697 timeout: 1345 lvb_type: 0 00000100:00100000:3.0:1772305933.317200:0:5495:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225405824 00010000:00010000:2.0:1772305933.317218:0:16126:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6fe21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1cb expref: 67 pid: 54697 timeout: 1345 lvb_type: 0 00010000:00010000:3.0:1772305933.317221:0:5495:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c6fd9c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x331:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1a8 expref: 77 pid: 54698 timeout: 1345 lvb_type: 0 00010000:00010000:1.0:1772305933.317235:0:5493:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x331:0x0].0x0 (00000000499b0bdb) 00010000:00010000:1.0:1772305933.317240:0:5493:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6ff47 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x331:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.317249:0:5493:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6ff47 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x331:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305933.317257:0:5495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3145 00010000:00010000:1.0:1772305933.317258:0:5493:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1772305933.317265:0:5495:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b36dba7e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+77:2215:x1858396225405824:12345-192.168.203.30@tcp:103:ldlm_bl_04.0 00010000:00010000:2.0:1772305933.317269:0:16126:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000048d87789/0xa5e9c8c58c6fe21 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1cb expref: 67 pid: 54697 timeout: 1345 lvb_type: 0 00010000:00010000:3.0:1772305933.317276:0:5495:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1772305933.317283:0:5495:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c6fd9c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x331:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1a8 expref: 77 pid: 54698 timeout: 1345 lvb_type: 0 00010000:00010000:2.0:1772305933.317286:0:16126:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x331:0x0].0x0 (00000000499b0bdb) 00000100:00100000:1.0:1772305933.317287:0:5493:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000084809c1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+77:2215:x1858396225405760:12345-192.168.203.30@tcp:103:ldlm_bl_01.0 Request processed in 151us (310us total) trans 0 rc 0/0 00010000:00010000:2.0:1772305933.317294:0:16126:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6ff47 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x331:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305933.317306:0:5493:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3143 00010000:00010000:2.0:1772305933.317314:0:16126:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6ff47 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x331:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.317323:0:16126:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1772305933.317340:0:5495:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c6fd9c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x331:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1a8 expref: 76 pid: 54698 timeout: 1345 lvb_type: 0 00010000:00010000:3.0:1772305933.317361:0:5495:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c6fd9c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x331:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1a8 expref: 76 pid: 54698 timeout: 1345 lvb_type: 0 00000100:00100000:2.0:1772305933.317367:0:16126:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e7a7367b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f935b4d0-e17f-49c8-8011-4be99ba75430+66:2215:x1858396225405888:12345-192.168.203.30@tcp:103:ldlm_bl_01.0 Request processed in 198us (310us total) trans 0 rc 0/0 00010000:00010000:3.0:1772305933.317377:0:5495:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x331:0x0].0x0 (00000000499b0bdb) 00010000:00010000:3.0:1772305933.317381:0:5495:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6ff47 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x331:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305933.317389:0:5495:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6ff47 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x331:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305933.317389:0:16126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3144 00010000:00010000:3.0:1772305933.317397:0:5495:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6ff47 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x331:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305933.317415:0:5495:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1772305933.317460:0:57054:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6ff47 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x331:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.317469:0:57054:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6ff47 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x331:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305933.317485:0:5495:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b36dba7e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+75:2215:x1858396225405824:12345-192.168.203.30@tcp:103:ldlm_bl_04.0 Request processed in 218us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305933.317491:0:5495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3145 00000001:00080000:2.0:1772305933.317535:0:57054:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934970 00000001:00080000:2.0:1772305933.317733:0:57054:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934970 00000100:00100000:2.0:1772305933.317814:0:57054:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085acb02d pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:57054:1858396216610304:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1772305933.317902:0:57054:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772305933.317930:0:57054:0:(client.c:2500:ptlrpc_set_wait()) set 0000000000cc2a19 going to sleep for 6 seconds 00000100:00100000:3.0:1772305933.317946:0:57220:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216610304 00000100:00100000:3.0:1772305933.317975:0:57220:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1772305933.317979:0:57220:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000090401002 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:57054:x1858396216610304:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1772305933.318031:0:57220:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000090401002 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:57054:x1858396216610304:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 51us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305933.318038:0:57220:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1772305933.318059:0:57054:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085acb02d pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:57054:1858396216610304:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1772305933.318106:0:57054:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934970 00000001:00080000:2.0:1772305933.318133:0:57054:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934970 00010000:00010000:2.0:1772305933.318143:0:57054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6ff47 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x331:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.318152:0:57054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6ff47 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x331:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.318160:0:57054:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6ff47 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x331:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.318167:0:57054:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000043f9fbca already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305933.318170:0:57054:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6ff47 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x331:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.318177:0:57054:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6ff47 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x331:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.318189:0:57054:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x331:0x0].0x0 (00000000499b0bdb) 00010000:00010000:2.0:1772305933.318192:0:57054:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1772305933.318195:0:57054:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6ff47 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x331:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.318202:0:57054:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c6ff47 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x331:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1772305933.318407:0:57054:0:(mdd_object.c:3529:mdd_close()) Object [0x200000408:0x96:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1772305933.318506:0:57054:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xd:0x0].14, 64 off9136 00000004:00080000:2.0:1772305933.318513:0:57054:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1245212885666ns, next at 1246212883429ns, rc = 0 00000001:00080000:2.0:1772305933.318520:0:57054:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934970 00010000:00010000:2.0:1772305933.318574:0:57054:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x331:0x0].0x0 (00000000499b0bdb) 00010000:00010000:2.0:1772305933.318578:0:57054:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1772305933.318583:0:57054:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c6ff32 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x331:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f22d expref: 65 pid: 54697 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305933.318673:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000039b4b25e pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+64:99900:x1858396225405632:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 3847us (3947us total) trans 8589934970 rc 0/0 00000100:00100000:2.0:1772305933.318684:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 149 00000100:00100000:3.0:1772305933.325552:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305933.325590:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225406016 00000100:00100000:1.0:1772305933.325623:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1146 00000100:00100000:1.0:1772305933.325650:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cfcd4c56 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+64:99901:x1858396225406016:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1772305933.325665:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305933.325678:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ee5a0681/0xa5e9c8c58c6ff4e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x332:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f234 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.325741:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6ff55 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x332:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.325751:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6ff55 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x332:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.325757:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6ff55 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x332:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1772305933.325766:0:54697:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x332:0x0]: returning size 0 00010000:00010000:1.0:1772305933.325833:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ee5a0681/0xa5e9c8c58c6ff4e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x332:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f234 expref: 67 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.325843:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6ff55 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x332:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f234 expref: 66 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.325848:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x332:0x0].0x0 (0000000013d42fff) 00010000:00010000:1.0:1772305933.325850:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1772305933.325852:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000295bd7c, rc 0) 00000100:00100000:1.0:1772305933.325885:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cfcd4c56 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+66:99901:x1858396225406016:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 235us (336us total) trans 8589934971 rc 0/0 00000100:00100000:1.0:1772305933.325890:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1146 00000100:00100000:1.0:1772305933.326737:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305933.326781:0:48470:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225406080 00000100:00100000:0.0:1772305933.326826:0:48470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5770 00000100:00100000:0.0:1772305933.326833:0:48470:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005dcbb4b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f935b4d0-e17f-49c8-8011-4be99ba75430+163:2215:x1858396225406080:12345-192.168.203.30@tcp:1:lfs.0 00010000:00010000:0.0:1772305933.326859:0:48470:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6ff63 lrc: 3/0,1 mode: --/PW res: [0x1b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305933.326874:0:48470:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6febb lrc: 2/0,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f20a expref: 163 pid: 10520 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1772305933.326888:0:48470:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6ff0f lrc: 2/0,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f21f expref: 224 pid: 48470 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1772305933.326896:0:48470:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305933.326898:0:48470:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305933.326901:0:48470:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6ff63 lrc: 5/0,1 mode: --/PW res: [0x1b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305933.326926:0:48470:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6ff0f lrc: 3/0,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f21f expref: 224 pid: 48470 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1772305933.326939:0:48470:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6ff0f lrc: 4/0,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f21f expref: 224 pid: 48470 timeout: 1345 lvb_type: 1 00000100:00100000:0.0:1772305933.326951:0:48470:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000848c45a9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:48470:1858396216610368:192.168.203.30@tcp:104: 00010000:00010000:0.0:1772305933.327008:0:48470:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6febb lrc: 3/0,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f20a expref: 163 pid: 10520 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1772305933.327020:0:48470:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6febb lrc: 4/0,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f20a expref: 163 pid: 10520 timeout: 1345 lvb_type: 1 00000100:00100000:0.0:1772305933.327031:0:48470:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d0ab861f pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:48470:1858396216610432:192.168.203.30@tcp:104: 00000100:00100000:0.0:1772305933.327059:0:48470:0:(client.c:2500:ptlrpc_set_wait()) set 00000000ef0768cf going to sleep for 6 seconds 00000100:00100000:0.0:1772305933.327789:0:48470:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000848c45a9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:48470:1858396216610368:192.168.203.30@tcp:104: 00000100:00100000:0.0:1772305933.327803:0:48470:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d0ab861f pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:48470:1858396216610432:192.168.203.30@tcp:104: 00010000:00010000:0.0:1772305933.327822:0:48470:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6ff63 lrc: 3/0,1 mode: --/PW res: [0x1b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305933.328014:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305933.328039:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305933.328065:0:5495:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225406208 00010000:00010000:3.0:1772305933.328081:0:5495:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6ff0f lrc: 4/0,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f21f expref: 225 pid: 48470 timeout: 1345 lvb_type: 1 00000100:00100000:0.0:1772305933.328086:0:16126:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225406144 00010000:00010000:0.0:1772305933.328106:0:16126:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6febb lrc: 4/0,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f20a expref: 164 pid: 10520 timeout: 1345 lvb_type: 1 00000100:00100000:3.0:1772305933.328116:0:5495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3146 00000100:00100000:3.0:1772305933.328123:0:5495:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009ef3a710 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+225:2216:x1858396225406208:12345-192.168.203.30@tcp:103:ldlm_bl_05.0 00010000:00010000:3.0:1772305933.328132:0:5495:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1772305933.328143:0:7104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3147 00010000:00010000:3.0:1772305933.328150:0:5495:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6ff0f lrc: 4/0,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f21f expref: 225 pid: 48470 timeout: 1345 lvb_type: 1 00000100:00100000:1.0:1772305933.328151:0:7104:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007776dfe8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2215:x1858396225406144:12345-192.168.203.30@tcp:103:ldlm_bl_07.0 00010000:00010000:1.0:1772305933.328163:0:7104:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1772305933.328169:0:5495:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6ff0f lrc: 3/0,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f21f expref: 225 pid: 48470 timeout: 1345 lvb_type: 1 00010000:00010000:1.0:1772305933.328183:0:7104:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6febb lrc: 4/0,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f20a expref: 164 pid: 10520 timeout: 1345 lvb_type: 1 00010000:00010000:3.0:1772305933.328190:0:5495:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c6ff0f lrc: 0/0,0 mode: --/PR res: [0x1b3:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f21f expref: 225 pid: 48470 timeout: 1345 lvb_type: 1 00010000:00010000:1.0:1772305933.328204:0:7104:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6febb lrc: 3/0,0 mode: PR/PR res: [0x1b3:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f20a expref: 164 pid: 10520 timeout: 1345 lvb_type: 1 00010000:00010000:3.0:1772305933.328217:0:5495:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1772305933.328229:0:7104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c6febb lrc: 0/0,0 mode: --/PR res: [0x1b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f20a expref: 164 pid: 10520 timeout: 1345 lvb_type: 1 00010000:00010000:1.0:1772305933.328242:0:7104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305933.328244:0:7104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1772305933.328247:0:5495:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009ef3a710 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+224:2216:x1858396225406208:12345-192.168.203.30@tcp:103:ldlm_bl_05.0 Request processed in 123us (232us total) trans 0 rc 0/0 00010000:00010000:1.0:1772305933.328247:0:7104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6ff63 lrc: 3/0,1 mode: PW/PW res: [0x1b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305933.328264:0:5495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3146 00010000:00010000:1.0:1772305933.328271:0:7104:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6ff63 lrc: 4/0,1 mode: PW/PW res: [0x1b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.328293:0:7104:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1772305933.328300:0:48470:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6ff63 lrc: 3/0,1 mode: PW/PW res: [0x1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305933.328307:0:48470:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6ff63 lrc: 3/0,1 mode: PW/PW res: [0x1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305933.328315:0:7104:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007776dfe8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+163:2215:x1858396225406144:12345-192.168.203.30@tcp:103:ldlm_bl_07.0 Request processed in 165us (274us total) trans 0 rc 0/0 00010000:00010000:3.0:1772305933.328320:0:48470:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6ff63 lrc: 3/0,1 mode: PW/PW res: [0x1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305933.328326:0:7104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3147 00010000:00010000:3.0:1772305933.328352:0:48470:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6ff63 lrc: 2/0,0 mode: PW/PW res: [0x1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305933.328438:0:48470:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1772305933.328468:0:5496:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1772305933.328474:0:5496:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6ff63 lrc: 2/0,0 mode: PW/PW res: [0x1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305933.328484:0:5496:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006e08f961 already unused, calling callback (00000000b5e4f3c0) 00010000:00010000:0.0:1772305933.328488:0:5496:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6ff63 lrc: 2/0,0 mode: PW/PW res: [0x1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305933.328497:0:5496:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6ff63 lrc: 3/0,0 mode: PW/PW res: [0x1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305933.328504:0:48470:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005dcbb4b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f935b4d0-e17f-49c8-8011-4be99ba75430+162:2215:x1858396225406080:12345-192.168.203.30@tcp:1:lfs.0 Request processed in 1670us (1767us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305933.328512:0:48470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5770 00010000:00010000:0.0:1772305933.328516:0:5496:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6ff63 lrc: 1/0,0 mode: --/PW res: [0x1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305933.328526:0:5496:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e08f961/0xa5e9c8c58c6ff63 lrc: 0/0,0 mode: --/PW res: [0x1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305933.328542:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1772305933.328544:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1772305933.328546:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772305933.329095:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305933.329121:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225406336 00000100:00100000:3.0:1772305933.329155:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 150 00000100:00100000:3.0:1772305933.329162:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000051e590c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+66:99901:x1858396225406336:12345-192.168.203.30@tcp:35:lfs.0 00000004:00010000:3.0:1772305933.329194:0:57054:0:(mdt_open.c:1862:mdt_hsm_release()) ### [0x200000402:0x332:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6ff55 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x332:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f234 expref: 66 pid: 54697 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1772305933.329304:0:57054:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934972 00000001:00080000:3.0:1772305933.329538:0:57054:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934972 00010000:00010000:3.0:1772305933.329569:0:57054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6ff6a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x332:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305933.329577:0:57054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 0000000096601b0a/0xa5e9c8c58c6fde2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x332:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1bd expref: 74 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305933.329582:0:57054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6feb4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x332:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f203 expref: 67 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305933.329587:0:57054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6ff08 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x332:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f218 expref: 74 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305933.329600:0:57054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6ff1d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x332:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f226 expref: 74 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305933.329604:0:57054:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6ff6a lrc: 7/0,1 mode: --/EX res: [0x200000402:0x332:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305933.329618:0:57054:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6ff1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x332:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f226 expref: 74 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305933.329645:0:57054:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6ff1d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x332:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f226 expref: 74 pid: 54697 timeout: 1345 lvb_type: 0 00000100:00100000:3.0:1772305933.329652:0:57054:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f7fa0064 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:57054:1858396216610496:192.168.203.30@tcp:104: 00010000:00010000:3.0:1772305933.329692:0:57054:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6ff08 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x332:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f218 expref: 74 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305933.329699:0:57054:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6ff08 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x332:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f218 expref: 74 pid: 54697 timeout: 1345 lvb_type: 0 00000100:00100000:3.0:1772305933.329705:0:57054:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000004f8c4bb pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:57054:1858396216610560:192.168.203.30@tcp:104: 00010000:00010000:3.0:1772305933.329736:0:57054:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6feb4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x332:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f203 expref: 67 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305933.329747:0:57054:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6feb4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x332:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f203 expref: 67 pid: 54698 timeout: 1345 lvb_type: 0 00000100:00100000:3.0:1772305933.329758:0:57054:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e20b2bbf pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:57054:1858396216610624:192.168.203.30@tcp:104: 00010000:00010000:3.0:1772305933.329907:0:57054:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 0000000096601b0a/0xa5e9c8c58c6fde2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x332:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1bd expref: 74 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305933.329915:0:57054:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 0000000096601b0a/0xa5e9c8c58c6fde2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x332:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1bd expref: 74 pid: 54698 timeout: 1345 lvb_type: 0 00000100:00100000:3.0:1772305933.329922:0:57054:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000024c17032 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:57054:1858396216610688:192.168.203.30@tcp:104: 00000100:00100000:3.0:1772305933.329945:0:57054:0:(client.c:2500:ptlrpc_set_wait()) set 00000000096ac161 going to sleep for 6 seconds 00000100:00100000:3.0:1772305933.330535:0:57054:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f7fa0064 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:57054:1858396216610496:192.168.203.30@tcp:104: 00000100:00100000:3.0:1772305933.330552:0:57054:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000004f8c4bb pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:57054:1858396216610560:192.168.203.30@tcp:104: 00000100:00100000:1.0:1772305933.330705:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305933.330728:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305933.330767:0:7104:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225406464 00000100:00100000:0.0:1772305933.330771:0:5495:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225406400 00010000:00010000:3.0:1772305933.330787:0:7104:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6ff08 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x332:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f218 expref: 76 pid: 54697 timeout: 1345 lvb_type: 0 00010000:00010000:0.0:1772305933.330793:0:5495:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6ff1d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x332:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f226 expref: 76 pid: 54697 timeout: 1345 lvb_type: 0 00000100:00100000:3.0:1772305933.330816:0:7104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3148 00000100:00100000:3.0:1772305933.330823:0:7104:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ab509801 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+76:2216:x1858396225406464:12345-192.168.203.30@tcp:103:ldlm_bl_08.0 00000100:00100000:1.0:1772305933.330833:0:5494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3149 00010000:00010000:3.0:1772305933.330834:0:7104:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1772305933.330841:0:5494:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000eae1ffd6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+76:2215:x1858396225406400:12345-192.168.203.30@tcp:103:ldlm_bl_06.0 00010000:00010000:3.0:1772305933.330842:0:7104:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6ff08 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x332:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f218 expref: 76 pid: 54697 timeout: 1345 lvb_type: 0 00010000:00010000:1.0:1772305933.330854:0:5494:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1772305933.330859:0:5494:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6ff1d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x332:0x0].0x0 bits 0x20/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f226 expref: 76 pid: 54697 timeout: 1345 lvb_type: 0 00010000:00010000:1.0:1772305933.330867:0:5494:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6ff1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x332:0x0].0x0 bits 0x20/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f226 expref: 76 pid: 54697 timeout: 1345 lvb_type: 0 00010000:00010000:1.0:1772305933.330877:0:5494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c6ff1d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x332:0x0].0x0 bits 0x20/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f226 expref: 76 pid: 54697 timeout: 1345 lvb_type: 0 00010000:00010000:1.0:1772305933.330887:0:5494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x332:0x0].0x0 (0000000013d42fff) 00010000:00010000:1.0:1772305933.330889:0:5494:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6ff6a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x332:0x0].0x0 bits 0x28/0x0 rrc: 9 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.330899:0:5494:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6ff6a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x332:0x0].0x0 bits 0x28/0x0 rrc: 9 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.330903:0:5494:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1772305933.330914:0:7104:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6ff08 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x332:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f218 expref: 75 pid: 54697 timeout: 1345 lvb_type: 0 00010000:00010000:3.0:1772305933.330928:0:7104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c6ff08 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x332:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f218 expref: 75 pid: 54697 timeout: 1345 lvb_type: 0 00000100:00100000:1.0:1772305933.330929:0:5494:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000eae1ffd6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+75:2215:x1858396225406400:12345-192.168.203.30@tcp:103:ldlm_bl_06.0 Request processed in 88us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305933.330946:0:5494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3149 00000100:00100000:0.0:1772305933.330953:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00010000:3.0:1772305933.330968:0:7104:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x332:0x0].0x0 (0000000013d42fff) 00000100:00100000:1.0:1772305933.330968:0:5494:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225406528 00010000:00010000:3.0:1772305933.330972:0:7104:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6ff6a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x332:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305933.330978:0:7104:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6ff6a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x332:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305933.330982:0:7104:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1772305933.330984:0:5494:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6feb4 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x332:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f203 expref: 68 pid: 54698 timeout: 1345 lvb_type: 0 00000100:00100000:3.0:1772305933.331007:0:7104:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ab509801 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+73:2216:x1858396225406464:12345-192.168.203.30@tcp:103:ldlm_bl_08.0 Request processed in 182us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305933.331008:0:5494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3150 00000100:00100000:1.0:1772305933.331016:0:5494:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d0ab861f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+68:2216:x1858396225406528:12345-192.168.203.30@tcp:103:ldlm_bl_03.0 00000100:00100000:3.0:1772305933.331021:0:7104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3148 00010000:00010000:1.0:1772305933.331025:0:5494:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1772305933.331030:0:5494:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6feb4 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x332:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f203 expref: 68 pid: 54698 timeout: 1345 lvb_type: 0 00010000:00010000:1.0:1772305933.331039:0:5494:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6feb4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x332:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f203 expref: 68 pid: 54698 timeout: 1345 lvb_type: 0 00010000:00010000:1.0:1772305933.331050:0:5494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x332:0x0].0x0 (0000000013d42fff) 00010000:00010000:1.0:1772305933.331052:0:5494:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6ff6a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x332:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.331057:0:5494:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6ff6a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x332:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305933.331074:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00010000:1.0:1772305933.331077:0:5494:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1772305933.331095:0:57054:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c6feb4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x332:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f203 expref: 68 pid: 54698 timeout: 1345 lvb_type: 0 00000100:00100000:1.0:1772305933.331104:0:5494:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d0ab861f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+68:2216:x1858396225406528:12345-192.168.203.30@tcp:103:ldlm_bl_03.0 Request processed in 84us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305933.331112:0:5494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3150 00000100:00100000:3.0:1772305933.331114:0:57054:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e20b2bbf pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:57054:1858396216610624:192.168.203.30@tcp:104: 00000100:00100000:1.0:1772305933.331133:0:5494:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225406592 00000100:00100000:3.0:1772305933.331136:0:57054:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000024c17032 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:57054:1858396216610688:192.168.203.30@tcp:104: 00010000:00010000:1.0:1772305933.331147:0:5494:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 0000000096601b0a/0xa5e9c8c58c6fde2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x332:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1bd expref: 73 pid: 54698 timeout: 1345 lvb_type: 0 00000100:00100000:1.0:1772305933.331170:0:5494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3151 00000100:00100000:1.0:1772305933.331177:0:5494:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e87a387b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+73:2217:x1858396225406592:12345-192.168.203.30@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1772305933.331186:0:5494:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1772305933.331191:0:5494:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 0000000096601b0a/0xa5e9c8c58c6fde2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x332:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1bd expref: 73 pid: 54698 timeout: 1345 lvb_type: 0 00010000:00010000:1.0:1772305933.331204:0:5494:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 0000000096601b0a/0xa5e9c8c58c6fde2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x332:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1bd expref: 73 pid: 54698 timeout: 1345 lvb_type: 0 00010000:00010000:1.0:1772305933.331220:0:5494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000096601b0a/0xa5e9c8c58c6fde2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x332:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1bd expref: 73 pid: 54698 timeout: 1345 lvb_type: 0 00010000:00010000:3.0:1772305933.331223:0:57054:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6ff6a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x332:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.331241:0:5494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x332:0x0].0x0 (0000000013d42fff) 00010000:00010000:1.0:1772305933.331245:0:5494:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6ff6a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x332:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.331251:0:5494:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6ff6a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x332:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.331260:0:5494:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6ff6a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x332:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.331279:0:5494:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1772305933.331289:0:57054:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6ff6a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x332:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305933.331296:0:57054:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6ff6a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x332:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305933.331304:0:5494:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e87a387b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+72:2217:x1858396225406592:12345-192.168.203.30@tcp:103:ldlm_bl_04.0 Request processed in 128us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305933.331311:0:5494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3151 00000001:00080000:3.0:1772305933.331408:0:57054:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934972 00000001:00080000:3.0:1772305933.331567:0:57054:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934972 00000100:00100000:3.0:1772305933.331672:0:57054:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000024c17032 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:57054:1858396216610752:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1772305933.331710:0:57054:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305933.331734:0:57054:0:(client.c:2500:ptlrpc_set_wait()) set 0000000041c46f66 going to sleep for 6 seconds 00000100:00100000:0.0:1772305933.331743:0:57220:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216610752 00000100:00100000:0.0:1772305933.331783:0:57220:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1772305933.331788:0:57220:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e20b2bbf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:57054:x1858396216610752:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1772305933.331856:0:57220:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e20b2bbf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:57054:x1858396216610752:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 66us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305933.331865:0:57220:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1772305933.331880:0:57054:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000024c17032 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:57054:1858396216610752:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:3.0:1772305933.331928:0:57054:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934972 00000001:00080000:3.0:1772305933.331953:0:57054:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934972 00010000:00010000:3.0:1772305933.331961:0:57054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6ff6a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x332:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305933.331967:0:57054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6ff6a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x332:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305933.331972:0:57054:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6ff6a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x332:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305933.331976:0:57054:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000403929b5 already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305933.331978:0:57054:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6ff6a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x332:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305933.331982:0:57054:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6ff6a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x332:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305933.331990:0:57054:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x332:0x0].0x0 (0000000013d42fff) 00010000:00010000:3.0:1772305933.331992:0:57054:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1772305933.331994:0:57054:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6ff6a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x332:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305933.331998:0:57054:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000403929b5/0xa5e9c8c58c6ff6a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x332:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1772305933.332174:0:57054:0:(mdd_object.c:3529:mdd_close()) Object [0x200000408:0x97:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1772305933.332248:0:57054:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xb:0x0].13, 64 off9120 00000004:00080000:3.0:1772305933.332253:0:57054:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1245226625240ns, next at 1246226623580ns, rc = 0 00000001:00080000:3.0:1772305933.332257:0:57054:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934972 00010000:00010000:3.0:1772305933.332287:0:57054:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x332:0x0].0x0 (0000000013d42fff) 00010000:00010000:3.0:1772305933.332290:0:57054:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1772305933.332293:0:57054:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c6ff55 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x332:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f234 expref: 66 pid: 54697 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305933.332361:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000051e590c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+65:99901:x1858396225406336:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 3198us (3265us total) trans 8589934972 rc 0/0 00000100:00100000:3.0:1772305933.332369:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 150 00000100:00100000:3.0:1772305933.343860:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305933.343909:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225406656 00000100:00100000:1.0:1772305933.343949:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1147 00000100:00100000:1.0:1772305933.343955:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000024c17032 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+72:99905:x1858396225406656:12345-192.168.203.30@tcp:101:mkdir.0 00010000:00010000:1.0:1772305933.343975:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305933.343989:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ee5a0681/0xa5e9c8c58c6ff71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f23b expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.344037:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000017162762/0xa5e9c8c58c6ff78 lrc: 3/1,0 mode: --/PR res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.344047:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000017162762/0xa5e9c8c58c6ff78 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.344055:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000017162762/0xa5e9c8c58c6ff78 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1772305933.344101:0:54697:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000408:0x95:0x0]: returning size 11776 00000004:00200000:1.0:1772305933.344105:0:54697:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1772305933.344124:0:54697:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 0000000017162762/0xa5e9c8c58c6ff78 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.344146:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ee5a0681/0xa5e9c8c58c6ff71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f23b expref: 74 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.344162:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000017162762/0xa5e9c8c58c6ff78 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f23b expref: 73 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.344171:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0x0 (00000000fbf66531) 00010000:00010000:1.0:1772305933.344175:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1772305933.344178:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000017162762, rc 0) 00000100:00100000:1.0:1772305933.344221:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000024c17032 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+73:99905:x1858396225406656:12345-192.168.203.30@tcp:101:mkdir.0 Request processed in 266us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305933.344227:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1147 00000100:00100000:1.0:1772305933.347923:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305933.347967:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225406720 00000100:00100000:2.0:1772305933.348002:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1148 00000100:00100000:2.0:1772305933.348009:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009ef3a710 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+73:99906:x1858396225406720:12345-192.168.203.30@tcp:101:rm.0 00010000:00010000:2.0:1772305933.348019:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305933.348030:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c6ff7f lrc: 2/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f242 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.348067:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6ff86 lrc: 3/1,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.348078:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6ff86 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.348087:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6ff86 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.348100:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6ff8d lrc: 3/1,0 mode: --/PR res: [0x200000408:0x95:0x0].0x32d22ff1 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.348108:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6ff8d lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x32d22ff1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.348116:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6ff8d lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x32d22ff1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.348161:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6ff86 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.348169:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6ff86 lrc: 2/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.348177:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6ff86 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.348185:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000010dea6ba already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305933.348189:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6ff86 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.348197:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6ff86 lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.348206:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0x0 (00000000fbf66531) 00010000:00010000:2.0:1772305933.348209:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305933.348212:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6ff86 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.348218:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6ff86 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.348228:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6ff8d lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x32d22ff1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.348235:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6ff8d lrc: 2/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x32d22ff1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.348242:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6ff8d lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x32d22ff1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.348248:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006c757b88 already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305933.348250:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6ff8d lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x32d22ff1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.348256:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6ff8d lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x32d22ff1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.348264:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0x32d22ff1 (000000008fd1be63) 00010000:00010000:2.0:1772305933.348266:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305933.348268:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6ff8d lrc: 2/0,0 mode: --/PR res: [0x200000408:0x95:0x0].0x32d22ff1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.348274:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6ff8d lrc: 0/0,0 mode: --/PR res: [0x200000408:0x95:0x0].0x32d22ff1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.348297:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c6ff7f lrc: 1/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f242 expref: 74 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.348305:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c6ff7f lrc: 0/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f242 expref: 74 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.348314:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f20d88bd, rc 0) 00000100:00100000:2.0:1772305933.348362:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009ef3a710 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+73:99906:x1858396225406720:12345-192.168.203.30@tcp:101:rm.0 Request processed in 352us (439us total) trans 0 rc 301/301 00000100:00100000:2.0:1772305933.348371:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1148 00000100:00100000:1.0:1772305933.352209:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305933.352259:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225406848 00000100:00100000:2.0:1772305933.352306:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1149 00000100:00100000:2.0:1772305933.352314:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007776dfe8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+73:99907:x1858396225406848:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:2.0:1772305933.352326:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305933.352340:0:54697:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1772305933.352357:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000017162762/0xa5e9c8c58c6ff78 lrc: 0/0,0 mode: --/PR res: [0x200000408:0x95:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f23b expref: 73 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.352372:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0x0 (00000000fbf66531) 00010000:00010000:2.0:1772305933.352377:0:54697:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1772305933.352388:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c6ff94 lrc: 2/0,0 mode: --/CW res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f249 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.352493:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6ff9b lrc: 3/0,1 mode: --/CW res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.352506:0:54697:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000cb557b9d/0xa5e9c8c58c6fe44 lrc: 2/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1e0 expref: 64 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.352515:0:54697:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6ff9b lrc: 4/0,1 mode: --/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.352548:0:54697:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000cb557b9d/0xa5e9c8c58c6fe44 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1e0 expref: 64 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.352564:0:54697:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000cb557b9d/0xa5e9c8c58c6fe44 lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1e0 expref: 64 pid: 54698 timeout: 1345 lvb_type: 0 00000100:00100000:2.0:1772305933.352579:0:54697:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085acb02d pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:54697:1858396216610816:192.168.203.30@tcp:104: 00000100:00100000:2.0:1772305933.352654:0:54697:0:(client.c:2500:ptlrpc_set_wait()) set 00000000b52a513c going to sleep for 6 seconds 00000100:00100000:0.0:1772305933.353444:0:54697:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085acb02d pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:54697:1858396216610816:192.168.203.30@tcp:104: 00010000:00010000:0.0:1772305933.353461:0:54697:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6ff9b lrc: 3/0,1 mode: --/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305933.353585:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305933.353618:0:5494:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225406912 00010000:00010000:0.0:1772305933.353663:0:5494:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cb557b9d/0xa5e9c8c58c6fe44 lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1e0 expref: 65 pid: 54698 timeout: 1345 lvb_type: 0 00000100:00100000:0.0:1772305933.353697:0:5494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3152 00000100:00100000:0.0:1772305933.353704:0:5494:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000eae1ffd6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+65:2215:x1858396225406912:12345-192.168.203.30@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1772305933.353716:0:5494:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1772305933.353722:0:5494:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000cb557b9d/0xa5e9c8c58c6fe44 lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1e0 expref: 65 pid: 54698 timeout: 1345 lvb_type: 0 00010000:00010000:0.0:1772305933.353737:0:5494:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000cb557b9d/0xa5e9c8c58c6fe44 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1e0 expref: 65 pid: 54698 timeout: 1345 lvb_type: 0 00010000:00010000:0.0:1772305933.353751:0:5494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cb557b9d/0xa5e9c8c58c6fe44 lrc: 0/0,0 mode: --/PR res: [0x200000408:0x95:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1e0 expref: 65 pid: 54698 timeout: 1345 lvb_type: 0 00010000:00010000:0.0:1772305933.353761:0:5494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0x0 (00000000fbf66531) 00010000:00010000:0.0:1772305933.353763:0:5494:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6ff9b lrc: 3/0,1 mode: --/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305933.353769:0:5494:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6ff9b lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305933.353774:0:5494:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6ff9b lrc: 4/0,1 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305933.353793:0:5494:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1772305933.353817:0:5494:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000eae1ffd6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+64:2215:x1858396225406912:12345-192.168.203.30@tcp:103:ldlm_bl_02.0 Request processed in 113us (233us total) trans 0 rc 0/0 00010000:00010000:2.0:1772305933.353819:0:54697:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6ff9b lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305933.353826:0:5494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3152 00010000:00010000:2.0:1772305933.353835:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6ff9b lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.353853:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6ffa2 lrc: 3/0,1 mode: --/PW res: [0x200000408:0x95:0x0].0x32d22ff1 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.353864:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6ffa2 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x95:0x0].0x32d22ff1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.353879:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6ffa2 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x95:0x0].0x32d22ff1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1772305933.354567:0:54697:0:(osp_object.c:1645:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x100010000:0x1b4:0x0], index 1: 0 00010000:00010000:2.0:1772305933.354762:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c937f2b9/0xa5e9c8c58c6ffa9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x333:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.354773:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c937f2b9/0xa5e9c8c58c6ffa9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x333:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.354782:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c937f2b9/0xa5e9c8c58c6ffa9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x333:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.354815:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6ff9b lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.354823:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6ff9b lrc: 2/0,0 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.354830:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6ff9b lrc: 3/0,0 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.354836:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006c757b88 already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305933.354839:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6ff9b lrc: 3/0,0 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.354846:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6ff9b lrc: 4/0,0 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.354861:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0x0 (00000000fbf66531) 00010000:00010000:2.0:1772305933.354864:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305933.354866:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6ff9b lrc: 2/0,0 mode: --/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.354873:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6ff9b lrc: 0/0,0 mode: --/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1772305933.354884:0:54697:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000007776dfe8 reply state 0000000012f8c5cd transno 8589934973 ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6ffa2 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x95:0x0].0x32d22ff1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.354906:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c6ff94 lrc: 0/0,0 mode: --/CW res: [0x200000408:0x95:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f249 expref: 75 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.354917:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000c937f2b9/0xa5e9c8c58c6ffa9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x333:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f249 expref: 74 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.354925:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x333:0x0].0x0 (000000009dcfc2b9) 00010000:00010000:2.0:1772305933.354927:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1772305933.354929:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c937f2b9, rc 0) 00000100:00100000:2.0:1772305933.354967:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007776dfe8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+75:99907:x1858396225406848:12345-192.168.203.30@tcp:101:dd.0 Request processed in 2653us (2762us total) trans 8589934973 rc 0/0 00000100:00100000:2.0:1772305933.354976:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1149 00010000:00010000:3.0:1772305933.355384:0:2978:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6ffa2 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x95:0x0].0x32d22ff1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305933.355393:0:2978:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6ffa2 lrc: 2/0,0 mode: PW/PW res: [0x200000408:0x95:0x0].0x32d22ff1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305933.355398:0:2978:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6ffa2 lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x95:0x0].0x32d22ff1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305933.355402:0:2978:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000010dea6ba already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305933.355404:0:2978:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6ffa2 lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x95:0x0].0x32d22ff1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305933.355407:0:2978:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6ffa2 lrc: 4/0,0 mode: PW/PW res: [0x200000408:0x95:0x0].0x32d22ff1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305933.355421:0:2978:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0x32d22ff1 (000000008fd1be63) 00010000:00010000:3.0:1772305933.355423:0:2978:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305933.355425:0:2978:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6ffa2 lrc: 2/0,0 mode: --/PW res: [0x200000408:0x95:0x0].0x32d22ff1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305933.355428:0:2978:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c6ffa2 lrc: 0/0,0 mode: --/PW res: [0x200000408:0x95:0x0].0x32d22ff1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305933.355877:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305933.355902:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225407040 00000100:00100000:3.0:1772305933.355960:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 151 00000100:00100000:3.0:1772305933.355964:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000000e66835 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+74:99907:x1858396225407040:12345-192.168.203.30@tcp:35:dd.0 00000100:00100000:3.0:1772305933.356094:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000000e66835 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+75:99907:x1858396225407040:12345-192.168.203.30@tcp:35:dd.0 Request processed in 129us (217us total) trans 8589934974 rc 0/0 00000100:00100000:3.0:1772305933.356100:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 151 00000100:00100000:1.0:1772305933.375554:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305933.375616:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225407104 00000100:00100000:2.0:1772305933.375685:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1150 00000100:00100000:2.0:1772305933.375694:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ab509801 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+75:99913:x1858396225407104:12345-192.168.203.30@tcp:101:mkdir.0 00010000:00010000:2.0:1772305933.375715:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305933.375731:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c6ffb7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f250 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.375781:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6ffbe lrc: 3/1,0 mode: --/PR res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.375795:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6ffbe lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.375806:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6ffbe lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1772305933.375849:0:54697:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000408:0x95:0x0]: returning size 11776 00000004:00200000:2.0:1772305933.375853:0:54697:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 5 stripe count 1 MDT count 1 00000004:00010000:2.0:1772305933.375872:0:54697:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6ffbe lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.375895:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c6ffb7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f250 expref: 77 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.375909:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6ffbe lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f250 expref: 76 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.375918:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0x0 (00000000fbf66531) 00010000:00010000:2.0:1772305933.375921:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1772305933.375924:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006c757b88, rc 0) 00000100:00100000:2.0:1772305933.375970:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ab509801 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+76:99913:x1858396225407104:12345-192.168.203.30@tcp:101:mkdir.0 Request processed in 277us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305933.375979:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1150 00000100:00100000:0.0:1772305933.379951:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305933.379993:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225407168 00000100:00100000:2.0:1772305933.380027:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1151 00000100:00100000:2.0:1772305933.380032:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000848c45a9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+76:99914:x1858396225407168:12345-192.168.203.30@tcp:101:rm.0 00010000:00010000:2.0:1772305933.380043:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305933.380054:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c6ffc5 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f257 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.380085:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000f8380462/0xa5e9c8c58c6ffcc lrc: 3/1,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.380095:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f8380462/0xa5e9c8c58c6ffcc lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.380104:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f8380462/0xa5e9c8c58c6ffcc lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.380118:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c6ffd3 lrc: 3/1,0 mode: --/PR res: [0x200000408:0x95:0x0].0xc9aa4189 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.380125:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c6ffd3 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0xc9aa4189 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.380132:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c6ffd3 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0xc9aa4189 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.380174:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000f8380462/0xa5e9c8c58c6ffcc lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.380182:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f8380462/0xa5e9c8c58c6ffcc lrc: 2/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.380190:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f8380462/0xa5e9c8c58c6ffcc lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.380197:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f8380462 already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305933.380200:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f8380462/0xa5e9c8c58c6ffcc lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.380208:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f8380462/0xa5e9c8c58c6ffcc lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.380218:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0x0 (00000000fbf66531) 00010000:00010000:2.0:1772305933.380221:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305933.380223:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f8380462/0xa5e9c8c58c6ffcc lrc: 2/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.380230:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f8380462/0xa5e9c8c58c6ffcc lrc: 0/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.380240:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c6ffd3 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0xc9aa4189 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.380246:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c6ffd3 lrc: 2/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0xc9aa4189 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.380252:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c6ffd3 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0xc9aa4189 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.380258:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e5e5320a already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305933.380260:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c6ffd3 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0xc9aa4189 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.380266:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c6ffd3 lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0xc9aa4189 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.380274:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0xc9aa4189 (00000000228cb01d) 00010000:00010000:2.0:1772305933.380277:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305933.380279:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c6ffd3 lrc: 2/0,0 mode: --/PR res: [0x200000408:0x95:0x0].0xc9aa4189 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.380285:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c6ffd3 lrc: 0/0,0 mode: --/PR res: [0x200000408:0x95:0x0].0xc9aa4189 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.380307:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c6ffc5 lrc: 1/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f257 expref: 77 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.380316:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c6ffc5 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f257 expref: 77 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.380324:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000089dbe966, rc 0) 00000100:00100000:2.0:1772305933.380372:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000848c45a9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+76:99914:x1858396225407168:12345-192.168.203.30@tcp:101:rm.0 Request processed in 339us (422us total) trans 0 rc 301/301 00000100:00100000:2.0:1772305933.380388:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1151 00000100:00100000:1.0:1772305933.384663:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305933.384699:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225407296 00000100:00100000:2.0:1772305933.384732:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1152 00000100:00100000:2.0:1772305933.384738:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b07205c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+76:99915:x1858396225407296:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:2.0:1772305933.384748:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305933.384751:0:54697:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1772305933.384764:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c6ffbe lrc: 0/0,0 mode: --/PR res: [0x200000408:0x95:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f250 expref: 76 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.384777:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0x0 (00000000fbf66531) 00010000:00010000:2.0:1772305933.384781:0:54697:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1772305933.384788:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c6ffda lrc: 2/0,0 mode: --/CW res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f25e expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.384848:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c6ffe1 lrc: 3/0,1 mode: --/CW res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.384859:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c6ffe1 lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.384867:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c6ffe1 lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.384880:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c6ffe8 lrc: 3/0,1 mode: --/PW res: [0x200000408:0x95:0x0].0xc9aa4189 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.384887:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c6ffe8 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x95:0x0].0xc9aa4189 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.384894:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c6ffe8 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x95:0x0].0xc9aa4189 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1772305933.385183:0:54697:0:(osp_object.c:1645:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x100000000:0x1b4:0x0], index 0: 0 00010000:00010000:2.0:1772305933.385315:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000fd78dae3/0xa5e9c8c58c6ffef lrc: 3/1,0 mode: --/CR res: [0x200000402:0x334:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.385326:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000fd78dae3/0xa5e9c8c58c6ffef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x334:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.385349:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000fd78dae3/0xa5e9c8c58c6ffef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x334:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.385386:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c6ffe1 lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.385394:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c6ffe1 lrc: 2/0,0 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.385401:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c6ffe1 lrc: 3/0,0 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.385408:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000007129515 already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305933.385411:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c6ffe1 lrc: 3/0,0 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.385417:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c6ffe1 lrc: 4/0,0 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.385426:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0x0 (00000000fbf66531) 00010000:00010000:2.0:1772305933.385429:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305933.385431:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c6ffe1 lrc: 2/0,0 mode: --/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.385437:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c6ffe1 lrc: 0/0,0 mode: --/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1772305933.385447:0:54697:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000b07205c9 reply state 0000000089575199 transno 8589934975 ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c6ffe8 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x95:0x0].0xc9aa4189 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.385468:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c6ffda lrc: 0/0,0 mode: --/CW res: [0x200000408:0x95:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f25e expref: 78 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.385485:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000fd78dae3/0xa5e9c8c58c6ffef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x334:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f25e expref: 77 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.385493:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x334:0x0].0x0 (00000000581d6dd7) 00010000:00010000:2.0:1772305933.385495:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1772305933.385497:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fd78dae3, rc 0) 00000100:00100000:2.0:1772305933.385535:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b07205c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+78:99915:x1858396225407296:12345-192.168.203.30@tcp:101:dd.0 Request processed in 797us (873us total) trans 8589934975 rc 0/0 00000100:00100000:2.0:1772305933.385543:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1152 00010000:00010000:2.0:1772305933.386123:0:2977:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c6ffe8 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x95:0x0].0xc9aa4189 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.386133:0:2977:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c6ffe8 lrc: 2/0,0 mode: PW/PW res: [0x200000408:0x95:0x0].0xc9aa4189 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.386141:0:2977:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c6ffe8 lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x95:0x0].0xc9aa4189 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.386147:0:2977:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000001967872f already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305933.386150:0:2977:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c6ffe8 lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x95:0x0].0xc9aa4189 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.386156:0:2977:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c6ffe8 lrc: 4/0,0 mode: PW/PW res: [0x200000408:0x95:0x0].0xc9aa4189 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.386165:0:2977:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0xc9aa4189 (000000008fd1be63) 00010000:00010000:2.0:1772305933.386168:0:2977:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305933.386171:0:2977:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c6ffe8 lrc: 2/0,0 mode: --/PW res: [0x200000408:0x95:0x0].0xc9aa4189 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.386177:0:2977:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c6ffe8 lrc: 0/0,0 mode: --/PW res: [0x200000408:0x95:0x0].0xc9aa4189 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305933.386533:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305933.386606:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225407424 00000100:00100000:3.0:1772305933.386649:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 152 00000100:00100000:3.0:1772305933.386657:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000051e590c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+77:99915:x1858396225407424:12345-192.168.203.30@tcp:35:dd.0 00000100:00100000:3.0:1772305933.386808:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000051e590c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+78:99915:x1858396225407424:12345-192.168.203.30@tcp:35:dd.0 Request processed in 153us (277us total) trans 8589934976 rc 0/0 00000100:00100000:3.0:1772305933.386819:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 152 00000100:00100000:1.0:1772305933.399123:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305933.399194:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225407488 00000100:00100000:2.0:1772305933.399235:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1153 00000100:00100000:2.0:1772305933.399244:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b1d66a61 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+64:99918:x1858396225407488:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1772305933.399262:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305933.399278:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c6fffd lrc: 2/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f265 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.399323:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c70004 lrc: 3/1,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.399350:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c70004 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.399362:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c70004 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.399376:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c7000b lrc: 3/1,0 mode: --/PR res: [0x200000408:0x95:0x0].0x32d22ff1 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.399384:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c7000b lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x32d22ff1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.399391:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c7000b lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x32d22ff1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.399474:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c70012 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x333:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.399484:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c70012 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x333:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.399492:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c70012 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x333:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1772305933.399516:0:54697:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x333:0x0]: returning size 0 00000004:00200000:2.0:1772305933.399520:0:54697:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1772305933.399532:0:54697:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c70012 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x333:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.399543:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c70012 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x333:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.399550:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c70004 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.399557:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c70004 lrc: 2/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.399565:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c70004 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.399572:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f20d88bd already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305933.399575:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c70004 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.399587:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c70004 lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.399598:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0x0 (00000000fbf66531) 00010000:00010000:2.0:1772305933.399601:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305933.399605:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c70004 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.399612:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c70004 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.399622:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c7000b lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x32d22ff1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.399665:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c7000b lrc: 2/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x32d22ff1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.399672:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c7000b lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x32d22ff1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.399679:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000007129515 already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305933.399681:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c7000b lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x32d22ff1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.399689:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c7000b lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x32d22ff1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.399698:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0x32d22ff1 (000000008fd1be63) 00010000:00010000:2.0:1772305933.399701:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305933.399704:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c7000b lrc: 2/0,0 mode: --/PR res: [0x200000408:0x95:0x0].0x32d22ff1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.399711:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c7000b lrc: 0/0,0 mode: --/PR res: [0x200000408:0x95:0x0].0x32d22ff1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.399737:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c6fffd lrc: 0/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f265 expref: 66 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.399750:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000006c757b88/0xa5e9c8c58c70012 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x333:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f265 expref: 65 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.399757:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x333:0x0].0x0 (000000009dcfc2b9) 00010000:00010000:2.0:1772305933.399760:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1772305933.399762:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006c757b88, rc 0) 00000100:00100000:2.0:1772305933.399804:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b1d66a61 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+65:99918:x1858396225407488:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 562us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305933.399813:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1153 00000100:00100000:0.0:1772305933.401068:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305933.401117:0:48470:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225407552 00000100:00100000:3.0:1772305933.401153:0:48470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5771 00000100:00100000:3.0:1772305933.401159:0:48470:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d0ab861f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f935b4d0-e17f-49c8-8011-4be99ba75430+140:2216:x1858396225407552:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1772305933.401170:0:48470:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305933.401199:0:48470:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000403929b5/0xa5e9c8c58c70019 lrc: 2/0,0 mode: --/PR res: [0x1b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f26c expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1772305933.401220:0:48470:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x1b4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1772305933.401230:0:48470:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1772305933.401232:0:48470:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1772305933.401237:0:48470:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000403929b5/0xa5e9c8c58c70019 lrc: 3/0,0 mode: PR/PR res: [0x1b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f26c expref: 141 pid: 48470 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1772305933.401246:0:48470:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000403929b5/0xa5e9c8c58c70019 lrc: 3/0,0 mode: PR/PR res: [0x1b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f26c expref: 141 pid: 48470 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1772305933.401254:0:48470:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000403929b5, rc 0) 00000100:00100000:3.0:1772305933.401281:0:48470:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d0ab861f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f935b4d0-e17f-49c8-8011-4be99ba75430+141:2216:x1858396225407552:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 123us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305933.401286:0:48470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5771 00000100:00100000:1.0:1772305933.402312:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305933.402363:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225407616 00000100:00100000:2.0:1772305933.402394:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1154 00000100:00100000:2.0:1772305933.402400:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a1cffce8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+65:99918:x1858396225407616:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1772305933.402410:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305933.402419:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c70020 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f273 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.402446:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c70027 lrc: 3/1,0 mode: --/PR res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.402456:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c70027 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.402465:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c70027 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1772305933.402491:0:54697:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000408:0x95:0x0]: returning size 11776 00000004:00200000:2.0:1772305933.402494:0:54697:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 6 stripe count 1 MDT count 1 00000004:00010000:2.0:1772305933.402507:0:54697:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c70027 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.402524:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c70020 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f273 expref: 67 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.402536:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c70027 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f273 expref: 66 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.402544:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0x0 (00000000fbf66531) 00010000:00010000:2.0:1772305933.402547:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1772305933.402549:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e5e5320a, rc 0) 00000100:00100000:2.0:1772305933.402580:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a1cffce8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+66:99918:x1858396225407616:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 179us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305933.402588:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1154 00000100:00100000:1.0:1772305933.404219:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305933.404264:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225407744 00000100:00100000:2.0:1772305933.404294:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1155 00000100:00100000:2.0:1772305933.404300:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ad79fcd8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+66:99918:x1858396225407744:12345-192.168.203.30@tcp:58:lfs.0 00000040:00080000:2.0:1772305933.404453:0:54697:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xf:0x0].44, 136 off14176 00000100:00100000:2.0:1772305933.404496:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ad79fcd8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+66:99918:x1858396225407744:12345-192.168.203.30@tcp:58:lfs.0 Request processed in 197us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305933.404502:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1155 00000040:00080000:3.0:1772305933.577753:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305933.577758:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305933.577797:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 45 count 17 00000040:00080000:3.0:1772305933.577803:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:3.0:1772305933.577983:0:54732:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011939cae pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:54732:1858396216610880:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1772305933.578051:0:54732:0:(client.c:2500:ptlrpc_set_wait()) set 0000000018c79529 going to sleep for 6 seconds 00000100:00100000:3.0:1772305933.579295:0:54732:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011939cae pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:54732:1858396216610880:192.168.203.30@tcp:107:hsm_cdtr.0 00000040:00080000:3.0:1772305933.579364:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305933.579366:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305933.579426:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 45 count 17 00000040:00080000:3.0:1772305933.579430:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:0.0:1772305933.579760:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305933.579803:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225407808 00000100:00100000:2.0:1772305933.579850:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1156 00000100:00100000:2.0:1772305933.579857:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000060c5d597 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+78:99928:x1858396225407808:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1772305933.579885:0:54697:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x333:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1772305933.579945:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000060c5d597 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+78:99928:x1858396225407808:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 89us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305933.579952:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1156 00000100:00100000:3.0:1772305933.581181:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305933.581235:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225407936 00000100:00100000:2.0:1772305933.581266:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1157 00000100:00100000:2.0:1772305933.581271:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000011939cae pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+78:99928:x1858396225407936:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1772305933.581282:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305933.581303:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c7002e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f27a expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.581379:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c70035 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.581392:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c70035 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.581401:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c70035 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.581462:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c7003c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xe1fa8a37 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.581471:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c7003c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xe1fa8a37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.581484:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c7003c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xe1fa8a37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.581530:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c70043 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x333:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.581538:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c70043 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x333:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.581543:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c70043 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x333:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1772305933.581550:0:54697:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x333:0x0]: returning size 0 00010000:00010000:2.0:1772305933.581659:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c70035 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.581665:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c70035 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.581670:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c70035 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.581675:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000001967872f already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305933.581678:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c70035 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.581683:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c70035 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.581692:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (00000000c78481f6) 00010000:00010000:2.0:1772305933.581694:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305933.581697:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c70035 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.581702:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c70035 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.581710:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c7003c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xe1fa8a37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.581714:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c7003c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xe1fa8a37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.581718:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c7003c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xe1fa8a37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.581722:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000007129515 already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305933.581723:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c7003c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xe1fa8a37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.581726:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c7003c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xe1fa8a37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.581730:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xe1fa8a37 (000000008fd1be63) 00010000:00010000:2.0:1772305933.581732:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305933.581733:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c7003c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xe1fa8a37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.581736:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c7003c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xe1fa8a37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.581768:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c7002e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f27a expref: 81 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.581780:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c70043 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x333:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f27a expref: 80 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.581785:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x333:0x0].0x0 (000000009dcfc2b9) 00010000:00010000:2.0:1772305933.581786:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1772305933.581788:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f20d88bd, rc 0) 00000100:00100000:2.0:1772305933.581816:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000011939cae pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+80:99928:x1858396225407936:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 546us (637us total) trans 8589934977 rc 0/0 00000100:00100000:2.0:1772305933.581822:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1157 00000100:00100000:0.0:1772305933.583114:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305933.583149:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305933.583152:0:5494:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225408000 00000100:00100000:1.0:1772305933.583193:0:5494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1051 00000100:00100000:3.0:1772305933.583199:0:48470:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225408064 00000100:00100000:1.0:1772305933.583199:0:5494:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000247170f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+80:2216:x1858396225408000:12345-192.168.203.30@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1772305933.583209:0:5494:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1772305933.583222:0:5494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c70043 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x333:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f27a expref: 80 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.583233:0:5494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x333:0x0].0x0 (000000009dcfc2b9) 00010000:00010000:1.0:1772305933.583236:0:5494:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1772305933.583242:0:48470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5772 00000100:00100000:3.0:1772305933.583249:0:48470:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6e261 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2215:x1858396225408064:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 00000100:00100000:1.0:1772305933.583269:0:5494:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000247170f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+79:2216:x1858396225408000:12345-192.168.203.30@tcp:103:ldlm_bl_01.0 Request processed in 68us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305933.583275:0:5494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1051 00010000:00010000:3.0:1772305933.583276:0:48470:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000051c27e8b/0xa5e9c8c58c70051 lrc: 3/1,0 mode: --/PR res: [0x1b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305933.583287:0:48470:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1772305933.583289:0:48470:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1772305933.583294:0:48470:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051c27e8b/0xa5e9c8c58c70051 lrc: 3/1,0 mode: PR/PR res: [0x1b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305933.583303:0:48470:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051c27e8b/0xa5e9c8c58c70051 lrc: 3/1,0 mode: PR/PR res: [0x1b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305933.583319:0:48470:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000051c27e8b/0xa5e9c8c58c70051 lrc: 3/1,0 mode: PR/PR res: [0x1b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305933.583324:0:48470:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051c27e8b/0xa5e9c8c58c70051 lrc: 2/0,0 mode: PR/PR res: [0x1b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305933.583351:0:48470:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1772305933.583371:0:38581:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1772305933.583375:0:38581:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051c27e8b/0xa5e9c8c58c70051 lrc: 2/0,0 mode: PR/PR res: [0x1b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.583382:0:38581:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000051c27e8b already unused, calling callback (00000000b5e4f3c0) 00010000:00010000:1.0:1772305933.583384:0:38581:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051c27e8b/0xa5e9c8c58c70051 lrc: 2/0,0 mode: PR/PR res: [0x1b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.583389:0:38581:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051c27e8b/0xa5e9c8c58c70051 lrc: 3/0,0 mode: PR/PR res: [0x1b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.583399:0:38581:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051c27e8b/0xa5e9c8c58c70051 lrc: 1/0,0 mode: --/PR res: [0x1b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.583403:0:38581:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051c27e8b/0xa5e9c8c58c70051 lrc: 0/0,0 mode: --/PR res: [0x1b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.583412:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1772305933.583413:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1772305933.583415:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1772305933.583422:0:48470:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6e261 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2215:x1858396225408064:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 Request processed in 172us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305933.583432:0:48470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5772 00000100:00100000:3.0:1772305933.584185:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305933.584216:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225408192 00000100:00100000:1.0:1772305933.584244:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1158 00000100:00100000:1.0:1772305933.584249:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000039b4b25e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+79:99928:x1858396225408192:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1772305933.584300:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000039b4b25e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+79:99928:x1858396225408192:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 51us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305933.584305:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1158 00000100:00100000:0.0:1772305933.585344:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305933.585376:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225408256 00000100:00100000:1.0:1772305933.585403:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1159 00000100:00100000:1.0:1772305933.585406:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002c77b239 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+79:99928:x1858396225408256:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1772305933.585413:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305933.585421:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ee5a0681/0xa5e9c8c58c70058 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f281 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.585448:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c7005f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x333:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.585455:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c7005f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x333:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.585461:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c7005f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x333:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1772305933.585476:0:54697:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x333:0x0]: returning size 0 00000004:00200000:1.0:1772305933.585479:0:54697:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1772305933.585493:0:54697:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c7005f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x333:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.585500:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c7005f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x333:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.585514:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ee5a0681/0xa5e9c8c58c70058 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f281 expref: 81 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.585522:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000748ac5ea/0xa5e9c8c58c7005f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x333:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f281 expref: 80 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.585527:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x333:0x0].0x0 (000000009dcfc2b9) 00010000:00010000:1.0:1772305933.585529:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1772305933.585530:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000748ac5ea, rc 0) 00000100:00100000:1.0:1772305933.585556:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002c77b239 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+80:99928:x1858396225408256:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 149us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305933.585561:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1159 00000100:00100000:2.0:1772305933.586483:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305933.586528:0:48470:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225408320 00000100:00100000:0.0:1772305933.586559:0:48470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5773 00000100:00100000:0.0:1772305933.586565:0:48470:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f5fe1428 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2215:x1858396225408320:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1772305933.586572:0:48470:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305933.586583:0:48470:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e08f961/0xa5e9c8c58c70066 lrc: 2/0,0 mode: --/PR res: [0x1b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f288 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305933.586596:0:48470:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305933.586598:0:48470:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305933.586602:0:48470:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e08f961/0xa5e9c8c58c70066 lrc: 3/0,0 mode: PR/PR res: [0x1b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f288 expref: 228 pid: 48470 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1772305933.586612:0:48470:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006e08f961/0xa5e9c8c58c70066 lrc: 3/0,0 mode: PR/PR res: [0x1b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f288 expref: 228 pid: 48470 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1772305933.586619:0:48470:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006e08f961, rc 0) 00000100:00100000:0.0:1772305933.586700:0:48470:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f5fe1428 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:370cd859-ca07-4cc9-a865-ed970d9eaddd+228:2215:x1858396225408320:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 135us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305933.586708:0:48470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5773 00000100:00100000:2.0:1772305933.587608:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305933.587663:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225408448 00000100:00100000:3.0:1772305933.587692:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1160 00000100:00100000:3.0:1772305933.587698:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000854ab26d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+80:99928:x1858396225408448:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1772305933.587779:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000854ab26d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+80:99928:x1858396225408448:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 81us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305933.587785:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1160 00000100:00100000:1.0:1772305933.588716:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305933.588738:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225408512 00000100:00100000:3.0:1772305933.588762:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1161 00000100:00100000:3.0:1772305933.588766:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d8a50734 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+80:99928:x1858396225408512:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1772305933.588773:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305933.588779:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000094970864/0xa5e9c8c58c7006d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x333:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f28f expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305933.588793:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000a5c1895c/0xa5e9c8c58c70074 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x333:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305933.588799:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a5c1895c/0xa5e9c8c58c70074 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x333:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305933.588804:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a5c1895c/0xa5e9c8c58c70074 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x333:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305933.588850:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000094970864/0xa5e9c8c58c7006d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x333:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f28f expref: 82 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305933.588858:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000a5c1895c/0xa5e9c8c58c70074 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x333:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f28f expref: 81 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305933.588863:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x333:0x0].0x0 (000000009dcfc2b9) 00010000:00010000:3.0:1772305933.588865:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1772305933.588870:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5c1895c, rc 0) 00000100:00100000:3.0:1772305933.588895:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d8a50734 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+81:99928:x1858396225408512:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 129us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305933.588900:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1161 00000100:00100000:2.0:1772305933.590026:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305933.590101:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225408576 00000100:00100000:3.0:1772305933.590128:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1162 00000100:00100000:3.0:1772305933.590133:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b896dfee pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+81:99928:x1858396225408576:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1772305933.590149:0:54697:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x333:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1772305933.590204:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b896dfee pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+81:99928:x1858396225408576:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 69us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305933.590209:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1162 00000100:00100000:2.0:1772305933.590957:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305933.591007:0:48470:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225408640 00000100:00100000:0.0:1772305933.591034:0:48470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5774 00000100:00100000:0.0:1772305933.591039:0:48470:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000093b46947 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:370cd859-ca07-4cc9-a865-ed970d9eaddd+228:2216:x1858396225408640:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1772305933.591056:0:48470:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000870ce7f2/0xa5e9c8c58c7007b lrc: 3/1,0 mode: --/PR res: [0x1b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305933.591063:0:48470:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305933.591065:0:48470:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305933.591068:0:48470:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000870ce7f2/0xa5e9c8c58c7007b lrc: 3/1,0 mode: PR/PR res: [0x1b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305933.591074:0:48470:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000870ce7f2/0xa5e9c8c58c7007b lrc: 3/1,0 mode: PR/PR res: [0x1b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305933.591090:0:48470:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000870ce7f2/0xa5e9c8c58c7007b lrc: 3/1,0 mode: PR/PR res: [0x1b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305933.591095:0:48470:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000870ce7f2/0xa5e9c8c58c7007b lrc: 2/0,0 mode: PR/PR res: [0x1b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305933.591111:0:48470:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1772305933.591137:0:5497:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1772305933.591141:0:48470:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000093b46947 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:370cd859-ca07-4cc9-a865-ed970d9eaddd+228:2216:x1858396225408640:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 Request processed in 101us (184us total) trans 0 rc 0/0 00010000:00010000:2.0:1772305933.591143:0:5497:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000870ce7f2/0xa5e9c8c58c7007b lrc: 2/0,0 mode: PR/PR res: [0x1b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305933.591152:0:48470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5774 00010000:00010000:2.0:1772305933.591162:0:5497:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000870ce7f2 already unused, calling callback (00000000b5e4f3c0) 00010000:00010000:2.0:1772305933.591167:0:5497:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000870ce7f2/0xa5e9c8c58c7007b lrc: 2/0,0 mode: PR/PR res: [0x1b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.591176:0:5497:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000870ce7f2/0xa5e9c8c58c7007b lrc: 3/0,0 mode: PR/PR res: [0x1b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.591195:0:5497:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000870ce7f2/0xa5e9c8c58c7007b lrc: 1/0,0 mode: --/PR res: [0x1b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.591203:0:5497:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000870ce7f2/0xa5e9c8c58c7007b lrc: 0/0,0 mode: --/PR res: [0x1b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305933.591213:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1772305933.591214:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1772305933.591215:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772305933.591784:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305933.591812:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225408768 00000100:00100000:3.0:1772305933.591849:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1163 00000100:00100000:3.0:1772305933.591856:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005905500f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+81:99928:x1858396225408768:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000040:00080000:3.0:1772305933.592085:0:54697:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305933.592088:0:54697:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305933.592154:0:54697:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 45 count 17 00000040:00080000:3.0:1772305933.592161:0:54697:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:3.0:1772305933.592224:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005905500f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+82:99928:x1858396225408768:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 367us (439us total) trans 8589934978 rc 0/0 00000100:00100000:3.0:1772305933.592235:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1163 00000040:00080000:1.0:1772305933.592251:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305933.592254:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305933.592718:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 17 00000040:00080000:1.0:1772305933.592727:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:3.0:1772305933.592853:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305933.592897:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225408896 00000100:00100000:0.0:1772305933.592925:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 153 00000100:00100000:0.0:1772305933.592929:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000004f8c4bb pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+82:99928:x1858396225408896:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1772305933.593059:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000004f8c4bb pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+83:99928:x1858396225408896:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 128us (208us total) trans 8589934979 rc 0/0 00000100:00100000:0.0:1772305933.593066:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 153 00000040:00080000:2.0:1772305933.679915:0:71230:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305933.679920:0:71230:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305933.679981:0:71230:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 45 count 17 00000040:00080000:2.0:1772305933.679985:0:71230:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:3.0:1772305933.697789:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305933.697849:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225408960 00000100:00100000:1.0:1772305933.697914:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1164 00000100:00100000:1.0:1772305933.697923:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f7fa0064 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+66:99929:x1858396225408960:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1772305933.697945:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305933.697965:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ee5a0681/0xa5e9c8c58c70082 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f296 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.698018:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c70089 lrc: 3/1,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.698031:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c70089 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.698040:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c70089 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.698051:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c70090 lrc: 3/1,0 mode: --/PR res: [0x200000408:0x95:0x0].0xc9aa4189 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.698056:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c70090 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0xc9aa4189 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.698061:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c70090 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0xc9aa4189 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.698157:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c70097 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x334:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.698163:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c70097 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x334:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.698167:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c70097 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x334:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1772305933.698193:0:54697:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x334:0x0]: returning size 0 00000004:00200000:1.0:1772305933.698196:0:54697:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1772305933.698209:0:54697:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c70097 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x334:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.698216:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c70097 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x334:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.698222:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c70089 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.698227:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c70089 lrc: 2/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.698232:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c70089 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.698235:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a178fe80 already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305933.698238:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c70089 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.698243:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c70089 lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.698252:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0x0 (00000000fbf66531) 00010000:00010000:1.0:1772305933.698255:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305933.698258:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c70089 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.698263:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c70089 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.698270:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c70090 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0xc9aa4189 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.698274:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c70090 lrc: 2/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0xc9aa4189 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.698281:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c70090 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0xc9aa4189 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.698285:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000025cc37fd already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305933.698287:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c70090 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0xc9aa4189 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.698291:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c70090 lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0xc9aa4189 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.698297:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0xc9aa4189 (00000000c75acf1a) 00010000:00010000:1.0:1772305933.698300:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305933.698301:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c70090 lrc: 2/0,0 mode: --/PR res: [0x200000408:0x95:0x0].0xc9aa4189 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.698307:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c70090 lrc: 0/0,0 mode: --/PR res: [0x200000408:0x95:0x0].0xc9aa4189 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.698358:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ee5a0681/0xa5e9c8c58c70082 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f296 expref: 68 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.698373:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000776565ed/0xa5e9c8c58c70097 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x334:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f296 expref: 67 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305933.698381:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x334:0x0].0x0 (00000000581d6dd7) 00010000:00010000:1.0:1772305933.698383:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1772305933.698385:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000776565ed, rc 0) 00000100:00100000:1.0:1772305933.698434:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f7fa0064 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+67:99929:x1858396225408960:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 512us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305933.698441:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1164 00000100:00100000:0.0:1772305933.699771:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305933.699819:0:48470:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225409024 00000100:00100000:1.0:1772305933.699861:0:48470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5775 00000100:00100000:1.0:1772305933.699867:0:48470:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ea7c71cc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f935b4d0-e17f-49c8-8011-4be99ba75430+162:2215:x1858396225409024:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1772305933.699877:0:48470:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305933.699894:0:48470:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c7009e lrc: 2/0,0 mode: --/PR res: [0x1b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f29d expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1772305933.699912:0:48470:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x1b4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1772305933.699923:0:48470:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305933.699925:0:48470:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305933.699930:0:48470:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c7009e lrc: 3/0,0 mode: PR/PR res: [0x1b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f29d expref: 163 pid: 48470 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1772305933.699940:0:48470:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004a9f3864/0xa5e9c8c58c7009e lrc: 3/0,0 mode: PR/PR res: [0x1b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f29d expref: 163 pid: 48470 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1772305933.699948:0:48470:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004a9f3864, rc 0) 00000100:00100000:1.0:1772305933.699982:0:48470:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ea7c71cc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f935b4d0-e17f-49c8-8011-4be99ba75430+163:2215:x1858396225409024:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 114us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305933.699990:0:48470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5775 00000100:00100000:3.0:1772305933.702369:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305933.702417:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225409152 00000100:00100000:1.0:1772305933.702449:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1165 00000100:00100000:1.0:1772305933.702456:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000773e607e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+67:99929:x1858396225409152:12345-192.168.203.30@tcp:58:lfs.0 00000040:00080000:1.0:1772305933.702656:0:54697:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xf:0x0].45, 136 off14312 00000100:00100000:1.0:1772305933.702724:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000773e607e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+67:99929:x1858396225409152:12345-192.168.203.30@tcp:58:lfs.0 Request processed in 267us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305933.702736:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1165 00000040:00080000:1.0:1772305933.979785:0:71281:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305933.979790:0:71281:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305933.979851:0:71281:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 46 count 18 00000040:00080000:1.0:1772305933.979856:0:71281:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:2.0:1772305934.024967:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1772305934.403895:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305934.403936:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305934.403980:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225409216 00000100:00100000:3.0:1772305934.403987:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305934.404015:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225409280 00000100:00100000:3.0:1772305934.404027:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305934.404054:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 150 00000100:00100000:2.0:1772305934.404055:0:48470:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225409408 00000100:00100000:1.0:1772305934.404063:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 163 00000100:00100000:0.0:1772305934.404068:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002ae2fbd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2215:x1858396225409216:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1772305934.404073:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305934.404076:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b36dba7e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+83:2216:x1858396225409280:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1772305934.404098:0:48470:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225409344 00000100:00100000:2.0:1772305934.404121:0:48470:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225409536 00000100:00100000:2.0:1772305934.404137:0:48470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1194 00000100:00100000:1.0:1772305934.404148:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b36dba7e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+83:2216:x1858396225409280:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 69us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305934.404150:0:48470:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f842a169 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:370cd859-ca07-4cc9-a865-ed970d9eaddd+228:2216:x1858396225409408:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:0.0:1772305934.404152:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002ae2fbd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2215:x1858396225409216:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 81us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305934.404155:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305934.404165:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 163 00000100:00100000:0.0:1772305934.404169:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 150 00000100:00100000:2.0:1772305934.404190:0:48470:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f842a169 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:370cd859-ca07-4cc9-a865-ed970d9eaddd+228:2216:x1858396225409408:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 46us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305934.404193:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225409472 00000100:00100000:2.0:1772305934.404199:0:48470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1194 00000100:00100000:0.0:1772305934.404222:0:18149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1195 00000100:00100000:1.0:1772305934.404227:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 164 00000100:00100000:0.0:1772305934.404235:0:18149:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d4d8044c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+224:2215:x1858396225409344:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1772305934.404236:0:48470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1196 00000100:00100000:1.0:1772305934.404238:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000084809c1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2215:x1858396225409472:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1772305934.404247:0:48470:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000af091ea6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f935b4d0-e17f-49c8-8011-4be99ba75430+163:2216:x1858396225409536:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1772305934.404257:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305934.404282:0:18149:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d4d8044c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+224:2215:x1858396225409344:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 50us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305934.404285:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000084809c1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2215:x1858396225409472:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 50us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305934.404291:0:48470:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000af091ea6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f935b4d0-e17f-49c8-8011-4be99ba75430+163:2216:x1858396225409536:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 42us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305934.404306:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 164 00000100:00100000:0.0:1772305934.404313:0:18149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1195 00000100:00100000:2.0:1772305934.404336:0:48470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1196 00000100:00100000:0.0:1772305934.404353:0:18149:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225409600 00000100:00100000:2.0:1772305934.404388:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1197 00000100:00100000:2.0:1772305934.404394:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009e8df762 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+141:2215:x1858396225409600:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1772305934.404432:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009e8df762 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+141:2215:x1858396225409600:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 37us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305934.404440:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1197 00000040:00080000:1.0:1772305934.600856:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305934.600864:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305934.600917:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 46 count 18 00000040:00080000:1.0:1772305934.600925:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:1.0:1772305934.601147:0:54732:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000c8c6a39 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:54732:1858396216610944:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1772305934.601228:0:54732:0:(client.c:2500:ptlrpc_set_wait()) set 000000007feb9551 going to sleep for 6 seconds 00000100:00100000:1.0:1772305934.602468:0:54732:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000c8c6a39 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:54732:1858396216610944:192.168.203.30@tcp:107:hsm_cdtr.0 00000040:00080000:1.0:1772305934.602529:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305934.602533:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305934.602599:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 46 count 18 00000040:00080000:1.0:1772305934.602604:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:1.0:1772305934.602880:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305934.602939:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225409664 00000100:00100000:0.0:1772305934.602987:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1166 00000100:00100000:0.0:1772305934.602995:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000c8c6a39 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+83:99940:x1858396225409664:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1772305934.603023:0:55653:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x334:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1772305934.603089:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000c8c6a39 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+83:99940:x1858396225409664:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 94us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305934.603095:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1166 00000100:00100000:3.0:1772305934.604120:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305934.604196:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225409792 00000100:00100000:0.0:1772305934.604224:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1167 00000100:00100000:0.0:1772305934.604228:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000933c070b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+83:99940:x1858396225409792:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1772305934.604237:0:55653:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305934.604254:0:55653:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c700a5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f2a4 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305934.604299:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c700ac lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305934.604311:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c700ac lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305934.604334:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c700ac lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305934.604394:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c700b3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4e07b0c3 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305934.604400:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c700b3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4e07b0c3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305934.604405:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c700b3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4e07b0c3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305934.604440:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c700ba lrc: 3/1,0 mode: --/CR res: [0x200000402:0x334:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305934.604446:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c700ba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x334:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305934.604450:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c700ba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x334:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305934.604456:0:55653:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x334:0x0]: returning size 0 00010000:00010000:0.0:1772305934.604514:0:55653:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c700ac lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305934.604520:0:55653:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c700ac lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305934.604524:0:55653:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c700ac lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305934.604528:0:55653:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000870ce7f2 already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305934.604531:0:55653:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c700ac lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305934.604536:0:55653:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c700ac lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305934.604544:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (00000000c78481f6) 00010000:00010000:0.0:1772305934.604546:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305934.604549:0:55653:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c700ac lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305934.604553:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c700ac lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305934.604562:0:55653:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c700b3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4e07b0c3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305934.604565:0:55653:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c700b3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4e07b0c3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305934.604569:0:55653:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c700b3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4e07b0c3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305934.604572:0:55653:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c7dfb548 already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305934.604573:0:55653:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c700b3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4e07b0c3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305934.604576:0:55653:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c700b3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4e07b0c3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305934.604580:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4e07b0c3 (00000000322bd48e) 00010000:00010000:0.0:1772305934.604581:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305934.604582:0:55653:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c700b3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4e07b0c3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305934.604586:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c7dfb548/0xa5e9c8c58c700b3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4e07b0c3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305934.604606:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c700a5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f2a4 expref: 86 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305934.604613:0:55653:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c700ba lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x334:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f2a4 expref: 85 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305934.604618:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x334:0x0].0x0 (00000000581d6dd7) 00010000:00010000:0.0:1772305934.604619:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1772305934.604620:0:55653:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000034fec1fd, rc 0) 00000100:00100000:0.0:1772305934.604676:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000933c070b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+85:99940:x1858396225409792:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 447us (557us total) trans 8589934980 rc 0/0 00000100:00100000:0.0:1772305934.604681:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1167 00000100:00100000:3.0:1772305934.605765:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305934.605792:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305934.605815:0:5494:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225409856 00000100:00100000:0.0:1772305934.605828:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225409920 00000100:00100000:2.0:1772305934.605867:0:5494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1052 00000100:00100000:0.0:1772305934.605868:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5776 00000100:00100000:0.0:1772305934.605874:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ea17b2f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+224:2215:x1858396225409920:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 00000100:00100000:2.0:1772305934.605882:0:5494:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d02fd03d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+85:2216:x1858396225409856:12345-192.168.203.30@tcp:103:ldlm_bl_07.0 00010000:00010000:2.0:1772305934.605895:0:5494:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1772305934.605900:0:6306:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c700c8 lrc: 3/1,0 mode: --/PR res: [0x1b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305934.605909:0:6306:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1772305934.605912:0:5494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c700ba lrc: 0/0,0 mode: --/CR res: [0x200000402:0x334:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f2a4 expref: 85 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305934.605912:0:6306:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305934.605917:0:6306:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c700c8 lrc: 3/1,0 mode: PR/PR res: [0x1b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305934.605933:0:5494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x334:0x0].0x0 (00000000581d6dd7) 00010000:00010000:0.0:1772305934.605936:0:6306:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c700c8 lrc: 3/1,0 mode: PR/PR res: [0x1b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305934.605940:0:5494:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1772305934.605953:0:6306:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c700c8 lrc: 3/1,0 mode: PR/PR res: [0x1b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305934.605959:0:6306:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c700c8 lrc: 2/0,0 mode: PR/PR res: [0x1b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305934.605974:0:6306:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1772305934.605988:0:5494:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d02fd03d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2216:x1858396225409856:12345-192.168.203.30@tcp:103:ldlm_bl_07.0 Request processed in 108us (222us total) trans 0 rc 0/0 00010000:00010000:3.0:1772305934.605993:0:5496:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1772305934.605998:0:5494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1052 00010000:00010000:3.0:1772305934.606001:0:5496:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c700c8 lrc: 2/0,0 mode: PR/PR res: [0x1b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305934.606003:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ea17b2f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+224:2215:x1858396225409920:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 Request processed in 125us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305934.606017:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5776 00010000:00010000:3.0:1772305934.606021:0:5496:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a7782eea already unused, calling callback (00000000b5e4f3c0) 00010000:00010000:3.0:1772305934.606026:0:5496:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c700c8 lrc: 2/0,0 mode: PR/PR res: [0x1b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305934.606036:0:5496:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c700c8 lrc: 3/0,0 mode: PR/PR res: [0x1b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305934.606051:0:5496:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c700c8 lrc: 1/0,0 mode: --/PR res: [0x1b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305934.606058:0:5496:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c700c8 lrc: 0/0,0 mode: --/PR res: [0x1b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305934.606070:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1772305934.606072:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1772305934.606074:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772305934.606686:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305934.606731:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225410048 00000100:00100000:2.0:1772305934.606762:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1168 00000100:00100000:2.0:1772305934.606767:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000702c2a54 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:99940:x1858396225410048:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1772305934.606826:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000702c2a54 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:99940:x1858396225410048:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 57us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305934.606833:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1168 00000100:00100000:1.0:1772305934.607699:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305934.607736:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225410112 00000100:00100000:2.0:1772305934.607765:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1169 00000100:00100000:2.0:1772305934.607769:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000eb98a4bb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:99940:x1858396225410112:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1772305934.607779:0:55653:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305934.607789:0:55653:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c700cf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f2ab expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305934.607824:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c700d6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x334:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305934.607835:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c700d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x334:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305934.607844:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c700d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x334:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1772305934.607866:0:55653:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x334:0x0]: returning size 0 00000004:00200000:2.0:1772305934.607869:0:55653:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1772305934.607881:0:55653:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c700d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x334:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305934.607890:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c700d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x334:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305934.607906:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c700cf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f2ab expref: 86 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305934.607919:0:55653:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000007129515/0xa5e9c8c58c700d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x334:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f2ab expref: 85 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305934.607931:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x334:0x0].0x0 (00000000581d6dd7) 00010000:00010000:2.0:1772305934.607933:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1772305934.607935:0:55653:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000007129515, rc 0) 00000100:00100000:2.0:1772305934.607968:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000eb98a4bb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+85:99940:x1858396225410112:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 198us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305934.607976:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1169 00000100:00100000:3.0:1772305934.608875:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305934.608914:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225410176 00000100:00100000:0.0:1772305934.608941:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5777 00000100:00100000:0.0:1772305934.608945:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000076169a73 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+224:2215:x1858396225410176:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1772305934.608952:0:6306:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305934.608959:0:6306:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c700dd lrc: 2/0,0 mode: --/PR res: [0x1b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f2b2 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305934.608973:0:6306:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305934.608975:0:6306:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305934.608980:0:6306:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c700dd lrc: 3/0,0 mode: PR/PR res: [0x1b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f2b2 expref: 225 pid: 6306 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1772305934.608989:0:6306:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000082c88ffe/0xa5e9c8c58c700dd lrc: 3/0,0 mode: PR/PR res: [0x1b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f2b2 expref: 225 pid: 6306 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1772305934.608997:0:6306:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000082c88ffe, rc 0) 00000100:00100000:0.0:1772305934.609022:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000076169a73 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+225:2215:x1858396225410176:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 76us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305934.609027:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5777 00000100:00100000:1.0:1772305934.609809:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305934.609843:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225410304 00000100:00100000:2.0:1772305934.609869:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1170 00000100:00100000:2.0:1772305934.609873:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002e3a97d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+85:99940:x1858396225410304:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1772305934.609919:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002e3a97d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+85:99940:x1858396225410304:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 44us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305934.609927:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1170 00000100:00100000:1.0:1772305934.610787:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305934.610830:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225410368 00000100:00100000:2.0:1772305934.610861:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1171 00000100:00100000:2.0:1772305934.610866:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000026c4ebe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+85:99940:x1858396225410368:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1772305934.610878:0:55653:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305934.610890:0:55653:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c700e4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x334:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f2b9 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305934.610912:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000f8380462/0xa5e9c8c58c700eb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x334:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305934.610923:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f8380462/0xa5e9c8c58c700eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x334:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305934.610937:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f8380462/0xa5e9c8c58c700eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x334:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305934.610994:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c700e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x334:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f2b9 expref: 87 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305934.611004:0:55653:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000f8380462/0xa5e9c8c58c700eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x334:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f2b9 expref: 86 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305934.611009:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x334:0x0].0x0 (00000000581d6dd7) 00010000:00010000:2.0:1772305934.611011:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1772305934.611013:0:55653:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f8380462, rc 0) 00000100:00100000:2.0:1772305934.611039:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000026c4ebe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+86:99940:x1858396225410368:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 173us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305934.611044:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1171 00000100:00100000:3.0:1772305934.612085:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305934.612134:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225410432 00000100:00100000:2.0:1772305934.612174:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1172 00000100:00100000:2.0:1772305934.612180:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000096cbaee8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+86:99940:x1858396225410432:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1772305934.612198:0:55653:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x334:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1772305934.612264:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000096cbaee8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+86:99940:x1858396225410432:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 83us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305934.612272:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1172 00000100:00100000:1.0:1772305934.613009:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305934.613075:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225410496 00000100:00100000:0.0:1772305934.613109:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5778 00000100:00100000:0.0:1772305934.613115:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ccd4edae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+225:2216:x1858396225410496:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1772305934.613139:0:6306:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c700f2 lrc: 3/1,0 mode: --/PR res: [0x1b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305934.613147:0:6306:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305934.613149:0:6306:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305934.613152:0:6306:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c700f2 lrc: 3/1,0 mode: PR/PR res: [0x1b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305934.613159:0:6306:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c700f2 lrc: 3/1,0 mode: PR/PR res: [0x1b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305934.613176:0:6306:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c700f2 lrc: 3/1,0 mode: PR/PR res: [0x1b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305934.613181:0:6306:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c700f2 lrc: 2/0,0 mode: PR/PR res: [0x1b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305934.613195:0:6306:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1772305934.613223:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ccd4edae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+225:2216:x1858396225410496:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 Request processed in 108us (216us total) trans 0 rc 0/0 00010000:00010000:1.0:1772305934.613224:0:38581:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1772305934.613232:0:38581:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c700f2 lrc: 2/0,0 mode: PR/PR res: [0x1b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305934.613234:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5778 00010000:00010000:1.0:1772305934.613246:0:38581:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000079ce3603 already unused, calling callback (00000000b5e4f3c0) 00010000:00010000:1.0:1772305934.613250:0:38581:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c700f2 lrc: 2/0,0 mode: PR/PR res: [0x1b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305934.613259:0:38581:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c700f2 lrc: 3/0,0 mode: PR/PR res: [0x1b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305934.613272:0:38581:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c700f2 lrc: 1/0,0 mode: --/PR res: [0x1b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305934.613278:0:38581:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c700f2 lrc: 0/0,0 mode: --/PR res: [0x1b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305934.613290:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1772305934.613291:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1772305934.613293:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772305934.613736:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305934.613780:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225410624 00000100:00100000:2.0:1772305934.613821:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1173 00000100:00100000:2.0:1772305934.613827:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f45a42e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+86:99940:x1858396225410624:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000040:00080000:2.0:1772305934.614080:0:55653:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305934.614084:0:55653:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305934.614172:0:55653:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 46 count 18 00000040:00080000:2.0:1772305934.614180:0:55653:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:2.0:1772305934.614243:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f45a42e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+87:99940:x1858396225410624:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 415us (508us total) trans 8589934981 rc 0/0 00000100:00100000:2.0:1772305934.614253:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1173 00000040:00080000:1.0:1772305934.614279:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305934.614283:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305934.614836:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 18 00000040:00080000:1.0:1772305934.614844:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:3.0:1772305934.614892:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305934.614952:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225410752 00000100:00100000:0.0:1772305934.614988:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 154 00000100:00100000:0.0:1772305934.614994:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fca5ff81 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+87:99940:x1858396225410752:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1772305934.615170:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fca5ff81 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+88:99940:x1858396225410752:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 175us (278us total) trans 8589934982 rc 0/0 00000100:00100000:0.0:1772305934.615179:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 154 00010000:00010000:0.0:1772305935.049711:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1772305935.278615:0:71332:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772305935.278622:0:71332:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772305935.278741:0:71332:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 46 count 18 00000040:00080000:0.0:1772305935.278746:0:71332:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:3.0:1772305935.343719:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305935.343761:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225410816 00000100:00100000:2.0:1772305935.343806:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1174 00000100:00100000:2.0:1772305935.343812:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006df25124 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+67:99959:x1858396225410816:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1772305935.343831:0:55653:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305935.343847:0:55653:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c700f9 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f2c0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.343912:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c70100 lrc: 3/1,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.343926:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c70100 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.343940:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c70100 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.343955:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c70107 lrc: 3/1,0 mode: --/PR res: [0x200000408:0x95:0x0].0xd86b4ffe bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.343963:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c70107 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0xd86b4ffe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.343976:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c70107 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0xd86b4ffe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.344074:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e44a0294/0xa5e9c8c58c7010e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x32f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.344081:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e44a0294/0xa5e9c8c58c7010e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.344086:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e44a0294/0xa5e9c8c58c7010e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1772305935.344109:0:55653:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x32f:0x0]: returning size 0 00000004:00200000:2.0:1772305935.344113:0:55653:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1772305935.344130:0:55653:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000e44a0294/0xa5e9c8c58c7010e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.344142:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e44a0294/0xa5e9c8c58c7010e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.344150:0:55653:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c70100 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.344157:0:55653:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c70100 lrc: 2/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.344164:0:55653:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c70100 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.344170:0:55653:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000089dbe966 already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305935.344174:0:55653:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c70100 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.344182:0:55653:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c70100 lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.344193:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0x0 (00000000fbf66531) 00010000:00010000:2.0:1772305935.344196:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305935.344199:0:55653:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c70100 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.344203:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c70100 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.344210:0:55653:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c70107 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0xd86b4ffe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.344213:0:55653:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c70107 lrc: 2/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0xd86b4ffe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.344217:0:55653:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c70107 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0xd86b4ffe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.344221:0:55653:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000007319ba46 already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305935.344222:0:55653:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c70107 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0xd86b4ffe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.344225:0:55653:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c70107 lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0xd86b4ffe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.344229:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0xd86b4ffe (000000008fd1be63) 00010000:00010000:2.0:1772305935.344231:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305935.344232:0:55653:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c70107 lrc: 2/0,0 mode: --/PR res: [0x200000408:0x95:0x0].0xd86b4ffe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.344236:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c70107 lrc: 0/0,0 mode: --/PR res: [0x200000408:0x95:0x0].0xd86b4ffe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.344258:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c700f9 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f2c0 expref: 69 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.344265:0:55653:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000e44a0294/0xa5e9c8c58c7010e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f2c0 expref: 68 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.344269:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32f:0x0].0x0 (0000000008f76014) 00010000:00010000:2.0:1772305935.344271:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1772305935.344272:0:55653:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e44a0294, rc 0) 00000100:00100000:2.0:1772305935.344333:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006df25124 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+68:99959:x1858396225410816:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 520us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305935.344338:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1174 00000100:00100000:1.0:1772305935.345686:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305935.345723:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225410880 00000100:00100000:0.0:1772305935.345754:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5779 00000100:00100000:0.0:1772305935.345758:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005215dd7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+141:2215:x1858396225410880:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1772305935.345767:0:6306:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305935.345780:0:6306:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7dfb548/0xa5e9c8c58c70115 lrc: 2/0,0 mode: --/PR res: [0x1b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f2c7 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1772305935.345807:0:6306:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x1b2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1772305935.345817:0:6306:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305935.345819:0:6306:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305935.345825:0:6306:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7dfb548/0xa5e9c8c58c70115 lrc: 3/0,0 mode: PR/PR res: [0x1b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f2c7 expref: 142 pid: 6306 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1772305935.345839:0:6306:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c7dfb548/0xa5e9c8c58c70115 lrc: 3/0,0 mode: PR/PR res: [0x1b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f2c7 expref: 142 pid: 6306 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1772305935.345851:0:6306:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c7dfb548, rc 0) 00000100:00100000:0.0:1772305935.345891:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005215dd7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+142:2215:x1858396225410880:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 127us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305935.345896:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5779 00000100:00100000:3.0:1772305935.347951:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305935.347997:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225411008 00000100:00100000:2.0:1772305935.348035:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1175 00000100:00100000:2.0:1772305935.348042:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000994afcfc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+68:99959:x1858396225411008:12345-192.168.203.30@tcp:58:lfs.0 00000040:00080000:2.0:1772305935.348191:0:55653:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xf:0x0].46, 136 off14448 00000100:00100000:2.0:1772305935.348243:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000994afcfc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+68:99959:x1858396225411008:12345-192.168.203.30@tcp:58:lfs.0 Request processed in 202us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305935.348249:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1175 00000040:00080000:1.0:1772305935.624874:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305935.624880:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305935.624932:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 47 count 19 00000040:00080000:1.0:1772305935.624941:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:1.0:1772305935.625153:0:54732:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e2a011a7 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:54732:1858396216611008:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1772305935.625229:0:54732:0:(client.c:2500:ptlrpc_set_wait()) set 00000000c74b00d2 going to sleep for 6 seconds 00000100:00100000:2.0:1772305935.626399:0:54732:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e2a011a7 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:54732:1858396216611008:192.168.203.30@tcp:107:hsm_cdtr.0 00000040:00080000:2.0:1772305935.626467:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305935.626470:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305935.626521:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 47 count 19 00000040:00080000:2.0:1772305935.626526:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:3.0:1772305935.646953:0:71383:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305935.646958:0:71383:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305935.647021:0:71383:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 47 count 19 00000040:00080000:3.0:1772305935.647024:0:71383:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:3.0:1772305935.647051:0:71383:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305935.647053:0:71383:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305935.647106:0:71383:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 47 count 19 00000040:00080000:3.0:1772305935.647108:0:71383:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:0.0:1772305935.665014:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305935.665074:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225411072 00000100:00100000:2.0:1772305935.665133:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1176 00000100:00100000:2.0:1772305935.665142:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001c01c9b0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+68:99972:x1858396225411072:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1772305935.665163:0:55653:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305935.665183:0:55653:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c7011c lrc: 2/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f2ce expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.665242:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c70123 lrc: 3/1,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.665257:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c70123 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.665269:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c70123 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.665283:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c7012a lrc: 3/1,0 mode: --/PR res: [0x200000408:0x95:0x0].0x9838e759 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.665291:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c7012a lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.665297:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c7012a lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.665422:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c70131 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x331:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.665437:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c70131 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.665445:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c70131 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1772305935.665479:0:55653:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x331:0x0]: returning size 0 00000004:00200000:2.0:1772305935.665484:0:55653:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1772305935.665503:0:55653:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c70131 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.665515:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c70131 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.665524:0:55653:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c70123 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.665533:0:55653:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c70123 lrc: 2/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.665541:0:55653:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c70123 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.665548:0:55653:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000007319ba46 already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305935.665552:0:55653:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c70123 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.665559:0:55653:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c70123 lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.665576:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0x0 (00000000fbf66531) 00010000:00010000:2.0:1772305935.665580:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305935.665584:0:55653:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c70123 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.665590:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c70123 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.665603:0:55653:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c7012a lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.665610:0:55653:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c7012a lrc: 2/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.665617:0:55653:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c7012a lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.665623:0:55653:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000089dbe966 already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305935.665649:0:55653:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c7012a lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.665658:0:55653:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c7012a lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.665668:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0x9838e759 (000000008fd1be63) 00010000:00010000:2.0:1772305935.665671:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305935.665674:0:55653:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c7012a lrc: 2/0,0 mode: --/PR res: [0x200000408:0x95:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.665685:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c7012a lrc: 0/0,0 mode: --/PR res: [0x200000408:0x95:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.665715:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c7011c lrc: 0/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f2ce expref: 70 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.665727:0:55653:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c70131 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f2ce expref: 69 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.665735:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x331:0x0].0x0 (00000000228cb01d) 00010000:00010000:2.0:1772305935.665738:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1772305935.665740:0:55653:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f20d88bd, rc 0) 00000100:00100000:2.0:1772305935.665796:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001c01c9b0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+69:99972:x1858396225411072:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 653us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305935.665805:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1176 00000100:00100000:1.0:1772305935.668202:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305935.668246:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225411200 00000100:00100000:2.0:1772305935.668288:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1177 00000100:00100000:2.0:1772305935.668295:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a95f9a22 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+69:99972:x1858396225411200:12345-192.168.203.30@tcp:58:lfs.0 00010000:00010000:2.0:1772305935.668369:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c70138 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x331:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.668384:0:55653:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c70131 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f2ce expref: 69 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.668393:0:55653:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c70138 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x331:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.668431:0:55653:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c70131 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f2ce expref: 69 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.668445:0:55653:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c70131 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f2ce expref: 69 pid: 55653 timeout: 1347 lvb_type: 0 00000100:00100000:2.0:1772305935.668459:0:55653:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085acb02d pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:55653:1858396216611072:192.168.203.30@tcp:104: 00000100:00100000:2.0:1772305935.668519:0:55653:0:(client.c:2500:ptlrpc_set_wait()) set 00000000ba93871b going to sleep for 6 seconds 00000100:00100000:2.0:1772305935.669304:0:55653:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085acb02d pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:55653:1858396216611072:192.168.203.30@tcp:104: 00010000:00010000:2.0:1772305935.669340:0:55653:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c70138 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x331:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305935.669538:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305935.669576:0:5494:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225411264 00010000:00010000:2.0:1772305935.669593:0:5494:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c70131 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f2ce expref: 70 pid: 55653 timeout: 1347 lvb_type: 0 00000100:00100000:2.0:1772305935.669624:0:5494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3153 00000100:00100000:2.0:1772305935.669652:0:5494:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002254491d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+70:2215:x1858396225411264:12345-192.168.203.30@tcp:103:ldlm_bl_08.0 00010000:00010000:2.0:1772305935.669663:0:5494:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1772305935.669669:0:5494:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c70131 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f2ce expref: 70 pid: 55653 timeout: 1347 lvb_type: 0 00010000:00010000:2.0:1772305935.669682:0:5494:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c70131 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f2ce expref: 70 pid: 55653 timeout: 1347 lvb_type: 0 00010000:00010000:2.0:1772305935.669697:0:5494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c70131 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f2ce expref: 70 pid: 55653 timeout: 1347 lvb_type: 0 00010000:00010000:2.0:1772305935.669713:0:5494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x331:0x0].0x0 (00000000228cb01d) 00010000:00010000:2.0:1772305935.669717:0:5494:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c70138 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x331:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.669726:0:5494:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c70138 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x331:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.669733:0:5494:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c70138 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x331:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305935.669758:0:5494:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1772305935.669779:0:55653:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c70138 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x331:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305935.669789:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c70138 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x331:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305935.669790:0:5494:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002254491d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+69:2215:x1858396225411264:12345-192.168.203.30@tcp:103:ldlm_bl_08.0 Request processed in 138us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305935.669808:0:5494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3153 00000040:00080000:0.0:1772305935.669921:0:55653:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xf:0x0].47, 136 off14584 00000100:00100000:0.0:1772305935.669974:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a95f9a22 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+68:99972:x1858396225411200:12345-192.168.203.30@tcp:58:lfs.0 Request processed in 1677us (1772us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305935.669984:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1177 00000100:00100000:3.0:1772305935.678193:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305935.678250:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225411328 00000100:00100000:0.0:1772305935.678290:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1178 00000100:00100000:0.0:1772305935.678295:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000006affeef pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+68:99974:x1858396225411328:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1772305935.678309:0:55653:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305935.678338:0:55653:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c7013f lrc: 2/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f2d5 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305935.678385:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c70146 lrc: 3/1,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305935.678395:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c70146 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305935.678403:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c70146 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305935.678413:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c7014d lrc: 3/1,0 mode: --/PR res: [0x200000408:0x95:0x0].0x9838e759 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305935.678418:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c7014d lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305935.678422:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c7014d lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305935.678501:0:55653:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c70154 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x331:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305935.678506:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c70154 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305935.678510:0:55653:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c70154 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305935.678534:0:55653:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x331:0x0]: returning size 0 00000004:00200000:0.0:1772305935.678537:0:55653:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1772305935.678550:0:55653:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c70154 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305935.678557:0:55653:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c70154 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305935.678562:0:55653:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c70146 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305935.678567:0:55653:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c70146 lrc: 2/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305935.678572:0:55653:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c70146 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305935.678576:0:55653:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000004820b6c already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305935.678578:0:55653:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c70146 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305935.678582:0:55653:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c70146 lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305935.678589:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0x0 (00000000fbf66531) 00010000:00010000:0.0:1772305935.678591:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305935.678594:0:55653:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c70146 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305935.678598:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c70146 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305935.678604:0:55653:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c7014d lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305935.678608:0:55653:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c7014d lrc: 2/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305935.678612:0:55653:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c7014d lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305935.678619:0:55653:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000fd93d0b1 already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305935.678621:0:55653:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c7014d lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305935.678651:0:55653:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c7014d lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305935.678661:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0x9838e759 (000000001ccb4b89) 00010000:00010000:0.0:1772305935.678664:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305935.678666:0:55653:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c7014d lrc: 2/0,0 mode: --/PR res: [0x200000408:0x95:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305935.678673:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c7014d lrc: 0/0,0 mode: --/PR res: [0x200000408:0x95:0x0].0x9838e759 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305935.678697:0:55653:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c7013f lrc: 0/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f2d5 expref: 70 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305935.678706:0:55653:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c70154 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f2d5 expref: 69 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305935.678710:0:55653:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x331:0x0].0x0 (00000000228cb01d) 00010000:00010000:0.0:1772305935.678712:0:55653:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1772305935.678714:0:55653:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000f7a426e, rc 0) 00000100:00100000:0.0:1772305935.678756:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000006affeef pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+69:99974:x1858396225411328:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 460us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305935.678761:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1178 00000001:00080000:1.0:1772305935.828091:0:6332:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-OST0000: transno 4294968318 is committed 00000001:00080000:1.0:1772305935.828109:0:6332:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-OST0000: transno 4294968319 is committed 00000040:00080000:3.0:1772305935.968222:0:71437:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305935.968226:0:71437:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305935.968290:0:71437:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 48 count 20 00000040:00080000:3.0:1772305935.968294:0:71437:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:3.0:1772305935.968329:0:71437:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305935.968331:0:71437:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305935.968387:0:71437:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 48 count 20 00000040:00080000:3.0:1772305935.968390:0:71437:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:2.0:1772305936.072738:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1772305936.648840:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305936.648848:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305936.648899:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 48 count 20 00000040:00080000:2.0:1772305936.648908:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:2.0:1772305936.648989:0:54732:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085acb02d pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:54732:1858396216611136:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1772305936.649061:0:54732:0:(client.c:2500:ptlrpc_set_wait()) set 0000000037908e98 going to sleep for 6 seconds 00000100:00100000:2.0:1772305936.650423:0:54732:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085acb02d pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:54732:1858396216611136:192.168.203.30@tcp:107:hsm_cdtr.0 00000040:00080000:2.0:1772305936.650488:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305936.650490:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305936.650573:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 48 count 20 00000040:00080000:2.0:1772305936.650580:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:3.0:1772305936.840875:0:2993:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000004:00080000:1.0:1772305936.840875:0:54722:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1248735245445ns, next at 1249735242041ns, rc = 0 00000004:00080000:0.0:1772305936.840876:0:54720:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1248735247335ns, next at 1249735243838ns, rc = 0 00000100:00100000:2.0:1772305936.840890:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bfe1381b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216611264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1772305936.840894:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000000ce11a0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216611200:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1772305936.840964:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772305936.841021:0:6309:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216611200 00000100:00100000:3.0:1772305936.841031:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772305936.841083:0:6309:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216611264 00000100:00100000:3.0:1772305936.841088:0:55611:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 461 00000100:00100000:3.0:1772305936.841097:0:55611:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000843d6290 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:2993:x1858396216611200:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1772305936.841110:0:6309:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 462 00000100:00100000:2.0:1772305936.841116:0:6309:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e6eb5d84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216611264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1772305936.841136:0:55611:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 695140352 pending 0 free 3603955712 avail 3601858560 00002000:00000024:2.0:1772305936.841161:0:6309:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 1703936 granted 744685568 pending 0 free 3828350976 avail 3826253824 00000100:00100000:3.0:1772305936.841190:0:55611:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000843d6290 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:2993:x1858396216611200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305936.841212:0:55611:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 461 00000100:00100000:2.0:1772305936.841219:0:6309:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e6eb5d84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216611264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305936.841229:0:6309:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 462 00000100:00100000:3.0:1772305936.841258:0:2991:0:(client.c:2868:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968319 gen 2 00000004:00080000:3.0:1772305936.841263:0:2991:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000d22b18dd, transno 4294968318 00000004:00080000:3.0:1772305936.841275:0:2991:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000731263eb, transno 4294968319 00000100:00100000:3.0:1772305936.841288:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bfe1381b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216611264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1772305936.841324:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000000ce11a0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216611200:0@lo:13:osp-pre-1-0.0 00000040:00100000:3.0:1772305936.841351:0:54719:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 11 in log [0xb:0x1:0x0] 00000040:00100000:3.0:1772305936.841558:0:54719:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 12 in log [0xb:0x1:0x0] 00000001:00080000:1.0:1772305936.855335:0:7114:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-OST0001: transno 4294968352 is committed 00000001:00080000:3.0:1772305936.856655:0:54724:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934982 is committed 00000004:00080000:3.0:1772305936.856674:0:54724:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 12 committed 00000001:00080000:3.0:1772305936.856698:0:54724:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934971 is committed 00000004:00080000:3.0:1772305936.856727:0:54724:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 14 committed 00000004:00080000:3.0:1772305936.856749:0:54724:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 13 committed 00000001:00080000:3.0:1772305936.856767:0:54724:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934972 is committed 00000020:00080000:3.0:1772305936.856773:0:54724:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 4295052957 batchid updated 00000020:00080000:0.0:1772305936.856824:0:54735:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4295052957 00000100:00100000:2.0:1772305936.856825:0:2991:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1772305936.856827:0:2994:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000020:00080000:0.0:1772305936.856841:0:54735:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4295052957 00000100:00100000:2.0:1772305936.856848:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085acb02d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216611328:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1772305936.856848:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000537dbec0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216611392:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1772305936.856913:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772305936.856940:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216611392 00000100:00100000:3.0:1772305936.856959:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772305936.856975:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216611328 00000100:00100000:1.0:1772305936.857000:0:48470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5780 00000100:00100000:2.0:1772305936.857010:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5781 00000100:00100000:1.0:1772305936.857010:0:48470:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cc3c0696 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216611392:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1772305936.857018:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c8b46b0c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216611328:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1772305936.857033:0:6306:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:435 count 1 00002000:00080000:1.0:1772305936.857034:0:48470:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:435 count 1 00002000:00010000:1.0:1772305936.857065:0:48470:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x1b3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00002000:00010000:2.0:1772305936.857067:0:6306:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x1b3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1772305936.857071:0:48470:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee5a0681/0xa5e9c8c58c70162 lrc: 3/0,1 mode: --/PW res: [0x1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305936.857072:0:6306:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c7015b lrc: 3/0,1 mode: --/PW res: [0x1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305936.857096:0:6306:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305936.857097:0:48470:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1772305936.857099:0:6306:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305936.857101:0:48470:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1772305936.857103:0:6306:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c7015b lrc: 3/0,1 mode: PW/PW res: [0x1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305936.857104:0:48470:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee5a0681/0xa5e9c8c58c70162 lrc: 3/0,1 mode: PW/PW res: [0x1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305936.857132:0:6306:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c7015b lrc: 3/0,1 mode: PW/PW res: [0x1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305936.857132:0:48470:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee5a0681/0xa5e9c8c58c70162 lrc: 3/0,1 mode: PW/PW res: [0x1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305936.857154:0:48470:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee5a0681/0xa5e9c8c58c70162 lrc: 3/0,1 mode: PW/PW res: [0x1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305936.857162:0:6306:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c7015b lrc: 3/0,1 mode: PW/PW res: [0x1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305936.857164:0:48470:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee5a0681/0xa5e9c8c58c70162 lrc: 2/0,0 mode: PW/PW res: [0x1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305936.857176:0:6306:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c7015b lrc: 2/0,0 mode: PW/PW res: [0x1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305936.857189:0:48470:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1772305936.857197:0:6306:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1772305936.857211:0:5496:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1772305936.857216:0:5496:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee5a0681/0xa5e9c8c58c70162 lrc: 2/0,0 mode: PW/PW res: [0x1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305936.857222:0:38581:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1772305936.857225:0:5496:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ee5a0681 already unused, calling callback (00000000b5e4f3c0) 00010000:00010000:0.0:1772305936.857228:0:38581:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c7015b lrc: 2/0,0 mode: PW/PW res: [0x1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305936.857229:0:5496:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee5a0681/0xa5e9c8c58c70162 lrc: 2/0,0 mode: PW/PW res: [0x1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305936.857250:0:5496:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee5a0681/0xa5e9c8c58c70162 lrc: 3/0,0 mode: PW/PW res: [0x1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305936.857252:0:38581:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f20d88bd already unused, calling callback (00000000b5e4f3c0) 00010000:00010000:0.0:1772305936.857258:0:38581:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c7015b lrc: 2/0,0 mode: PW/PW res: [0x1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305936.857269:0:38581:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c7015b lrc: 3/0,0 mode: PW/PW res: [0x1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305936.857271:0:5496:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee5a0681/0xa5e9c8c58c70162 lrc: 1/0,0 mode: --/PW res: [0x1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305936.857293:0:5496:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee5a0681/0xa5e9c8c58c70162 lrc: 0/0,0 mode: --/PW res: [0x1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 48470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305936.857300:0:38581:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c7015b lrc: 1/0,0 mode: --/PW res: [0x1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305936.857325:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1772305936.857326:0:38581:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c7015b lrc: 0/0,0 mode: --/PW res: [0x1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305936.857329:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1772305936.857332:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1772305936.857348:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1772305936.857351:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1772305936.857353:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772305936.857602:0:48470:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cc3c0696 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:2994:x1858396216611392:12345-0@lo:6:osp-syn-1-0.0 Request processed in 595us (689us total) trans 4294968353 rc 0/0 00000100:00100000:1.0:1772305936.857608:0:48470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5780 00000100:00100000:2.0:1772305936.857613:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c8b46b0c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:2991:x1858396216611328:12345-0@lo:6:osp-syn-0-0.0 Request processed in 595us (654us total) trans 4294968320 rc 0/0 00000100:00100000:2.0:1772305936.857622:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5781 00000100:00100000:0.0:1772305936.857678:0:2994:0:(client.c:2868:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968352 gen 2 00000004:00080000:3.0:1772305936.857681:0:2991:0:(osp_sync.c:563:osp_sync_interpret()) reply req 0000000085acb02d/2, rc 0, transno 1024 00000004:00080000:0.0:1772305936.857684:0:2994:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000ffc6c4ba, transno 4294968351 00000100:00100000:3.0:1772305936.857688:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085acb02d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216611328:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1772305936.857695:0:2994:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 000000004f8db88b, transno 4294968352 00000100:00100000:0.0:1772305936.857703:0:2994:0:(client.c:2894:ptlrpc_free_committed()) @@@ stopping search req@00000000537dbec0 x1858396216611392/t4294968353(4294968353) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1772305943 ref 2 fl Rpc:RQU/4/0 rc 0/0 job:'osp-syn-1-0.0' 00000040:00100000:1.0:1772305936.857709:0:54721:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 12 in log [0xd:0x1:0x0] 00000004:00080000:0.0:1772305936.857712:0:2994:0:(osp_sync.c:563:osp_sync_interpret()) reply req 00000000537dbec0/2, rc 0, transno 1057 00000100:00100000:0.0:1772305936.857717:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000537dbec0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216611392:0@lo:6:osp-syn-1-0.0 00000040:00100000:1.0:1772305936.857782:0:54721:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 13 in log [0xd:0x1:0x0] 00010000:00010000:1.0:1772305937.096747:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1772305937.256560:0:71490:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305937.256565:0:71490:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305937.256670:0:71490:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 48 count 20 00000040:00080000:2.0:1772305937.256679:0:71490:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:2.0:1772305937.256708:0:71490:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305937.256710:0:71490:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305937.256772:0:71490:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 48 count 20 00000040:00080000:2.0:1772305937.256775:0:71490:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:2.0:1772305937.275162:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305937.275221:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225411456 00000100:00100000:0.0:1772305937.275278:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1179 00000100:00100000:0.0:1772305937.275285:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d22b18dd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+65:99993:x1858396225411456:12345-192.168.203.30@tcp:58:lfs.0 00000040:00080000:0.0:1772305937.275536:0:55653:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xf:0x0].48, 136 off14720 00000100:00100000:0.0:1772305937.275614:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d22b18dd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+65:99993:x1858396225411456:12345-192.168.203.30@tcp:58:lfs.0 Request processed in 329us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305937.275623:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1179 00000100:00100000:1.0:1772305937.352774:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c9f16044 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:70aae467-c860-409f-ba1b-742f4d042da6:2994:1858396216611456:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1772305937.352786:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000acf112ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216611648:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305937.352801:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e66c634e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2991:1858396216611520:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1772305937.352860:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305937.352861:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305937.352865:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305937.352903:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000361b5fba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216611712:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305937.352908:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003116ee12 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2991:1858396216611776:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1772305937.352923:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216611648 00000100:00100000:1.0:1772305937.352942:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305937.352954:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772305937.352975:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216611712 00000100:00100000:1.0:1772305937.352981:0:54689:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216611456 00000100:00100000:3.0:1772305937.352982:0:2991:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1772305937.352991:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fe12e717 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:2991:1858396216611584:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1772305937.353010:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1198 00000100:00100000:2.0:1772305937.353020:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000731263eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:2993:x1858396216611648:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305937.353022:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305937.353023:0:54689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1772305937.353033:0:54689:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b5d26536 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70aae467-c860-409f-ba1b-742f4d042da6+18:2994:x1858396216611456:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305937.353064:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216611520 00000100:00100000:1.0:1772305937.353083:0:54689:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b5d26536 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70aae467-c860-409f-ba1b-742f4d042da6+18:2994:x1858396216611456:12345-0@lo:400:kworker/u8:0.0 Request processed in 50us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305937.353093:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000731263eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:2993:x1858396216611648:12345-0@lo:400:kworker/u8:0.0 Request processed in 72us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305937.353093:0:54689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1772305937.353104:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1198 00000100:00100000:3.0:1772305937.353105:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216611776 00000100:00100000:3.0:1772305937.353124:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1772305937.353129:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000009f3c62d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:2991:x1858396216611520:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1772305937.353137:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1199 00000100:00100000:2.0:1772305937.353144:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a5d3959f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:2994:x1858396216611712:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1772305937.353161:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216611584 00000100:00100000:3.0:1772305937.353169:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000009f3c62d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:2991:x1858396216611520:12345-0@lo:400:kworker/u8:0.0 Request processed in 39us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305937.353177:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1772305937.353190:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a5d3959f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:2994:x1858396216611712:12345-0@lo:400:kworker/u8:0.0 Request processed in 46us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305937.353199:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1772305937.353200:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1199 00000100:00100000:3.0:1772305937.353208:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1772305937.353212:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000030950d51 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:2991:x1858396216611776:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305937.353219:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000566cbf94 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:2991:x1858396216611584:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305937.353271:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000566cbf94 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:2991:x1858396216611584:12345-0@lo:400:kworker/u8:0.0 Request processed in 57us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305937.353278:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1772305937.353282:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000030950d51 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:2991:x1858396216611776:12345-0@lo:400:kworker/u8:0.0 Request processed in 70us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305937.353290:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1772305937.353343:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fe12e717 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:2991:1858396216611584:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305937.353360:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e66c634e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2991:1858396216611520:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305937.353385:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003116ee12 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2991:1858396216611776:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1772305937.353385:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000361b5fba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216611712:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1772305937.353416:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c9f16044 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:70aae467-c860-409f-ba1b-742f4d042da6:2994:1858396216611456:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1772305937.353474:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000acf112ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216611648:0@lo:400:kworker/u8:0.0 00000040:00080000:3.0:1772305937.575093:0:71541:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305937.575099:0:71541:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305937.575175:0:71541:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 49 count 21 00000040:00080000:3.0:1772305937.575179:0:71541:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:3.0:1772305937.575199:0:71541:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305937.575201:0:71541:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305937.575255:0:71541:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 49 count 21 00000040:00080000:3.0:1772305937.575257:0:71541:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:2.0:1772305937.672792:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305937.672798:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305937.672846:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 49 count 21 00000040:00080000:2.0:1772305937.672854:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:2.0:1772305937.672931:0:54732:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e72c7c57 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:54732:1858396216611840:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1772305937.673003:0:54732:0:(client.c:2500:ptlrpc_set_wait()) set 00000000b18f5977 going to sleep for 6 seconds 00000100:00100000:1.0:1772305937.674253:0:54732:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e72c7c57 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:54732:1858396216611840:192.168.203.30@tcp:107:hsm_cdtr.0 00000040:00080000:1.0:1772305937.674342:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305937.674345:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305937.674474:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 49 count 21 00000040:00080000:1.0:1772305937.674481:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:2.0:1772305938.120732:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1772305938.696846:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305938.696856:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305938.696905:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 49 count 21 00000040:00080000:1.0:1772305938.696911:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:0.0:1772305938.871676:0:71592:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772305938.871680:0:71592:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772305938.871748:0:71592:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 49 count 21 00000040:00080000:0.0:1772305938.871752:0:71592:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:0.0:1772305938.871778:0:71592:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772305938.871779:0:71592:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772305938.871847:0:71592:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 49 count 21 00000040:00080000:0.0:1772305938.871852:0:71592:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:1.0:1772305938.889682:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305938.889723:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225411520 00000100:00100000:2.0:1772305938.889779:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1180 00000100:00100000:2.0:1772305938.889789:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005e40d2db pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+65:100014:x1858396225411520:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1772305938.889809:0:54696:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305938.889830:0:54696:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c70169 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f2dc expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.889887:0:54696:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c70170 lrc: 3/1,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.889901:0:54696:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c70170 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.889919:0:54696:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c70170 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.889933:0:54696:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c70177 lrc: 3/1,0 mode: --/PR res: [0x200000408:0x95:0x0].0xa2905c76 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.889941:0:54696:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c70177 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0xa2905c76 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.889948:0:54696:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c70177 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0xa2905c76 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.890060:0:54696:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c7017e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x330:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.890069:0:54696:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c7017e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x330:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.890077:0:54696:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c7017e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x330:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1772305938.890106:0:54696:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x330:0x0]: returning size 0 00000004:00200000:2.0:1772305938.890110:0:54696:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1772305938.890126:0:54696:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c7017e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x330:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.890137:0:54696:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c7017e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x330:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.890146:0:54696:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c70170 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.890154:0:54696:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c70170 lrc: 2/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.890162:0:54696:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c70170 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.890169:0:54696:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000089dbe966 already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305938.890173:0:54696:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c70170 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.890181:0:54696:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c70170 lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.890193:0:54696:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0x0 (00000000fbf66531) 00010000:00010000:2.0:1772305938.890196:0:54696:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305938.890199:0:54696:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c70170 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.890206:0:54696:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c70170 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.890217:0:54696:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c70177 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0xa2905c76 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.890224:0:54696:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c70177 lrc: 2/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0xa2905c76 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.890230:0:54696:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c70177 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0xa2905c76 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.890242:0:54696:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000007319ba46 already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305938.890244:0:54696:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c70177 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0xa2905c76 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.890250:0:54696:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c70177 lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0xa2905c76 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.890258:0:54696:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0xa2905c76 (0000000088c8ea8b) 00010000:00010000:2.0:1772305938.890260:0:54696:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305938.890262:0:54696:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c70177 lrc: 2/0,0 mode: --/PR res: [0x200000408:0x95:0x0].0xa2905c76 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.890269:0:54696:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c70177 lrc: 0/0,0 mode: --/PR res: [0x200000408:0x95:0x0].0xa2905c76 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.890312:0:54696:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c70169 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f2dc expref: 67 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.890326:0:54696:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000ad568b72/0xa5e9c8c58c7017e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x330:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f2dc expref: 66 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.890334:0:54696:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x330:0x0].0x0 (00000000d9ebda3c) 00010000:00010000:2.0:1772305938.890336:0:54696:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1772305938.890339:0:54696:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ad568b72, rc 0) 00000100:00100000:2.0:1772305938.890402:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005e40d2db pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+66:100014:x1858396225411520:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 614us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305938.890411:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1180 00000100:00100000:2.0:1772305938.891685:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305938.891722:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225411584 00000100:00100000:3.0:1772305938.891758:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5782 00000100:00100000:3.0:1772305938.891763:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f5fe1428 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+163:2216:x1858396225411584:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1772305938.891771:0:6306:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305938.891787:0:6306:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094970864/0xa5e9c8c58c70185 lrc: 2/0,0 mode: --/PR res: [0x1b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f2e3 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1772305938.891811:0:6306:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x1b2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1772305938.891823:0:6306:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1772305938.891825:0:6306:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1772305938.891830:0:6306:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094970864/0xa5e9c8c58c70185 lrc: 3/0,0 mode: PR/PR res: [0x1b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f2e3 expref: 164 pid: 6306 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1772305938.891844:0:6306:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000094970864/0xa5e9c8c58c70185 lrc: 3/0,0 mode: PR/PR res: [0x1b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f2e3 expref: 164 pid: 6306 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1772305938.891853:0:6306:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000094970864, rc 0) 00000100:00100000:3.0:1772305938.891883:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f5fe1428 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2216:x1858396225411584:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 119us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305938.891888:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5782 00000100:00100000:0.0:1772305938.893800:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305938.893845:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225411712 00000100:00100000:2.0:1772305938.893884:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1181 00000100:00100000:2.0:1772305938.893891:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fb0c28f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+66:100014:x1858396225411712:12345-192.168.203.30@tcp:58:lfs.0 00000040:00080000:2.0:1772305938.894081:0:54696:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xf:0x0].49, 136 off14856 00000100:00100000:2.0:1772305938.894141:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fb0c28f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+66:100014:x1858396225411712:12345-192.168.203.30@tcp:58:lfs.0 Request processed in 250us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305938.894151:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1181 00000100:00100000:3.0:1772305938.900456:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305938.900509:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225411776 00000100:00100000:2.0:1772305938.900551:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1182 00000100:00100000:2.0:1772305938.900557:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003116ee12 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+66:100015:x1858396225411776:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1772305938.900572:0:54696:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305938.900589:0:54696:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e8ea7e31/0xa5e9c8c58c7018c lrc: 2/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f2ea expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.900650:0:54696:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c70193 lrc: 3/1,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.900661:0:54696:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c70193 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.900671:0:54696:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c70193 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.900682:0:54696:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c7019a lrc: 3/1,0 mode: --/PR res: [0x200000408:0x95:0x0].0x1313e569 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.900687:0:54696:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c7019a lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.900696:0:54696:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c7019a lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.900786:0:54696:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c701a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x332:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.900792:0:54696:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c701a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x332:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.900797:0:54696:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c701a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x332:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1772305938.900822:0:54696:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x332:0x0]: returning size 0 00000004:00200000:2.0:1772305938.900825:0:54696:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1772305938.900838:0:54696:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c701a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x332:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.900846:0:54696:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c701a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x332:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.900852:0:54696:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c70193 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.900857:0:54696:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c70193 lrc: 2/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.900862:0:54696:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c70193 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.900866:0:54696:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000063369192 already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305938.900868:0:54696:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c70193 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.900874:0:54696:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c70193 lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.900882:0:54696:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0x0 (00000000fbf66531) 00010000:00010000:2.0:1772305938.900884:0:54696:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305938.900887:0:54696:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c70193 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.900894:0:54696:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c70193 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.900907:0:54696:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c7019a lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.900914:0:54696:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c7019a lrc: 2/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.900920:0:54696:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c7019a lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.900926:0:54696:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000004e3177f5 already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305938.900929:0:54696:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c7019a lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.900935:0:54696:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c7019a lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.900943:0:54696:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0x1313e569 (00000000fc961c4f) 00010000:00010000:2.0:1772305938.900947:0:54696:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305938.900949:0:54696:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c7019a lrc: 2/0,0 mode: --/PR res: [0x200000408:0x95:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.900955:0:54696:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c7019a lrc: 0/0,0 mode: --/PR res: [0x200000408:0x95:0x0].0x1313e569 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.900984:0:54696:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e8ea7e31/0xa5e9c8c58c7018c lrc: 0/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f2ea expref: 68 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.900994:0:54696:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c701a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x332:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f2ea expref: 67 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.900999:0:54696:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x332:0x0].0x0 (000000007f5f418e) 00010000:00010000:2.0:1772305938.901000:0:54696:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1772305938.901002:0:54696:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f20d88bd, rc 0) 00000100:00100000:2.0:1772305938.901046:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003116ee12 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+67:100015:x1858396225411776:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 490us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305938.901052:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1182 00000100:00100000:3.0:1772305938.903062:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305938.903102:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225411904 00000100:00100000:2.0:1772305938.903141:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1183 00000100:00100000:2.0:1772305938.903147:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e66c634e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+67:100015:x1858396225411904:12345-192.168.203.30@tcp:58:lfs.0 00010000:00010000:2.0:1772305938.903189:0:54696:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c701a8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x332:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.903200:0:54696:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c701a1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x332:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f2ea expref: 67 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.903206:0:54696:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c701a8 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x332:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.903231:0:54696:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c701a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x332:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f2ea expref: 67 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.903239:0:54696:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c701a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x332:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f2ea expref: 67 pid: 54696 timeout: 1350 lvb_type: 0 00000100:00100000:2.0:1772305938.903249:0:54696:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000093b46947 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:54696:1858396216611904:192.168.203.30@tcp:104: 00000100:00100000:2.0:1772305938.903307:0:54696:0:(client.c:2500:ptlrpc_set_wait()) set 00000000a4d182ad going to sleep for 6 seconds 00000100:00100000:2.0:1772305938.904047:0:54696:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000093b46947 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:54696:1858396216611904:192.168.203.30@tcp:104: 00010000:00010000:2.0:1772305938.904066:0:54696:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c701a8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x332:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305938.904204:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305938.904238:0:5494:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225411968 00010000:00010000:2.0:1772305938.904259:0:5494:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c701a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x332:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f2ea expref: 68 pid: 54696 timeout: 1350 lvb_type: 0 00000100:00100000:2.0:1772305938.904304:0:5494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3154 00000100:00100000:2.0:1772305938.904311:0:5494:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fe12e717 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+68:2215:x1858396225411968:12345-192.168.203.30@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1772305938.904323:0:5494:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1772305938.904327:0:5494:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c701a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x332:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f2ea expref: 68 pid: 54696 timeout: 1350 lvb_type: 0 00010000:00010000:2.0:1772305938.904335:0:5494:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c701a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x332:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f2ea expref: 68 pid: 54696 timeout: 1350 lvb_type: 0 00010000:00010000:2.0:1772305938.904346:0:5494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c701a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x332:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f2ea expref: 68 pid: 54696 timeout: 1350 lvb_type: 0 00010000:00010000:2.0:1772305938.904355:0:5494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x332:0x0].0x0 (000000007f5f418e) 00010000:00010000:2.0:1772305938.904357:0:5494:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c701a8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x332:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.904363:0:5494:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c701a8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x332:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.904367:0:5494:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c701a8 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x332:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305938.904385:0:5494:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1772305938.904401:0:54696:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c701a8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x332:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305938.904413:0:54696:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c701a8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x332:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305938.904421:0:5494:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fe12e717 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2215:x1858396225411968:12345-192.168.203.30@tcp:103:ldlm_bl_01.0 Request processed in 109us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305938.904430:0:5494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3154 00000040:00080000:3.0:1772305938.904592:0:54696:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xf:0x0].50, 136 off14992 00000100:00100000:3.0:1772305938.904681:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e66c634e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+66:100015:x1858396225411904:12345-192.168.203.30@tcp:58:lfs.0 Request processed in 1532us (1620us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305938.904691:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1183 00000100:00100000:3.0:1772305938.914036:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305938.914087:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225412096 00000100:00100000:2.0:1772305938.914139:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1184 00000100:00100000:2.0:1772305938.914146:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000024ecc70c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+66:100016:x1858396225412096:12345-192.168.203.30@tcp:58:lfs.0 00000040:00080000:2.0:1772305938.914332:0:54696:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xf:0x0].51, 136 off15128 00000100:00100000:2.0:1772305938.914398:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000024ecc70c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+66:100016:x1858396225412096:12345-192.168.203.30@tcp:58:lfs.0 Request processed in 252us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305938.914405:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1184 00010000:00010000:3.0:1772305939.144806:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1772305939.523890:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305939.523932:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305939.523957:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305939.523961:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225412224 00000100:00100000:0.0:1772305939.523979:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305939.523998:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225412160 00000100:00100000:3.0:1772305939.524004:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225412352 00000100:00100000:0.0:1772305939.524009:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305939.524018:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 168 00000100:00100000:2.0:1772305939.524025:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a17edbba pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+75:2217:x1858396225412224:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:0.0:1772305939.524040:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305939.524046:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225412288 00000100:00100000:1.0:1772305939.524046:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 152 00000100:00100000:1.0:1772305939.524055:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000005fbd592 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2218:x1858396225412160:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1772305939.524072:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225412480 00000100:00100000:0.0:1772305939.524076:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305939.524096:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a17edbba pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+75:2217:x1858396225412224:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 70us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305939.524105:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000005fbd592 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2218:x1858396225412160:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 47us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305939.524106:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225412544 00000100:00100000:2.0:1772305939.524113:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 168 00000100:00100000:1.0:1772305939.524120:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 152 00000100:00100000:3.0:1772305939.524129:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1200 00000100:00100000:3.0:1772305939.524136:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004ab5c349 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+228:2217:x1858396225412352:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1772305939.524137:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225412416 00000100:00100000:1.0:1772305939.524170:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1201 00000100:00100000:2.0:1772305939.524172:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 169 00000100:00100000:3.0:1772305939.524175:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004ab5c349 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+228:2217:x1858396225412352:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 36us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305939.524182:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b975fc8d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+66:2218:x1858396225412416:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1772305939.524187:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1200 00000100:00100000:1.0:1772305939.524187:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000034cdda9e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+225:2218:x1858396225412288:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1772305939.524211:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1202 00000100:00100000:3.0:1772305939.524216:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000269f4b78 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2217:x1858396225412480:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1772305939.524227:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b975fc8d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+66:2218:x1858396225412416:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 45us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305939.524236:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1203 00000100:00100000:1.0:1772305939.524237:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000034cdda9e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+225:2218:x1858396225412288:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 49us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305939.524240:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 169 00000100:00100000:3.0:1772305939.524246:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000269f4b78 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2217:x1858396225412480:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 25us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305939.524250:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000f39354b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+142:2218:x1858396225412544:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:1.0:1772305939.524256:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1201 00000100:00100000:0.0:1772305939.524301:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000f39354b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+142:2218:x1858396225412544:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 38us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305939.524308:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1203 00000100:00100000:3.0:1772305939.524340:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1202 00000040:00080000:1.0:1772305939.720779:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305939.720786:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305939.720845:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 52 count 24 00000040:00080000:1.0:1772305939.720854:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:0.0:1772305940.168728:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1772305940.198021:0:71642:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305940.198026:0:71642:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305940.198095:0:71642:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 52 count 24 00000040:00080000:2.0:1772305940.198099:0:71642:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:2.0:1772305940.198118:0:71642:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305940.198120:0:71642:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305940.198177:0:71642:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 52 count 24 00000040:00080000:2.0:1772305940.198181:0:71642:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:1.0:1772305940.744743:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305940.744749:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305940.744795:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 52 count 24 00000040:00080000:1.0:1772305940.744801:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000001:00080000:1.0:1772305940.946607:0:6332:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-OST0000: transno 4294968320 is committed 00010000:00010000:0.0:1772305941.193782:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1772305941.768764:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305941.768772:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305941.768823:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 52 count 24 00000040:00080000:1.0:1772305941.768830:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:0.0:1772305941.774238:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305941.774299:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225412608 00000100:00100000:1.0:1772305941.774353:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1185 00000100:00100000:1.0:1772305941.774358:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6e261 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+75:100445:x1858396225412608:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1772305941.774386:0:54698:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x32f:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1772305941.774474:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6e261 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+75:100445:x1858396225412608:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 114us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305941.774485:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1185 00000100:00100000:2.0:1772305941.775431:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305941.775478:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225412672 00000100:00100000:1.0:1772305941.775511:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1186 00000100:00100000:1.0:1772305941.775518:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000093b46947 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+75:100446:x1858396225412672:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1772305941.775533:0:54698:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x331:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1772305941.775591:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000093b46947 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+75:100446:x1858396225412672:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 72us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305941.775599:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1186 00000100:00100000:3.0:1772305941.775731:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305941.775769:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225412864 00000100:00100000:1.0:1772305941.775804:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1187 00000100:00100000:1.0:1772305941.775809:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000f58975a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+75:100447:x1858396225412864:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1772305941.775822:0:54698:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x333:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1772305941.775855:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305941.775862:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000f58975a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+75:100447:x1858396225412864:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 51us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305941.775869:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1187 00000100:00100000:1.0:1772305941.775881:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225412800 00000100:00100000:1.0:1772305941.775903:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1188 00000100:00100000:1.0:1772305941.775908:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000acf112ff pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+75:100445:x1858396225412800:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1772305941.775916:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305941.775933:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c701af lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f2f1 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.775983:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c701b6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.776004:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c701b6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.776017:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c701b6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.776030:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000016b42150/0xa5e9c8c58c701bd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3b59db0b bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.776035:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000016b42150/0xa5e9c8c58c701bd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3b59db0b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.776040:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000016b42150/0xa5e9c8c58c701bd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3b59db0b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.776093:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c701c4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x32f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.776103:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c701c4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x32f:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.776110:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c701c4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x32f:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1772305941.776120:0:54698:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x32f:0x0]: returning size 0 00010000:00010000:1.0:1772305941.776231:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c701b6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.776237:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c701b6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.776246:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c701b6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.776250:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a178fe80 already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305941.776253:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c701b6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.776259:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c701b6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.776282:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (00000000c78481f6) 00010000:00010000:1.0:1772305941.776285:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305941.776290:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c701b6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.776297:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a178fe80/0xa5e9c8c58c701b6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.776308:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000016b42150/0xa5e9c8c58c701bd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3b59db0b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.776315:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000016b42150/0xa5e9c8c58c701bd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3b59db0b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.776321:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000016b42150/0xa5e9c8c58c701bd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3b59db0b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.776327:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000016b42150 already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305941.776329:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000016b42150/0xa5e9c8c58c701bd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3b59db0b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.776336:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000016b42150/0xa5e9c8c58c701bd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3b59db0b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.776356:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3b59db0b (00000000c75acf1a) 00010000:00010000:1.0:1772305941.776359:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305941.776361:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000016b42150/0xa5e9c8c58c701bd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3b59db0b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.776367:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000016b42150/0xa5e9c8c58c701bd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3b59db0b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.776398:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000025cc37fd/0xa5e9c8c58c701af lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f2f1 expref: 78 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.776409:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c701c4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x32f:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f2f1 expref: 77 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.776416:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32f:0x0].0x0 (0000000008f76014) 00010000:00010000:1.0:1772305941.776419:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1772305941.776420:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c609f04e, rc 0) 00000100:00100000:1.0:1772305941.776453:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000acf112ff pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+77:100445:x1858396225412800:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 544us (677us total) trans 8589934983 rc 0/0 00000100:00100000:1.0:1772305941.776461:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1188 00000100:00100000:0.0:1772305941.776573:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305941.776615:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225412928 00000100:00100000:1.0:1772305941.776668:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1189 00000100:00100000:1.0:1772305941.776674:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ea7c71cc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+77:100446:x1858396225412928:12345-192.168.203.30@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1772305941.776703:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c701d2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.776714:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c701d2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.776723:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c701d2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.776737:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c701d9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x85ccc03 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.776745:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c701d9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x85ccc03 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.776754:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c701d9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x85ccc03 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305941.776757:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00010000:1.0:1772305941.776777:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000ee5a0681/0xa5e9c8c58c701e0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x331:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.776786:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ee5a0681/0xa5e9c8c58c701e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.776793:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ee5a0681/0xa5e9c8c58c701e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1772305941.776812:0:54698:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x331:0x0]: returning size 0 00000004:00200000:1.0:1772305941.776816:0:54698:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1772305941.776823:0:54698:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000ee5a0681/0xa5e9c8c58c701e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.776832:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c701d2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.776840:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c701d2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305941.776846:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225413056 00010000:00010000:1.0:1772305941.776847:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c701d2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.776854:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d142a9ac already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305941.776857:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c701d2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.776865:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c701d2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.776874:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (00000000c78481f6) 00010000:00010000:1.0:1772305941.776878:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305941.776881:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c701d2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305941.776882:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1190 00010000:00010000:1.0:1772305941.776891:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d142a9ac/0xa5e9c8c58c701d2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305941.776892:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000731263eb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+78:100447:x1858396225413056:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1772305941.776909:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305941.776911:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c701d9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x85ccc03 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.776918:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c701d9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x85ccc03 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305941.776921:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c701e7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f2f8 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.776929:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c701d9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x85ccc03 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.776947:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000001cde7dd0 already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305941.776950:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c701d9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x85ccc03 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.776956:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c701d9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x85ccc03 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.776965:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x85ccc03 (0000000045f3282f) 00010000:00010000:1.0:1772305941.776967:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305941.776969:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c701d9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x85ccc03 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.776975:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001cde7dd0/0xa5e9c8c58c701d9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x85ccc03 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305941.776977:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c701ee lrc: 3/1,0 mode: --/CR res: [0x200000402:0x333:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.776994:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000ee5a0681/0xa5e9c8c58c701e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305941.776996:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c701ee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x333:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.777013:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ee5a0681/0xa5e9c8c58c701e0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305941.777018:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c701ee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x333:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.777024:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000ee5a0681/0xa5e9c8c58c701e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.777043:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ee5a0681 already unused, calling callback (00000000909eb10b) 00010000:00010000:1.0:1772305941.777047:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ee5a0681/0xa5e9c8c58c701e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1772305941.777050:0:54697:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x333:0x0]: returning size 0 00010000:00010000:1.0:1772305941.777058:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ee5a0681/0xa5e9c8c58c701e0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.777067:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x331:0x0].0x0 (00000000228cb01d) 00010000:00010000:1.0:1772305941.777070:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1772305941.777071:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000ee5a0681/0xa5e9c8c58c701e0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x331:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.777077:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ee5a0681/0xa5e9c8c58c701e0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x331:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305941.777123:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c701e7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f2f8 expref: 81 pid: 54697 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305941.777126:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ea7c71cc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+81:100446:x1858396225412928:12345-192.168.203.30@tcp:34:lhsmtool_posix.0 Request processed in 450us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305941.777143:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1189 00010000:00010000:3.0:1772305941.777150:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c701ee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x333:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f2f8 expref: 80 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305941.777160:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x333:0x0].0x0 (000000009dcfc2b9) 00010000:00010000:3.0:1772305941.777163:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1772305941.777165:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000617aea8a, rc 0) 00000100:00100000:3.0:1772305941.777190:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000731263eb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+79:100447:x1858396225413056:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 299us (437us total) trans 8589934984 rc 0/0 00000100:00100000:3.0:1772305941.777199:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1190 00000100:00100000:0.0:1772305941.777533:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305941.777581:0:5494:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225413120 00000100:00100000:2.0:1772305941.777613:0:5494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1053 00000100:00100000:2.0:1772305941.777616:0:5494:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bfe1381b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+79:2217:x1858396225413120:12345-192.168.203.30@tcp:103:ldlm_bl_08.0 00010000:00010000:2.0:1772305941.777645:0:5494:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1772305941.777657:0:5494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c609f04e/0xa5e9c8c58c701c4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x32f:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f2f1 expref: 79 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.777670:0:5494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32f:0x0].0x0 (0000000008f76014) 00010000:00010000:2.0:1772305941.777675:0:5494:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1772305941.777710:0:5494:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bfe1381b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+78:2217:x1858396225413120:12345-192.168.203.30@tcp:103:ldlm_bl_08.0 Request processed in 91us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305941.777719:0:5494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1053 00000100:00100000:3.0:1772305941.777741:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305941.777782:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225413184 00000100:00100000:1.0:1772305941.777815:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5783 00000100:00100000:1.0:1772305941.777823:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c9f16044 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+228:2216:x1858396225413184:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1772305941.777848:0:6306:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000017162762/0xa5e9c8c58c701fc lrc: 3/1,0 mode: --/PR res: [0x1b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.777859:0:6306:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305941.777862:0:6306:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305941.777867:0:6306:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017162762/0xa5e9c8c58c701fc lrc: 3/1,0 mode: PR/PR res: [0x1b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.777878:0:6306:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000017162762/0xa5e9c8c58c701fc lrc: 3/1,0 mode: PR/PR res: [0x1b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.777896:0:6306:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000017162762/0xa5e9c8c58c701fc lrc: 3/1,0 mode: PR/PR res: [0x1b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.777905:0:6306:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000017162762/0xa5e9c8c58c701fc lrc: 2/0,0 mode: PR/PR res: [0x1b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.777922:0:6306:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1772305941.777943:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00010000:2.0:1772305941.777949:0:6322:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1772305941.777954:0:6322:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000017162762/0xa5e9c8c58c701fc lrc: 2/0,0 mode: PR/PR res: [0x1b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305941.777959:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c9f16044 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+228:2216:x1858396225413184:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 Request processed in 133us (217us total) trans 0 rc 0/0 00010000:00010000:2.0:1772305941.777969:0:6322:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000017162762 already unused, calling callback (00000000b5e4f3c0) 00010000:00010000:2.0:1772305941.777974:0:6322:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000017162762/0xa5e9c8c58c701fc lrc: 2/0,0 mode: PR/PR res: [0x1b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305941.777975:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5783 00000100:00100000:3.0:1772305941.777979:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225413248 00010000:00010000:2.0:1772305941.777989:0:6322:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000017162762/0xa5e9c8c58c701fc lrc: 3/0,0 mode: PR/PR res: [0x1b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.778004:0:6322:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000017162762/0xa5e9c8c58c701fc lrc: 1/0,0 mode: --/PR res: [0x1b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.778010:0:6322:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000017162762/0xa5e9c8c58c701fc lrc: 0/0,0 mode: --/PR res: [0x1b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305941.778020:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1191 00000100:00100000:3.0:1772305941.778029:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000242e6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+78:100446:x1858396225413248:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00010000:00010000:2.0:1772305941.778029:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1772305941.778032:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1772305941.778034:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:3.0:1772305941.778050:0:54697:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x331:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1772305941.778164:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000242e6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+78:100446:x1858396225413248:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 135us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305941.778172:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1191 00000100:00100000:0.0:1772305941.778285:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305941.778323:0:5494:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225413312 00000100:00100000:2.0:1772305941.778349:0:5494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1054 00000100:00100000:2.0:1772305941.778353:0:5494:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008f14ee0c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+78:2215:x1858396225413312:12345-192.168.203.30@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1772305941.778359:0:5494:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1772305941.778368:0:5494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c701ee lrc: 0/0,0 mode: --/CR res: [0x200000402:0x333:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f2f8 expref: 78 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.778377:0:5494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x333:0x0].0x0 (000000009dcfc2b9) 00010000:00010000:2.0:1772305941.778379:0:5494:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1772305941.778407:0:5494:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008f14ee0c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+77:2215:x1858396225413312:12345-192.168.203.30@tcp:103:ldlm_bl_03.0 Request processed in 54us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305941.778413:0:5494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1054 00000100:00100000:0.0:1772305941.778599:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305941.778676:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225413440 00000100:00100000:1.0:1772305941.778722:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1192 00000100:00100000:1.0:1772305941.778728:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fd6a7d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+77:100447:x1858396225413440:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1772305941.778756:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305941.778781:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225413568 00000100:00100000:2.0:1772305941.778809:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1193 00000100:00100000:2.0:1772305941.778815:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000361b5fba pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+78:100445:x1858396225413568:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1772305941.778860:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000361b5fba pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+78:100445:x1858396225413568:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 44us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305941.778869:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1193 00000040:00080000:1.0:1772305941.778948:0:54697:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305941.778951:0:54697:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305941.778992:0:54697:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 49 count 24 00000040:00080000:1.0:1772305941.778997:0:54697:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 4 count 2 00000100:00100000:1.0:1772305941.779029:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fd6a7d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+78:100447:x1858396225413440:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 301us (432us total) trans 8589934985 rc 0/0 00000100:00100000:1.0:1772305941.779035:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1192 00000100:00100000:3.0:1772305941.779129:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305941.779180:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225413696 00000100:00100000:1.0:1772305941.779203:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1194 00000100:00100000:1.0:1772305941.779208:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009e8df762 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+78:100446:x1858396225413696:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1772305941.779217:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305941.779226:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c70203 lrc: 2/0,0 mode: --/CW res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f2ff expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.779546:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c7020a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x335:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.779554:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c7020a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x335:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.779560:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c7020a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x335:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1772305941.779565:0:54697:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x335:0x0]: returning size 0 00010000:00010000:1.0:1772305941.779584:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000295bd7c/0xa5e9c8c58c70203 lrc: 0/0,0 mode: --/CW res: [0x200000408:0x95:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f2ff expref: 81 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.779592:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c7020a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x335:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f2ff expref: 80 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.779597:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x335:0x0].0x0 (0000000067720f33) 00010000:00010000:1.0:1772305941.779599:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1772305941.779600:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a84c62ba, rc 0) 00000100:00100000:1.0:1772305941.779652:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009e8df762 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+80:100446:x1858396225413696:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 416us (499us total) trans 8589934986 rc 0/0 00000100:00100000:1.0:1772305941.779660:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1194 00000100:00100000:0.0:1772305941.780822:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305941.780855:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225413824 00000100:00100000:1.0:1772305941.780904:0:54699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 155 00000100:00100000:1.0:1772305941.780909:0:54699:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003a8b295f pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+80:100447:x1858396225413824:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1772305941.781020:0:54699:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003a8b295f pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+81:100447:x1858396225413824:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 110us (200us total) trans 8589934987 rc 0/0 00000100:00100000:1.0:1772305941.781032:0:54699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 155 00000100:00100000:0.0:1772305941.781034:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305941.781084:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225413888 00000100:00100000:2.0:1772305941.781114:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1195 00000100:00100000:2.0:1772305941.781118:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000019df2d37 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+81:100445:x1858396225413888:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1772305941.781127:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305941.781136:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c70218 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f306 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.781168:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e8ea7e31/0xa5e9c8c58c7021f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x32f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.781175:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e8ea7e31/0xa5e9c8c58c7021f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.781182:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e8ea7e31/0xa5e9c8c58c7021f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1772305941.781198:0:54697:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x32f:0x0]: returning size 0 00000004:00200000:2.0:1772305941.781200:0:54697:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1772305941.781209:0:54697:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000e8ea7e31/0xa5e9c8c58c7021f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305941.781220:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00010000:2.0:1772305941.781223:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e8ea7e31/0xa5e9c8c58c7021f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.781241:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c70218 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f306 expref: 83 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.781254:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000e8ea7e31/0xa5e9c8c58c7021f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f306 expref: 82 pid: 54697 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305941.781259:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225414016 00010000:00010000:2.0:1772305941.781261:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32f:0x0].0x0 (0000000008f76014) 00010000:00010000:2.0:1772305941.781263:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1772305941.781265:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e8ea7e31, rc 0) 00000100:00100000:1.0:1772305941.781300:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1196 00000100:00100000:1.0:1772305941.781306:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ea17b2f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+83:100446:x1858396225414016:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00000100:00100000:2.0:1772305941.781307:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000019df2d37 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+83:100445:x1858396225413888:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 189us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305941.781314:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1195 00010000:00010000:1.0:1772305941.781338:0:54698:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1772305941.781349:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a84c62ba/0xa5e9c8c58c7020a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x335:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f2ff expref: 82 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.781363:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x335:0x0].0x0 (0000000067720f33) 00010000:00010000:1.0:1772305941.781369:0:54698:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1772305941.781381:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c70226 lrc: 3/0,1 mode: --/CW res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.781398:0:54698:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c70027 lrc: 2/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f273 expref: 65 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.781402:0:54698:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c70226 lrc: 4/0,1 mode: --/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.781424:0:54698:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c70027 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f273 expref: 65 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.781432:0:54698:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c70027 lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f273 expref: 65 pid: 54697 timeout: 1353 lvb_type: 0 00000100:00100000:1.0:1772305941.781441:0:54698:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a9712d04 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:54698:1858396216611968:192.168.203.30@tcp:104: 00000100:00100000:1.0:1772305941.781484:0:54698:0:(client.c:2500:ptlrpc_set_wait()) set 000000006631e0ff going to sleep for 6 seconds 00000100:00100000:3.0:1772305941.782292:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305941.782325:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225414080 00000100:00100000:1.0:1772305941.782350:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5784 00000100:00100000:1.0:1772305941.782355:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000076169a73 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+228:2216:x1858396225414080:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1772305941.782361:0:6306:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305941.782370:0:6306:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048d87789/0xa5e9c8c58c7022d lrc: 2/0,0 mode: --/PR res: [0x1b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f30d expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.782383:0:6306:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305941.782385:0:6306:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305941.782389:0:6306:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048d87789/0xa5e9c8c58c7022d lrc: 3/0,0 mode: PR/PR res: [0x1b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f30d expref: 229 pid: 6306 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1772305941.782397:0:6306:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000048d87789/0xa5e9c8c58c7022d lrc: 3/0,0 mode: PR/PR res: [0x1b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f30d expref: 229 pid: 6306 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1772305941.782404:0:6306:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000048d87789, rc 0) 00000100:00100000:1.0:1772305941.782429:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000076169a73 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+229:2216:x1858396225414080:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 74us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305941.782435:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5784 00000100:00100000:2.0:1772305941.782497:0:54698:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a9712d04 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:54698:1858396216611968:192.168.203.30@tcp:104: 00000100:00100000:3.0:1772305941.782519:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00010000:2.0:1772305941.782520:0:54698:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c70226 lrc: 3/0,1 mode: --/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305941.782573:0:5494:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225414144 00010000:00010000:1.0:1772305941.782590:0:5494:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c70027 lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f273 expref: 66 pid: 54697 timeout: 1353 lvb_type: 0 00000100:00100000:1.0:1772305941.782617:0:5494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3155 00000100:00100000:1.0:1772305941.782623:0:5494:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c8b46b0c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+66:2215:x1858396225414144:12345-192.168.203.30@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1772305941.782658:0:5494:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1772305941.782663:0:5494:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c70027 lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f273 expref: 66 pid: 54697 timeout: 1353 lvb_type: 0 00010000:00010000:1.0:1772305941.782676:0:5494:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c70027 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x95:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f273 expref: 66 pid: 54697 timeout: 1353 lvb_type: 0 00010000:00010000:1.0:1772305941.782694:0:5494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c70027 lrc: 0/0,0 mode: --/PR res: [0x200000408:0x95:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f273 expref: 66 pid: 54697 timeout: 1353 lvb_type: 0 00010000:00010000:1.0:1772305941.782702:0:5494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0x0 (00000000fbf66531) 00010000:00010000:1.0:1772305941.782704:0:5494:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c70226 lrc: 3/0,1 mode: --/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.782709:0:5494:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c70226 lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.782713:0:5494:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c70226 lrc: 4/0,1 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.782730:0:5494:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1772305941.782751:0:54698:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c70226 lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305941.782755:0:5494:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c8b46b0c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+65:2215:x1858396225414144:12345-192.168.203.30@tcp:103:ldlm_bl_04.0 Request processed in 132us (240us total) trans 0 rc 0/0 00010000:00010000:2.0:1772305941.782761:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c70226 lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305941.782764:0:5494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3155 00010000:00010000:2.0:1772305941.782778:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c70234 lrc: 3/0,1 mode: --/PW res: [0x200000408:0x95:0x0].0x3ef1c9dc bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.782787:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c70234 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x95:0x0].0x3ef1c9dc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.782795:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c70234 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x95:0x0].0x3ef1c9dc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.782845:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c70226 lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.782852:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c70226 lrc: 2/0,0 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.782869:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c70226 lrc: 3/0,0 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.782875:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000043f9fbca already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305941.782878:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c70226 lrc: 3/0,0 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.782885:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c70226 lrc: 4/0,0 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.782891:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0x0 (00000000fbf66531) 00010000:00010000:2.0:1772305941.782893:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305941.782895:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c70226 lrc: 2/0,0 mode: --/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.782902:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000043f9fbca/0xa5e9c8c58c70226 lrc: 0/0,0 mode: --/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.782910:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c70234 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x95:0x0].0x3ef1c9dc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.782913:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c70234 lrc: 2/0,0 mode: PW/PW res: [0x200000408:0x95:0x0].0x3ef1c9dc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.782917:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c70234 lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x95:0x0].0x3ef1c9dc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.782921:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000004e3177f5 already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305941.782922:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c70234 lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x95:0x0].0x3ef1c9dc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.782926:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c70234 lrc: 4/0,0 mode: PW/PW res: [0x200000408:0x95:0x0].0x3ef1c9dc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.782930:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0x3ef1c9dc (0000000088c8ea8b) 00010000:00010000:2.0:1772305941.782931:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305941.782932:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c70234 lrc: 2/0,0 mode: --/PW res: [0x200000408:0x95:0x0].0x3ef1c9dc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.782935:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c70234 lrc: 0/0,0 mode: --/PW res: [0x200000408:0x95:0x0].0x3ef1c9dc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305941.782970:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ea17b2f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+81:100446:x1858396225414016:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 1664us (1760us total) trans 0 rc -2/-2 00000100:00100000:2.0:1772305941.782978:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1196 00000100:00100000:3.0:1772305941.783337:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305941.783385:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225414272 00000100:00100000:2.0:1772305941.783427:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1197 00000100:00100000:2.0:1772305941.783433:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d02fd03d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+81:100445:x1858396225414272:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1772305941.783495:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d02fd03d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+81:100445:x1858396225414272:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 63us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305941.783501:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1197 00000100:00100000:0.0:1772305941.783764:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305941.783804:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225414336 00000100:00100000:2.0:1772305941.783838:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1198 00000100:00100000:2.0:1772305941.783843:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004668f3b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+81:100446:x1858396225414336:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1772305941.783852:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305941.783862:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c7023b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x335:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f314 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.783882:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c70242 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x335:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.783891:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c70242 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x335:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.783900:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c70242 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x335:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.783963:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c7023b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x335:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f314 expref: 83 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.783976:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000007319ba46/0xa5e9c8c58c70242 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x335:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f314 expref: 82 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.783984:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x335:0x0].0x0 (00000000fc961c4f) 00010000:00010000:2.0:1772305941.783986:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1772305941.783988:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007319ba46, rc 0) 00000100:00100000:2.0:1772305941.784023:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004668f3b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+82:100446:x1858396225414336:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 179us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305941.784031:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1198 00000100:00100000:0.0:1772305941.784605:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305941.784661:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225414400 00000100:00100000:2.0:1772305941.784685:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1199 00000100:00100000:2.0:1772305941.784696:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007eaa6db7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+82:100445:x1858396225414400:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1772305941.784710:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305941.784720:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c70249 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x32f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f31b expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.784738:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000002baedb3/0xa5e9c8c58c70250 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x32f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.784747:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000002baedb3/0xa5e9c8c58c70250 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32f:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.784756:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000002baedb3/0xa5e9c8c58c70250 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32f:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305941.784798:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00010000:2.0:1772305941.784807:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c70249 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x32f:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f31b expref: 84 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.784821:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000002baedb3/0xa5e9c8c58c70250 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f31b expref: 83 pid: 54698 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305941.784828:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225414528 00010000:00010000:2.0:1772305941.784836:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32f:0x0].0x0 (0000000008f76014) 00010000:00010000:2.0:1772305941.784839:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1772305941.784841:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000002baedb3, rc 0) 00000100:00100000:1.0:1772305941.784858:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1200 00000100:00100000:1.0:1772305941.784864:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c0b7c50f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:100446:x1858396225414528:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00000100:00100000:2.0:1772305941.784878:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007eaa6db7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:100445:x1858396225414400:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 184us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305941.784886:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1199 00010000:00010000:1.0:1772305941.784897:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000480c2697/0xa5e9c8c58c70257 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x335:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.784907:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000480c2697/0xa5e9c8c58c70257 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x335:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.784913:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000480c2697/0xa5e9c8c58c70257 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x335:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1772305941.785015:0:54697:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000c0b7c50f reply state 0000000012fc9e30 transno 8589934988 ns: mdt-lustre-MDT0000_UUID lock: 00000000480c2697/0xa5e9c8c58c70257 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x335:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305941.785061:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c0b7c50f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+85:100446:x1858396225414528:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 196us (264us total) trans 8589934988 rc 0/0 00000100:00100000:1.0:1772305941.785067:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1200 00010000:00010000:2.0:1772305941.785681:0:2978:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000480c2697/0xa5e9c8c58c70257 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x335:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.785699:0:2978:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000480c2697/0xa5e9c8c58c70257 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x335:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.785707:0:2978:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000480c2697/0xa5e9c8c58c70257 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x335:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.785717:0:2978:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000480c2697 already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305941.785720:0:2978:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000480c2697/0xa5e9c8c58c70257 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x335:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.785727:0:2978:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000480c2697/0xa5e9c8c58c70257 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x335:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.785737:0:2978:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x335:0x0].0x0 (00000000fc961c4f) 00010000:00010000:2.0:1772305941.785740:0:2978:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1772305941.785743:0:2978:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000480c2697/0xa5e9c8c58c70257 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x335:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.785749:0:2978:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000480c2697/0xa5e9c8c58c70257 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x335:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305941.785835:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305941.785869:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225414592 00000100:00100000:1.0:1772305941.785897:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1201 00000100:00100000:1.0:1772305941.785902:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fe12e717 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:100446:x1858396225414592:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1772305941.785913:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305941.785922:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000023e766ad/0xa5e9c8c58c7025e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x335:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f322 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.785950:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000023e766ad/0xa5e9c8c58c7025e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x335:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f322 expref: 85 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.785957:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000023e766ad/0xa5e9c8c58c7025e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x335:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f322 expref: 85 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.785962:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x335:0x0].0x0 (00000000fc961c4f) 00010000:00010000:1.0:1772305941.785964:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1772305941.785965:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000023e766ad, rc 0) 00000100:00100000:1.0:1772305941.785988:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fe12e717 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+85:100446:x1858396225414592:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 86us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305941.785992:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1201 00000100:00100000:0.0:1772305941.786182:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305941.786220:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225414656 00000100:00100000:1.0:1772305941.786245:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1202 00000100:00100000:1.0:1772305941.786249:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009c8bbbd9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+85:100445:x1858396225414656:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1772305941.786265:0:54697:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x32f:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1772305941.786322:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009c8bbbd9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+85:100445:x1858396225414656:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 70us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305941.786330:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1202 00000100:00100000:0.0:1772305941.787021:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305941.787057:0:54699:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225414720 00000100:00100000:1.0:1772305941.787090:0:54699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 156 00000100:00100000:1.0:1772305941.787096:0:54699:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000004473942 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+85:100446:x1858396225414720:12345-192.168.203.30@tcp:49:lhsmtool_posix.0 00000100:00100000:1.0:1772305941.787156:0:54699:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000004473942 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+85:100446:x1858396225414720:12345-192.168.203.30@tcp:49:lhsmtool_posix.0 Request processed in 59us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305941.787163:0:54699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 156 00000100:00100000:3.0:1772305941.787349:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305941.787399:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225414784 00000100:00100000:1.0:1772305941.787434:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5785 00000100:00100000:1.0:1772305941.787440:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001a9ec63b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+229:2216:x1858396225414784:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1772305941.787466:0:6306:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ecdb8dda/0xa5e9c8c58c70265 lrc: 3/1,0 mode: --/PR res: [0x1b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.787481:0:6306:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305941.787483:0:6306:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305941.787488:0:6306:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ecdb8dda/0xa5e9c8c58c70265 lrc: 3/1,0 mode: PR/PR res: [0x1b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.787499:0:6306:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ecdb8dda/0xa5e9c8c58c70265 lrc: 3/1,0 mode: PR/PR res: [0x1b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.787526:0:6306:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ecdb8dda/0xa5e9c8c58c70265 lrc: 3/1,0 mode: PR/PR res: [0x1b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.787534:0:6306:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ecdb8dda/0xa5e9c8c58c70265 lrc: 2/0,0 mode: PR/PR res: [0x1b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.787553:0:6306:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1772305941.787570:0:5496:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1772305941.787575:0:5496:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ecdb8dda/0xa5e9c8c58c70265 lrc: 2/0,0 mode: PR/PR res: [0x1b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305941.787582:0:5496:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ecdb8dda already unused, calling callback (00000000b5e4f3c0) 00010000:00010000:3.0:1772305941.787585:0:5496:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecdb8dda/0xa5e9c8c58c70265 lrc: 2/0,0 mode: PR/PR res: [0x1b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305941.787591:0:5496:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecdb8dda/0xa5e9c8c58c70265 lrc: 3/0,0 mode: PR/PR res: [0x1b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305941.787598:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001a9ec63b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+229:2216:x1858396225414784:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 Request processed in 153us (244us total) trans 0 rc 0/0 00010000:00010000:3.0:1772305941.787607:0:5496:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ecdb8dda/0xa5e9c8c58c70265 lrc: 1/0,0 mode: --/PR res: [0x1b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305941.787612:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5785 00010000:00010000:3.0:1772305941.787618:0:5496:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ecdb8dda/0xa5e9c8c58c70265 lrc: 0/0,0 mode: --/PR res: [0x1b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305941.787648:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1772305941.787650:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1772305941.787652:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1772305941.787852:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305941.787900:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225414912 00000100:00100000:1.0:1772305941.787933:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1203 00000100:00100000:1.0:1772305941.787939:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c9564863 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+85:100446:x1858396225414912:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1772305941.787988:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c9564863 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+85:100446:x1858396225414912:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 48us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305941.787997:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1203 00000100:00100000:0.0:1772305941.788447:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305941.788491:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225415040 00000100:00100000:1.0:1772305941.788522:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1204 00000100:00100000:1.0:1772305941.788528:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000db187a53 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+85:100445:x1858396225415040:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000040:00080000:1.0:1772305941.788776:0:54697:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305941.788780:0:54697:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305941.788856:0:54697:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 47 count 24 00000040:00080000:1.0:1772305941.788864:0:54697:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 4 count 2 00000100:00100000:1.0:1772305941.788909:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000db187a53 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+86:100445:x1858396225415040:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 380us (463us total) trans 8589934989 rc 0/0 00000100:00100000:1.0:1772305941.788920:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1204 00000100:00100000:3.0:1772305941.788991:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305941.789018:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225415168 00000100:00100000:1.0:1772305941.789048:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1205 00000100:00100000:1.0:1772305941.789053:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001774aae5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+86:100446:x1858396225415168:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1772305941.789062:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305941.789072:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004f0eacd6/0xa5e9c8c58c7026c lrc: 2/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f329 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.789123:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000ce9f4b5a/0xa5e9c8c58c70273 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x335:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.789136:0:54697:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 0000000023e766ad/0xa5e9c8c58c7025e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x335:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f322 expref: 87 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.789145:0:54697:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ce9f4b5a/0xa5e9c8c58c70273 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x335:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.789174:0:54697:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 0000000023e766ad/0xa5e9c8c58c7025e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x335:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f322 expref: 87 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.789188:0:54697:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 0000000023e766ad/0xa5e9c8c58c7025e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x335:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f322 expref: 87 pid: 54697 timeout: 1353 lvb_type: 0 00000100:00100000:1.0:1772305941.789201:0:54697:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ca19f1dd pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:54697:1858396216612032:192.168.203.30@tcp:104: 00000100:00100000:1.0:1772305941.789248:0:54697:0:(client.c:2500:ptlrpc_set_wait()) set 00000000e4cefe62 going to sleep for 6 seconds 00000100:00100000:0.0:1772305941.789608:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305941.789683:0:54699:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225415296 00000100:00100000:1.0:1772305941.789713:0:54699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 157 00000100:00100000:1.0:1772305941.789720:0:54699:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000078a97c37 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+88:100445:x1858396225415296:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1772305941.789873:0:54699:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000078a97c37 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+89:100445:x1858396225415296:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 152us (266us total) trans 8589934990 rc 0/0 00000100:00100000:1.0:1772305941.789882:0:54699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 157 00000100:00100000:1.0:1772305941.789987:0:54697:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ca19f1dd pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:54697:1858396216612032:192.168.203.30@tcp:104: 00010000:00010000:1.0:1772305941.790007:0:54697:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 00000000ce9f4b5a/0xa5e9c8c58c70273 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x335:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305941.790155:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305941.790197:0:5494:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225415360 00010000:00010000:1.0:1772305941.790214:0:5494:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 0000000023e766ad/0xa5e9c8c58c7025e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x335:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f322 expref: 89 pid: 54697 timeout: 1353 lvb_type: 0 00000100:00100000:1.0:1772305941.790243:0:5494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3156 00000100:00100000:1.0:1772305941.790248:0:5494:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003132ee1a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+89:2216:x1858396225415360:12345-192.168.203.30@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1772305941.790259:0:5494:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1772305941.790266:0:5494:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 0000000023e766ad/0xa5e9c8c58c7025e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x335:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f322 expref: 89 pid: 54697 timeout: 1353 lvb_type: 0 00010000:00010000:1.0:1772305941.790289:0:5494:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 0000000023e766ad/0xa5e9c8c58c7025e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x335:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f322 expref: 89 pid: 54697 timeout: 1353 lvb_type: 0 00010000:00010000:1.0:1772305941.790301:0:5494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000023e766ad/0xa5e9c8c58c7025e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x335:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f322 expref: 89 pid: 54697 timeout: 1353 lvb_type: 0 00010000:00010000:1.0:1772305941.790312:0:5494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x335:0x0].0x0 (00000000fc961c4f) 00010000:00010000:1.0:1772305941.790314:0:5494:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: 00000000ce9f4b5a/0xa5e9c8c58c70273 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x335:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.790321:0:5494:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000ce9f4b5a/0xa5e9c8c58c70273 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x335:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.790327:0:5494:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ce9f4b5a/0xa5e9c8c58c70273 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x335:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.790347:0:5494:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1772305941.790366:0:54697:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 00000000ce9f4b5a/0xa5e9c8c58c70273 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x335:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305941.790374:0:5494:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003132ee1a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+88:2216:x1858396225415360:12345-192.168.203.30@tcp:103:ldlm_bl_02.0 Request processed in 122us (217us total) trans 0 rc 0/0 00010000:00010000:2.0:1772305941.790384:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ce9f4b5a/0xa5e9c8c58c70273 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x335:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305941.790391:0:5494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3156 00000004:00200000:2.0:1772305941.790402:0:54697:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x335:0x0]: returning size 0 00000004:00080000:2.0:1772305941.790707:0:54697:0:(osp_object.c:1645:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x100010000:0x1b5:0x0], index 1: 0 00010000:00010000:2.0:1772305941.790801:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000ce9f4b5a/0xa5e9c8c58c70273 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x335:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.790811:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ce9f4b5a/0xa5e9c8c58c70273 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x335:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.790818:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000ce9f4b5a/0xa5e9c8c58c70273 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x335:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.790824:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ce9f4b5a already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305941.790827:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ce9f4b5a/0xa5e9c8c58c70273 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x335:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.790832:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ce9f4b5a/0xa5e9c8c58c70273 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x335:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.790839:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x335:0x0].0x0 (00000000fc961c4f) 00010000:00010000:2.0:1772305941.790841:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1772305941.790842:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000ce9f4b5a/0xa5e9c8c58c70273 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x335:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.790851:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ce9f4b5a/0xa5e9c8c58c70273 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x335:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.790873:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000004f0eacd6/0xa5e9c8c58c7026c lrc: 1/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f329 expref: 88 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.790880:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004f0eacd6/0xa5e9c8c58c7026c lrc: 0/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f329 expref: 88 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.790889:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004f0eacd6, rc 0) 00000100:00100000:2.0:1772305941.790923:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001774aae5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+87:100446:x1858396225415168:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 1868us (1933us total) trans 8589934991 rc 301/301 00000100:00100000:2.0:1772305941.790929:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1205 00000100:00100000:0.0:1772305941.791824:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305941.791863:0:54699:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225415488 00000100:00100000:1.0:1772305941.791894:0:54699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 158 00000100:00100000:1.0:1772305941.791900:0:54699:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000090b11f09 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+87:100446:x1858396225415488:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1772305941.792054:0:54699:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000090b11f09 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+88:100446:x1858396225415488:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 152us (229us total) trans 8589934992 rc 0/0 00000100:00100000:1.0:1772305941.792062:0:54699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 158 00000100:00100000:0.0:1772305941.792780:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305941.792819:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225415552 00000100:00100000:2.0:1772305941.792852:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1206 00000100:00100000:2.0:1772305941.792857:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000091bd8ecf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+88:100446:x1858396225415552:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1772305941.792869:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305941.792881:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000869c9ee7/0xa5e9c8c58c70281 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f330 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.792916:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c80483f6/0xa5e9c8c58c70288 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x335:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.792927:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c80483f6/0xa5e9c8c58c70288 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x335:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.792936:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c80483f6/0xa5e9c8c58c70288 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x335:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1772305941.792951:0:54697:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x335:0x0]: returning size 0 00000004:00200000:2.0:1772305941.792954:0:54697:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1772305941.792962:0:54697:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000c80483f6/0xa5e9c8c58c70288 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x335:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.792969:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c80483f6/0xa5e9c8c58c70288 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x335:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.792981:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000869c9ee7/0xa5e9c8c58c70281 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f330 expref: 90 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.792990:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000c80483f6/0xa5e9c8c58c70288 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x335:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f330 expref: 89 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.792994:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x335:0x0].0x0 (00000000fc961c4f) 00010000:00010000:2.0:1772305941.792996:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1772305941.792997:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c80483f6, rc 0) 00000100:00100000:2.0:1772305941.793022:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000091bd8ecf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+89:100446:x1858396225415552:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 165us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305941.793026:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1206 00000100:00100000:3.0:1772305941.793944:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305941.793978:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225415616 00000100:00100000:1.0:1772305941.794005:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5786 00000100:00100000:1.0:1772305941.794008:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009c8771ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+229:2216:x1858396225415616:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1772305941.794015:0:6306:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305941.794027:0:6306:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043c851d7/0xa5e9c8c58c7028f lrc: 2/0,0 mode: --/PR res: [0x1b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f337 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1772305941.794042:0:6306:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x1b5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1772305941.794051:0:6306:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305941.794052:0:6306:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305941.794057:0:6306:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043c851d7/0xa5e9c8c58c7028f lrc: 3/0,0 mode: PR/PR res: [0x1b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f337 expref: 230 pid: 6306 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1772305941.794066:0:6306:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000043c851d7/0xa5e9c8c58c7028f lrc: 3/0,0 mode: PR/PR res: [0x1b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f337 expref: 230 pid: 6306 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1772305941.794073:0:6306:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043c851d7, rc 0) 00000100:00100000:1.0:1772305941.794095:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009c8771ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2216:x1858396225415616:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 86us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305941.794099:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5786 00000100:00100000:0.0:1772305941.794875:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305941.794923:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225415744 00000100:00100000:2.0:1772305941.794976:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1207 00000100:00100000:2.0:1772305941.794984:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bbac71e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+89:100446:x1858396225415744:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1772305941.795047:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bbac71e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+89:100446:x1858396225415744:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 64us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305941.795055:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1207 00000100:00100000:0.0:1772305941.795882:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305941.795916:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225415808 00000100:00100000:2.0:1772305941.795940:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1208 00000100:00100000:2.0:1772305941.795943:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000088035587 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+89:100446:x1858396225415808:12345-192.168.203.30@tcp:44:lhsmtool_posix.0 00000004:00080000:3.0:1772305941.805888:0:54724:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 14 committed 00000001:00080000:3.0:1772305941.805919:0:54724:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934992 is committed 00000100:00100000:2.0:1772305941.805952:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000088035587 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+83:100446:x1858396225415808:12345-192.168.203.30@tcp:44:lhsmtool_posix.0 Request processed in 10003us (10066us total) trans 0 rc 0/0 00000004:00080000:3.0:1772305941.805964:0:54724:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 15 committed 00000100:00100000:2.0:1772305941.805969:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1208 00000100:00100000:3.0:1772305941.807129:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305941.807177:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225415872 00000100:00100000:1.0:1772305941.807212:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5787 00000100:00100000:1.0:1772305941.807216:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000032e68268 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2218:x1858396225415872:12345-192.168.203.30@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1772305941.807291:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000032e68268 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2218:x1858396225415872:12345-192.168.203.30@tcp:16:lhsmtool_posix.0 Request processed in 73us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305941.807302:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5787 00000100:00100000:0.0:1772305941.808374:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305941.808428:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225416000 00000100:00100000:2.0:1772305941.808465:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1209 00000100:00100000:2.0:1772305941.808472:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e2ba2fc8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+79:100446:x1858396225416000:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1772305941.808509:0:54697:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1772305941.808535:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c80483f6/0xa5e9c8c58c70288 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x335:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f330 expref: 79 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.808555:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x335:0x0].0x0 (00000000fc961c4f) 00010000:00010000:2.0:1772305941.808560:0:54697:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1772305941.808585:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000869c9ee7/0xa5e9c8c58c70296 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x335:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.808599:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000869c9ee7/0xa5e9c8c58c70296 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x335:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.808611:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000869c9ee7/0xa5e9c8c58c70296 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x335:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.808661:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000869c9ee7/0xa5e9c8c58c70296 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x335:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.808669:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000869c9ee7/0xa5e9c8c58c70296 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x335:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.808678:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000869c9ee7/0xa5e9c8c58c70296 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x335:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.808686:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000869c9ee7 already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305941.808690:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000869c9ee7/0xa5e9c8c58c70296 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x335:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.808699:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000869c9ee7/0xa5e9c8c58c70296 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x335:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.808709:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x335:0x0].0x0 (00000000fc961c4f) 00010000:00010000:2.0:1772305941.808711:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305941.808714:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000869c9ee7/0xa5e9c8c58c70296 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x335:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.808720:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000869c9ee7/0xa5e9c8c58c70296 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x335:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305941.808784:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e2ba2fc8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+78:100446:x1858396225416000:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 311us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305941.808793:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1209 00000100:00100000:0.0:1772305941.809750:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305941.809791:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225416064 00000100:00100000:2.0:1772305941.809824:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1210 00000100:00100000:2.0:1772305941.809830:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005114ebc1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+78:100446:x1858396225416064:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1772305941.809841:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305941.809854:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cf20b42a/0xa5e9c8c58c7029d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x335:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f33e expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.809893:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cf20b42a/0xa5e9c8c58c7029d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x335:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f33e expref: 79 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.809906:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000cf20b42a/0xa5e9c8c58c7029d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x335:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f33e expref: 79 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.809923:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x335:0x0].0x0 (00000000fc961c4f) 00010000:00010000:2.0:1772305941.809925:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1772305941.809928:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000cf20b42a, rc 0) 00000100:00100000:2.0:1772305941.809961:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005114ebc1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+79:100446:x1858396225416064:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 130us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305941.809969:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1210 00000100:00100000:3.0:1772305941.811001:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305941.811058:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225416128 00000100:00100000:1.0:1772305941.811088:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5788 00000100:00100000:1.0:1772305941.811100:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e43a966f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2218:x1858396225416128:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1772305941.811247:0:6306:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x1b5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1772305941.811249:0:6306:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x1b5:0x0] updating lvb mtime from disk: 0 -> 1772305930 00002000:00010000:1.0:1772305941.811251:0:6306:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x1b5:0x0] updating lvb atime from disk: 0 -> 1772305930 00002000:00010000:1.0:1772305941.811252:0:6306:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x1b5:0x0] updating lvb ctime from disk: 0 -> 1772305930 00002000:00010000:1.0:1772305941.811253:0:6306:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x1b5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1772305941.811291:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e43a966f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+231:2218:x1858396225416128:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 Request processed in 190us (290us total) trans 4294968354 rc 0/0 00000100:00100000:1.0:1772305941.811298:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5788 00000100:00100000:0.0:1772305941.812220:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305941.812283:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225416192 00000100:00100000:1.0:1772305941.812315:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5789 00000100:00100000:1.0:1772305941.812321:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005e7bbe3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+231:2217:x1858396225416192:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1772305941.812350:0:6306:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000023e766ad/0xa5e9c8c58c702a4 lrc: 3/1,0 mode: --/PR res: [0x1b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.812362:0:6306:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305941.812363:0:6306:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305941.812369:0:6306:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023e766ad/0xa5e9c8c58c702a4 lrc: 3/1,0 mode: PR/PR res: [0x1b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.812380:0:6306:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023e766ad/0xa5e9c8c58c702a4 lrc: 3/1,0 mode: PR/PR res: [0x1b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.812396:0:6306:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000023e766ad/0xa5e9c8c58c702a4 lrc: 3/1,0 mode: PR/PR res: [0x1b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.812403:0:6306:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000023e766ad/0xa5e9c8c58c702a4 lrc: 2/0,0 mode: PR/PR res: [0x1b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.812421:0:6306:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1772305941.812439:0:38581:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1772305941.812444:0:38581:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000023e766ad/0xa5e9c8c58c702a4 lrc: 2/0,0 mode: PR/PR res: [0x1b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.812452:0:38581:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000023e766ad already unused, calling callback (00000000b5e4f3c0) 00000100:00100000:1.0:1772305941.812454:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005e7bbe3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+231:2217:x1858396225416192:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 Request processed in 131us (234us total) trans 0 rc 0/0 00010000:00010000:0.0:1772305941.812456:0:38581:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000023e766ad/0xa5e9c8c58c702a4 lrc: 2/0,0 mode: PR/PR res: [0x1b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.812469:0:38581:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000023e766ad/0xa5e9c8c58c702a4 lrc: 3/0,0 mode: PR/PR res: [0x1b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305941.812472:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5789 00010000:00010000:0.0:1772305941.812485:0:38581:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000023e766ad/0xa5e9c8c58c702a4 lrc: 1/0,0 mode: --/PR res: [0x1b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.812489:0:38581:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023e766ad/0xa5e9c8c58c702a4 lrc: 0/0,0 mode: --/PR res: [0x1b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.812500:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1772305941.812502:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1772305941.812503:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1772305941.813249:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305941.813308:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225416320 00000100:00100000:2.0:1772305941.813346:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1211 00000100:00100000:2.0:1772305941.813352:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000774a31b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+79:100446:x1858396225416320:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1772305941.813506:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000dc2935b7/0xa5e9c8c58c702ab lrc: 3/0,1 mode: --/EX res: [0x200000402:0x335:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.813517:0:54697:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000cf20b42a/0xa5e9c8c58c7029d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x335:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f33e expref: 80 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.813524:0:54697:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 00000000dc2935b7/0xa5e9c8c58c702ab lrc: 4/0,1 mode: --/EX res: [0x200000402:0x335:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.813553:0:54697:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000cf20b42a/0xa5e9c8c58c7029d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x335:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f33e expref: 80 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.813573:0:54697:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000cf20b42a/0xa5e9c8c58c7029d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x335:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f33e expref: 80 pid: 54697 timeout: 1353 lvb_type: 0 00000100:00100000:2.0:1772305941.813585:0:54697:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e72c7c57 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:54697:1858396216612096:192.168.203.30@tcp:104: 00000100:00100000:2.0:1772305941.813658:0:54697:0:(client.c:2500:ptlrpc_set_wait()) set 00000000c518b62e going to sleep for 6 seconds 00000100:00100000:2.0:1772305941.814471:0:54697:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e72c7c57 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:54697:1858396216612096:192.168.203.30@tcp:104: 00010000:00010000:2.0:1772305941.814486:0:54697:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 00000000dc2935b7/0xa5e9c8c58c702ab lrc: 3/0,1 mode: --/EX res: [0x200000402:0x335:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305941.814701:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305941.814759:0:5494:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225416384 00010000:00010000:1.0:1772305941.814780:0:5494:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cf20b42a/0xa5e9c8c58c7029d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x335:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f33e expref: 81 pid: 54697 timeout: 1353 lvb_type: 0 00000100:00100000:1.0:1772305941.814813:0:5494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3157 00000100:00100000:1.0:1772305941.814820:0:5494:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006755215f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+81:2215:x1858396225416384:12345-192.168.203.30@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1772305941.814831:0:5494:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1772305941.814835:0:5494:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000cf20b42a/0xa5e9c8c58c7029d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x335:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f33e expref: 81 pid: 54697 timeout: 1353 lvb_type: 0 00010000:00010000:1.0:1772305941.814842:0:5494:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000cf20b42a/0xa5e9c8c58c7029d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x335:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f33e expref: 81 pid: 54697 timeout: 1353 lvb_type: 0 00010000:00010000:1.0:1772305941.814852:0:5494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cf20b42a/0xa5e9c8c58c7029d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x335:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f33e expref: 81 pid: 54697 timeout: 1353 lvb_type: 0 00010000:00010000:1.0:1772305941.814864:0:5494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x335:0x0].0x0 (00000000fc961c4f) 00010000:00010000:1.0:1772305941.814868:0:5494:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: 00000000dc2935b7/0xa5e9c8c58c702ab lrc: 3/0,1 mode: --/EX res: [0x200000402:0x335:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.814876:0:5494:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000dc2935b7/0xa5e9c8c58c702ab lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x335:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.814882:0:5494:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000dc2935b7/0xa5e9c8c58c702ab lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x335:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.814906:0:5494:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1772305941.814927:0:54697:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 00000000dc2935b7/0xa5e9c8c58c702ab lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x335:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.814935:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000dc2935b7/0xa5e9c8c58c702ab lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x335:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305941.814943:0:5494:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006755215f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+80:2215:x1858396225416384:12345-192.168.203.30@tcp:103:ldlm_bl_01.0 Request processed in 119us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305941.814954:0:5494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3157 00000001:00080000:2.0:1772305941.815046:0:54697:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934993 00000001:00080000:2.0:1772305941.815133:0:54697:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934993 00000001:00080000:2.0:1772305941.815159:0:54697:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934993 00000100:00100000:2.0:1772305941.815205:0:54697:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e72c7c57 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:54697:1858396216612160:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1772305941.815239:0:54697:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772305941.815259:0:54697:0:(client.c:2500:ptlrpc_set_wait()) set 00000000935fc697 going to sleep for 6 seconds 00000100:00100000:1.0:1772305941.815293:0:57220:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216612160 00000100:00100000:1.0:1772305941.815331:0:57220:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1772305941.815335:0:57220:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bfe1381b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:54697:x1858396216612160:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1772305941.815398:0:57220:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bfe1381b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:54697:x1858396216612160:12345-0@lo:1000:mdt00_001.0 Request processed in 61us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305941.815405:0:57220:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1772305941.815437:0:54697:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e72c7c57 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:54697:1858396216612160:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1772305941.815584:0:54697:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934993 00000100:00100000:2.0:1772305941.815618:0:54697:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e72c7c57 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:54697:1858396216612224:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1772305941.815669:0:54697:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772305941.815688:0:54697:0:(client.c:2500:ptlrpc_set_wait()) set 00000000c518b62e going to sleep for 6 seconds 00000100:00100000:1.0:1772305941.815707:0:57220:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216612224 00000100:00100000:1.0:1772305941.815734:0:57220:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1772305941.815738:0:57220:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000247170f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:54697:x1858396216612224:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1772305941.815847:0:57220:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000247170f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:54697:x1858396216612224:12345-0@lo:1000:mdt00_001.0 Request processed in 107us (178us total) trans 4294968355 rc 0/0 00000100:00100000:1.0:1772305941.815852:0:57220:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1772305941.815881:0:54697:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e72c7c57 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:54697:1858396216612224:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1772305941.815944:0:54697:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934993 00010000:00010000:2.0:1772305941.815955:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000dc2935b7/0xa5e9c8c58c702ab lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x335:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.815965:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000dc2935b7/0xa5e9c8c58c702ab lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x335:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.815972:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000dc2935b7/0xa5e9c8c58c702ab lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x335:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.815978:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000dc2935b7 already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305941.815981:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000dc2935b7/0xa5e9c8c58c702ab lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x335:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.815988:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000dc2935b7/0xa5e9c8c58c702ab lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x335:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.815997:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x335:0x0].0x0 (00000000fc961c4f) 00010000:00010000:2.0:1772305941.816000:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1772305941.816003:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000dc2935b7/0xa5e9c8c58c702ab lrc: 2/0,0 mode: --/EX res: [0x200000402:0x335:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.816008:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000dc2935b7/0xa5e9c8c58c702ab lrc: 0/0,0 mode: --/EX res: [0x200000402:0x335:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.816025:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c70138 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x331:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.816031:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c70138 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x331:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.816042:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c70138 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x331:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.816048:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000010dea6ba already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305941.816050:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c70138 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x331:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.816055:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c70138 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x331:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.816062:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x331:0x0].0x0 (00000000228cb01d) 00010000:00010000:2.0:1772305941.816064:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1772305941.816066:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c70138 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x331:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.816071:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c70138 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x331:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.816088:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000c80483f6/0xa5e9c8c58c702b2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x331:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.816098:0:54697:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c70154 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f2d5 expref: 64 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.816105:0:54697:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c80483f6/0xa5e9c8c58c702b2 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x331:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.816124:0:54697:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c70154 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f2d5 expref: 64 pid: 55653 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.816140:0:54697:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c70154 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f2d5 expref: 64 pid: 55653 timeout: 1353 lvb_type: 0 00000100:00100000:2.0:1772305941.816150:0:54697:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b94be3cb pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:54697:1858396216612288:192.168.203.30@tcp:104: 00000100:00100000:2.0:1772305941.816186:0:54697:0:(client.c:2500:ptlrpc_set_wait()) set 00000000c518b62e going to sleep for 6 seconds 00000100:00100000:2.0:1772305941.817083:0:54697:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b94be3cb pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:54697:1858396216612288:192.168.203.30@tcp:104: 00010000:00010000:2.0:1772305941.817097:0:54697:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 00000000c80483f6/0xa5e9c8c58c702b2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x331:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305941.817372:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305941.817409:0:5494:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225416448 00010000:00010000:1.0:1772305941.817423:0:5494:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c70154 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f2d5 expref: 65 pid: 55653 timeout: 1353 lvb_type: 0 00000100:00100000:1.0:1772305941.817445:0:5494:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3158 00000100:00100000:1.0:1772305941.817449:0:5494:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000009b41aad pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+65:2216:x1858396225416448:12345-192.168.203.30@tcp:103:ldlm_bl_05.0 00010000:00010000:1.0:1772305941.817456:0:5494:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1772305941.817459:0:5494:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c70154 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f2d5 expref: 65 pid: 55653 timeout: 1353 lvb_type: 0 00010000:00010000:1.0:1772305941.817466:0:5494:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c70154 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x331:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f2d5 expref: 65 pid: 55653 timeout: 1353 lvb_type: 0 00010000:00010000:1.0:1772305941.817476:0:5494:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c70154 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x331:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f2d5 expref: 65 pid: 55653 timeout: 1353 lvb_type: 0 00010000:00010000:1.0:1772305941.817487:0:5494:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x331:0x0].0x0 (00000000228cb01d) 00010000:00010000:1.0:1772305941.817489:0:5494:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: 00000000c80483f6/0xa5e9c8c58c702b2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x331:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.817495:0:5494:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000c80483f6/0xa5e9c8c58c702b2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x331:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.817498:0:5494:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c80483f6/0xa5e9c8c58c702b2 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x331:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.817514:0:5494:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1772305941.817539:0:54697:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 00000000c80483f6/0xa5e9c8c58c702b2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x331:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305941.817545:0:5494:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000009b41aad pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+64:2216:x1858396225416448:12345-192.168.203.30@tcp:103:ldlm_bl_05.0 Request processed in 91us (171us total) trans 0 rc 0/0 00010000:00010000:2.0:1772305941.817555:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c80483f6/0xa5e9c8c58c702b2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x331:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.817568:0:54697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000c80483f6/0xa5e9c8c58c702b2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x331:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305941.817569:0:5494:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3158 00010000:00010000:2.0:1772305941.817578:0:54697:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c80483f6/0xa5e9c8c58c702b2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x331:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.817585:0:54697:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c80483f6/0xa5e9c8c58c702b2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x331:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.817592:0:54697:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c80483f6 already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305941.817595:0:54697:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c80483f6/0xa5e9c8c58c702b2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x331:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.817607:0:54697:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c80483f6/0xa5e9c8c58c702b2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x331:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.817617:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x331:0x0].0x0 (00000000228cb01d) 00010000:00010000:2.0:1772305941.817621:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305941.817623:0:54697:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c80483f6/0xa5e9c8c58c702b2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x331:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.817664:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c80483f6/0xa5e9c8c58c702b2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x331:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1772305941.817740:0:54697:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305941.817744:0:54697:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305941.817825:0:54697:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 48 count 24 00000040:00080000:2.0:1772305941.817832:0:54697:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 4 count 2 00000100:00100000:2.0:1772305941.817890:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000774a31b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+79:100446:x1858396225416320:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 4536us (4640us total) trans 8589934993 rc 0/0 00000100:00100000:2.0:1772305941.817900:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1211 00000040:00080000:1.0:1772305941.817926:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305941.817929:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305941.817973:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 52 count 24 00000040:00080000:1.0:1772305941.817980:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:1.0:1772305941.818101:0:54732:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ca19f1dd pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:54732:1858396216612352:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1772305941.818129:0:54732:0:(client.c:2500:ptlrpc_set_wait()) set 0000000076dc362a going to sleep for 6 seconds 00000100:00100000:3.0:1772305941.818839:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305941.818853:0:54732:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ca19f1dd pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:54732:1858396216612352:192.168.203.30@tcp:107:hsm_cdtr.0 00000040:00080000:1.0:1772305941.818907:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000100:00100000:2.0:1772305941.818909:0:54699:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225416576 00000040:00080000:1.0:1772305941.818910:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000100:00100000:2.0:1772305941.818940:0:54699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 159 00000100:00100000:2.0:1772305941.818944:0:54699:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003bb53c21 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+79:100446:x1858396225416576:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1772305941.819065:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000040:00080000:1.0:1772305941.819071:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 52 count 24 00000040:00080000:1.0:1772305941.819078:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:3.0:1772305941.819114:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225416640 00000100:00100000:3.0:1772305941.819147:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1212 00000100:00100000:3.0:1772305941.819153:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000036860235 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+81:100454:x1858396225416640:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1772305941.819173:0:54697:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x330:0x0] from 18446744073709551615 #0 00000004:00080000:2.0:1772305941.819235:0:54699:0:(mdd_object.c:3529:mdd_close()) Object [0x200000402:0x335:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1772305941.819302:0:54699:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589934994 00000100:00100000:3.0:1772305941.819317:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000036860235 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+81:100454:x1858396225416640:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 162us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305941.819326:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1212 00010000:00010000:2.0:1772305941.819328:0:54699:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000869c9ee7/0xa5e9c8c58c702b9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x335:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54699 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.819342:0:54699:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000869c9ee7/0xa5e9c8c58c702b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x335:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446631285415129280 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 54699 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.819352:0:54699:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000869c9ee7/0xa5e9c8c58c702b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x335:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446631285415129280 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 54699 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305941.819365:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00010000:2.0:1772305941.819367:0:54699:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000869c9ee7/0xa5e9c8c58c702b9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x335:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446631285415129280 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 54699 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.819376:0:54699:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000869c9ee7/0xa5e9c8c58c702b9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x335:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446631285415129280 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 54699 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305941.819383:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225416704 00010000:00010000:2.0:1772305941.819383:0:54699:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000869c9ee7/0xa5e9c8c58c702b9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x335:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446631285415129280 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 54699 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.819404:0:54699:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1772305941.819418:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1213 00010000:00010000:1.0:1772305941.819419:0:5497:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1772305941.819424:0:5497:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000869c9ee7/0xa5e9c8c58c702b9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x335:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446631285415129280 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 54699 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305941.819425:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ca19f1dd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+81:100456:x1858396225416704:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00010000:00010000:1.0:1772305941.819434:0:5497:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000869c9ee7 already unused, calling callback (00000000b5e4f3c0) 00010000:00010000:1.0:1772305941.819437:0:5497:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000869c9ee7/0xa5e9c8c58c702b9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x335:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446631285415129280 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 54699 timeout: 0 lvb_type: 0 00000004:00000080:3.0:1772305941.819439:0:54697:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x334:0x0] from 18446744073709551615 #0 00010000:00010000:1.0:1772305941.819445:0:5497:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000869c9ee7/0xa5e9c8c58c702b9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x335:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446631285415129280 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 54699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.819455:0:5497:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x335:0x0].0x0 (00000000fc961c4f) 00010000:00010000:1.0:1772305941.819459:0:5497:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1772305941.819461:0:5497:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000869c9ee7/0xa5e9c8c58c702b9 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x335:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446631285415129280 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 54699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.819467:0:5497:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000869c9ee7/0xa5e9c8c58c702b9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x335:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446631285415129280 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 54699 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.819482:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1772305941.819484:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1772305941.819486:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1772305941.819493:0:54699:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003bb53c21 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+81:100446:x1858396225416576:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 547us (656us total) trans 8589934994 rc 0/0 00000100:00100000:2.0:1772305941.819501:0:54699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 159 00000100:00100000:0.0:1772305941.819616:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305941.819665:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225416768 00000100:00100000:2.0:1772305941.819697:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1214 00000100:00100000:2.0:1772305941.819703:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008043af1b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+81:100455:x1858396225416768:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1772305941.819718:0:54698:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x332:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1772305941.819768:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ca19f1dd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+81:100456:x1858396225416704:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 154us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305941.819778:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008043af1b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+81:100455:x1858396225416768:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 74us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305941.819784:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1213 00000100:00100000:2.0:1772305941.819795:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1214 00000100:00100000:1.0:1772305941.820599:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305941.820671:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225416896 00000100:00100000:2.0:1772305941.820702:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1215 00000100:00100000:2.0:1772305941.820708:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f63ede85 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+80:100454:x1858396225416896:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1772305941.820720:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305941.820733:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000047eac72e/0xa5e9c8c58c702c0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f345 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305941.820733:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305941.820779:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225417024 00010000:00010000:2.0:1772305941.820782:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000cf20b42a/0xa5e9c8c58c702c7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.820794:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cf20b42a/0xa5e9c8c58c702c7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.820804:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cf20b42a/0xa5e9c8c58c702c7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305941.820818:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1216 00010000:00010000:2.0:1772305941.820819:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c702ce lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xf7fac378 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305941.820830:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000622dfb8f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+82:100456:x1858396225417024:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1772305941.820833:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c702ce lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xf7fac378 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305941.820843:0:54697:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305941.820845:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c702ce lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xf7fac378 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305941.820856:0:54697:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c702d5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f34c expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.820887:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c702dc lrc: 3/1,0 mode: --/CR res: [0x200000402:0x330:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.820897:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c702dc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x330:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.820905:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c702dc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x330:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1772305941.820919:0:54698:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x330:0x0]: returning size 0 00010000:00010000:2.0:1772305941.820980:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000cf20b42a/0xa5e9c8c58c702c7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.820988:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cf20b42a/0xa5e9c8c58c702c7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305941.820992:0:54697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c702ea lrc: 3/1,0 mode: --/CR res: [0x200000402:0x334:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.820996:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cf20b42a/0xa5e9c8c58c702c7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.821017:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cf20b42a already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305941.821023:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cf20b42a/0xa5e9c8c58c702c7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.821030:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cf20b42a/0xa5e9c8c58c702c7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305941.821033:0:54697:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c702ea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x334:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.821044:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (00000000c78481f6) 00000100:00100000:1.0:1772305941.821047:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00010000:2.0:1772305941.821050:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305941.821055:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cf20b42a/0xa5e9c8c58c702c7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305941.821057:0:54697:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c702ea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x334:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.821067:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cf20b42a/0xa5e9c8c58c702c7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1772305941.821077:0:54697:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x334:0x0]: returning size 0 00010000:00010000:2.0:1772305941.821083:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c702ce lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xf7fac378 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.821092:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c702ce lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xf7fac378 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.821100:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c702ce lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xf7fac378 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.821106:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000089dbe966 already unused, calling callback (00000000909eb10b) 00000100:00100000:0.0:1772305941.821108:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225417088 00010000:00010000:2.0:1772305941.821109:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c702ce lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xf7fac378 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.821118:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c702ce lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xf7fac378 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.821127:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xf7fac378 (00000000e64b4432) 00010000:00010000:2.0:1772305941.821130:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305941.821132:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c702ce lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xf7fac378 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.821138:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c702ce lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xf7fac378 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305941.821143:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1217 00000100:00100000:0.0:1772305941.821152:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004f1a5774 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+85:100455:x1858396225417088:12345-192.168.203.30@tcp:34:lhsmtool_posix.0 00000100:00100000:1.0:1772305941.821153:0:54696:0:(service.c:3210:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:1.0:1772305941.821164:0:54696:0:(service.c:3269:ptlrpc_start_thread()) starting thread 'mdt00_005' 00010000:00010000:2.0:1772305941.821175:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000047eac72e/0xa5e9c8c58c702c0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f345 expref: 86 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.821191:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c702dc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x330:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f345 expref: 86 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.821192:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c702f8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.821211:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x330:0x0].0x0 (00000000d9ebda3c) 00010000:00010000:2.0:1772305941.821215:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1772305941.821216:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c702f8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.821218:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e5e5320a, rc 0) 00010000:00010000:0.0:1772305941.821230:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c702f8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305941.821236:0:54697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c702d5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f34c expref: 87 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.821247:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c702ff lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb467831b bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.821255:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c702ff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb467831b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305941.821259:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f63ede85 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+86:100454:x1858396225416896:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 546us (656us total) trans 8589934995 rc 0/0 00010000:00010000:3.0:1772305941.821260:0:54697:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c702ea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x334:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f34c expref: 86 pid: 54697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.821287:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c702ff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb467831b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305941.821291:0:54697:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x334:0x0].0x0 (00000000581d6dd7) 00000100:00100000:2.0:1772305941.821295:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1215 00010000:00010000:3.0:1772305941.821297:0:54697:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1772305941.821301:0:54697:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c6c2d285, rc 0) 00010000:00010000:0.0:1772305941.821317:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c70306 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x332:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.821324:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c70306 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x332:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.821330:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c70306 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x332:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305941.821334:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000622dfb8f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+85:100456:x1858396225417024:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 505us (601us total) trans 8589934996 rc 0/0 00000100:00100000:3.0:1772305941.821345:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1216 00000004:00200000:0.0:1772305941.821348:0:55141:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x332:0x0]: returning size 0 00000004:00200000:0.0:1772305941.821352:0:55141:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1772305941.821358:0:55141:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c70306 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x332:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.821367:0:55141:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c702f8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.821374:0:55141:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c702f8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.821381:0:55141:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c702f8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.821387:0:55141:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000870ce7f2 already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305941.821390:0:55141:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c702f8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.821397:0:55141:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c702f8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.821407:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (00000000c78481f6) 00010000:00010000:0.0:1772305941.821410:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305941.821413:0:55141:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c702f8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.821419:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c702f8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.821429:0:55141:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c702ff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb467831b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.821436:0:55141:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c702ff lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb467831b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.821444:0:55141:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c702ff lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb467831b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.821448:0:55141:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000fd93d0b1 already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305941.821449:0:55141:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c702ff lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb467831b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.821453:0:55141:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c702ff lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb467831b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.821458:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xb467831b (00000000176e8e72) 00010000:00010000:0.0:1772305941.821459:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305941.821461:0:55141:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c702ff lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb467831b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.821464:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c702ff lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb467831b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.821472:0:55141:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c70306 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x332:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.821475:0:55141:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c70306 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x332:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.821479:0:55141:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c70306 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x332:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.821483:0:55141:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000004820b6c already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305941.821484:0:55141:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c70306 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x332:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.821489:0:55141:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c70306 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x332:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.821493:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x332:0x0].0x0 (000000007f5f418e) 00010000:00010000:0.0:1772305941.821495:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305941.821496:0:55141:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c70306 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x332:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.821499:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c70306 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x332:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305941.821531:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004f1a5774 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:100455:x1858396225417088:12345-192.168.203.30@tcp:34:lhsmtool_posix.0 Request processed in 381us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305941.821537:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1217 00000100:00100000:1.0:1772305941.823386:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305941.823439:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225417152 00000100:00100000:0.0:1772305941.823473:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1218 00000100:00100000:0.0:1772305941.823480:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cba49044 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:100455:x1858396225417152:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1772305941.823499:0:55141:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x332:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1772305941.823556:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cba49044 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:100455:x1858396225417152:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 76us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305941.823564:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1218 00000100:00100000:3.0:1772305941.824037:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305941.824067:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305941.824074:0:5494:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225417216 00000100:00100000:3.0:1772305941.824094:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305941.824115:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225417280 00000100:00100000:1.0:1772305941.824128:0:5494:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225417344 00000100:00100000:2.0:1772305941.824139:0:7104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1055 00000100:00100000:2.0:1772305941.824146:0:7104:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003e88e354 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+85:2217:x1858396225417216:12345-192.168.203.30@tcp:103:ldlm_bl_06.0 00010000:00010000:2.0:1772305941.824157:0:7104:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1772305941.824168:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5790 00000100:00100000:3.0:1772305941.824169:0:6323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1056 00010000:00010000:2.0:1772305941.824172:0:7104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c702dc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x330:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f345 expref: 85 pid: 54698 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305941.824182:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a7458d21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+225:2215:x1858396225417280:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 00000100:00100000:3.0:1772305941.824186:0:6323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d2a6474b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2218:x1858396225417344:12345-192.168.203.30@tcp:103:ldlm_bl_06.0 00010000:00010000:2.0:1772305941.824189:0:7104:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x330:0x0].0x0 (00000000d9ebda3c) 00010000:00010000:2.0:1772305941.824195:0:7104:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1772305941.824203:0:6323:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1772305941.824215:0:6306:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c7030d lrc: 3/1,0 mode: --/PR res: [0x1b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305941.824219:0:6323:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c702ea lrc: 0/0,0 mode: --/CR res: [0x200000402:0x334:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f34c expref: 84 pid: 54697 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305941.824228:0:7104:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003e88e354 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2217:x1858396225417216:12345-192.168.203.30@tcp:103:ldlm_bl_06.0 Request processed in 77us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305941.824244:0:7104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1055 00010000:00010000:0.0:1772305941.824244:0:6306:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305941.824248:0:6306:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1772305941.824249:0:6323:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x334:0x0].0x0 (00000000581d6dd7) 00010000:00010000:3.0:1772305941.824253:0:6323:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1772305941.824256:0:6306:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c7030d lrc: 3/1,0 mode: PR/PR res: [0x1b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.824284:0:6306:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c7030d lrc: 3/1,0 mode: PR/PR res: [0x1b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305941.824303:0:6323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d2a6474b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+82:2218:x1858396225417344:12345-192.168.203.30@tcp:103:ldlm_bl_06.0 Request processed in 123us (209us total) trans 0 rc 0/0 00010000:00010000:0.0:1772305941.824307:0:6306:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c7030d lrc: 3/1,0 mode: PR/PR res: [0x1b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305941.824313:0:6323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1056 00010000:00010000:0.0:1772305941.824322:0:6306:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c7030d lrc: 2/0,0 mode: PR/PR res: [0x1b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.824343:0:6306:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1772305941.824358:0:6322:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1772305941.824363:0:6322:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c7030d lrc: 2/0,0 mode: PR/PR res: [0x1b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.824373:0:6322:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000001e903b7f already unused, calling callback (00000000b5e4f3c0) 00010000:00010000:2.0:1772305941.824377:0:6322:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c7030d lrc: 2/0,0 mode: PR/PR res: [0x1b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305941.824383:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a7458d21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+225:2215:x1858396225417280:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 Request processed in 203us (313us total) trans 0 rc 0/0 00010000:00010000:2.0:1772305941.824397:0:6322:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c7030d lrc: 3/0,0 mode: PR/PR res: [0x1b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305941.824402:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5790 00010000:00010000:2.0:1772305941.824418:0:6322:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c7030d lrc: 1/0,0 mode: --/PR res: [0x1b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.824432:0:6322:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c7030d lrc: 0/0,0 mode: --/PR res: [0x1b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.824444:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1772305941.824446:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1772305941.824449:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772305941.824607:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305941.824671:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225417472 00000100:00100000:0.0:1772305941.824708:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1219 00000100:00100000:0.0:1772305941.824715:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c221b79d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+82:100455:x1858396225417472:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1772305941.824729:0:55141:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305941.824742:0:55141:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c70314 lrc: 2/0,0 mode: --/CW res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f353 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305941.824965:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305941.825012:0:71804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225417600 00000100:00100000:2.0:1772305941.825046:0:71804:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1220 00000100:00100000:2.0:1772305941.825053:0:71804:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000166181f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:100456:x1858396225417600:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1772305941.825173:0:55141:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c7031b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x336:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.825190:0:55141:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c7031b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x336:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.825200:0:55141:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c7031b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x336:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55141 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305941.825209:0:55141:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x336:0x0]: returning size 0 00000100:00100000:3.0:1772305941.825215:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00010000:0.0:1772305941.825251:0:55141:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000f7a426e/0xa5e9c8c58c70314 lrc: 0/0,0 mode: --/CW res: [0x200000408:0x95:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f353 expref: 87 pid: 55141 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305941.825254:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225417728 00010000:00010000:0.0:1772305941.825268:0:55141:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c7031b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x336:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f353 expref: 87 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.825291:0:55141:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x336:0x0].0x0 (000000001ccb4b89) 00010000:00010000:0.0:1772305941.825295:0:55141:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1772305941.825298:0:55141:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079ce3603, rc 0) 00000100:00100000:1.0:1772305941.825305:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1221 00000100:00100000:1.0:1772305941.825311:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000083531784 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+87:100454:x1858396225417728:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000040:00080000:2.0:1772305941.825329:0:71804:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305941.825334:0:71804:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000100:00100000:0.0:1772305941.825341:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c221b79d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+87:100455:x1858396225417472:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 625us (733us total) trans 8589934997 rc 0/0 00000100:00100000:0.0:1772305941.825350:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1219 00000100:00100000:1.0:1772305941.825373:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000083531784 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+86:100454:x1858396225417728:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 59us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305941.825383:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1221 00000040:00080000:2.0:1772305941.825431:0:71804:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 52 count 24 00000040:00080000:2.0:1772305941.825438:0:71804:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:2.0:1772305941.825481:0:71804:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000166181f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+85:100456:x1858396225417600:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 428us (516us total) trans 8589934998 rc 0/0 00000100:00100000:2.0:1772305941.825490:0:71804:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1220 00000100:00100000:3.0:1772305941.826993:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305941.827034:0:71804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225417792 00000100:00100000:2.0:1772305941.827067:0:71804:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1222 00000100:00100000:2.0:1772305941.827073:0:71804:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009b3b63a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+85:100454:x1858396225417792:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1772305941.827086:0:71804:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305941.827095:0:71804:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c70329 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f35a expref: -99 pid: 71804 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.827127:0:71804:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c70330 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x330:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 71804 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.827142:0:71804:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c70330 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x330:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 71804 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.827151:0:71804:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c70330 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x330:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 71804 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1772305941.827170:0:71804:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x330:0x0]: returning size 0 00000004:00200000:2.0:1772305941.827174:0:71804:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1772305941.827184:0:71804:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c70330 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x330:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 71804 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.827193:0:71804:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c70330 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x330:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 71804 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.827209:0:71804:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c70329 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f35a expref: 87 pid: 71804 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.827222:0:71804:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000010dea6ba/0xa5e9c8c58c70330 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x330:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f35a expref: 86 pid: 71804 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.827229:0:71804:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x330:0x0].0x0 (00000000d9ebda3c) 00010000:00010000:2.0:1772305941.827232:0:71804:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1772305941.827234:0:71804:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010dea6ba, rc 0) 00000100:00100000:2.0:1772305941.827267:0:71804:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009b3b63a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+86:100454:x1858396225417792:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 192us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305941.827288:0:71804:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1222 00000100:00100000:3.0:1772305941.827369:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305941.827414:0:54699:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225417920 00000100:00100000:2.0:1772305941.827450:0:54699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 160 00000100:00100000:2.0:1772305941.827456:0:54699:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bb867392 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+86:100456:x1858396225417920:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1772305941.827565:0:54699:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bb867392 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+87:100456:x1858396225417920:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 108us (198us total) trans 8589934999 rc 0/0 00000100:00100000:2.0:1772305941.827574:0:54699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 160 00000100:00100000:1.0:1772305941.827675:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305941.827717:0:71804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225418048 00000100:00100000:0.0:1772305941.827756:0:71804:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1223 00000100:00100000:0.0:1772305941.827763:0:71804:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000032bc5322 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+87:100455:x1858396225418048:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1772305941.827790:0:71804:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1772305941.827802:0:71804:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c7031b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x336:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f353 expref: 87 pid: 55141 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.827816:0:71804:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x336:0x0].0x0 (000000001ccb4b89) 00010000:00010000:0.0:1772305941.827823:0:71804:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1772305941.827837:0:71804:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c70337 lrc: 3/0,1 mode: --/CW res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 71804 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.827846:0:71804:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c70337 lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 71804 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.827852:0:71804:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c70337 lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 71804 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.827909:0:71804:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c7033e lrc: 3/0,1 mode: --/PW res: [0x200000408:0x95:0x0].0xe8f3e28e bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 71804 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.827915:0:71804:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c7033e lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x95:0x0].0xe8f3e28e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 71804 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.827919:0:71804:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c7033e lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x95:0x0].0xe8f3e28e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 71804 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.827960:0:71804:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c70337 lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 71804 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.827964:0:71804:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c70337 lrc: 2/0,0 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 71804 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.827968:0:71804:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c70337 lrc: 3/0,0 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 71804 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.827972:0:71804:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000004820b6c already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305941.827974:0:71804:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c70337 lrc: 3/0,0 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 71804 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.827982:0:71804:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c70337 lrc: 4/0,0 mode: CW/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 71804 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.827987:0:71804:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0x0 (00000000fbf66531) 00010000:00010000:0.0:1772305941.827989:0:71804:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305941.827991:0:71804:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c70337 lrc: 2/0,0 mode: --/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71804 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.827994:0:71804:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c70337 lrc: 0/0,0 mode: --/CW res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71804 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.828000:0:71804:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c7033e lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x95:0x0].0xe8f3e28e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 71804 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.828003:0:71804:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c7033e lrc: 2/0,0 mode: PW/PW res: [0x200000408:0x95:0x0].0xe8f3e28e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 71804 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.828007:0:71804:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c7033e lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x95:0x0].0xe8f3e28e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 71804 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.828011:0:71804:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000fd93d0b1 already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305941.828012:0:71804:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c7033e lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x95:0x0].0xe8f3e28e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 71804 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.828015:0:71804:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c7033e lrc: 4/0,0 mode: PW/PW res: [0x200000408:0x95:0x0].0xe8f3e28e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 71804 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.828019:0:71804:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x95:0x0].0xe8f3e28e (00000000176e8e72) 00010000:00010000:0.0:1772305941.828024:0:71804:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305941.828026:0:71804:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c7033e lrc: 2/0,0 mode: --/PW res: [0x200000408:0x95:0x0].0xe8f3e28e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71804 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.828030:0:71804:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c7033e lrc: 0/0,0 mode: --/PW res: [0x200000408:0x95:0x0].0xe8f3e28e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71804 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305941.828064:0:71804:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000032bc5322 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+86:100455:x1858396225418048:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 302us (393us total) trans 0 rc -2/-2 00000100:00100000:0.0:1772305941.828077:0:71804:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1223 00000100:00100000:3.0:1772305941.828178:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305941.828244:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225418112 00000100:00100000:1.0:1772305941.828290:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5791 00000100:00100000:1.0:1772305941.828297:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b29332f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+225:2216:x1858396225418112:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1772305941.828307:0:6306:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305941.828320:0:6306:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023e766ad/0xa5e9c8c58c70345 lrc: 2/0,0 mode: --/PR res: [0x1b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f361 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.828337:0:6306:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305941.828339:0:6306:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305941.828347:0:6306:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023e766ad/0xa5e9c8c58c70345 lrc: 3/0,0 mode: PR/PR res: [0x1b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f361 expref: 226 pid: 6306 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1772305941.828360:0:6306:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000023e766ad/0xa5e9c8c58c70345 lrc: 3/0,0 mode: PR/PR res: [0x1b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f361 expref: 226 pid: 6306 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1772305941.828371:0:6306:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000023e766ad, rc 0) 00000100:00100000:1.0:1772305941.828400:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b29332f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+226:2216:x1858396225418112:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 104us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305941.828408:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5791 00000100:00100000:3.0:1772305941.828831:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305941.828869:0:71804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225418176 00000100:00100000:0.0:1772305941.828901:0:71804:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1224 00000100:00100000:0.0:1772305941.828907:0:71804:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000367e8d8d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+86:100455:x1858396225418176:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1772305941.828918:0:71804:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305941.828928:0:71804:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c7034c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x336:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f368 expref: -99 pid: 71804 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.828944:0:71804:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c70353 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x336:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 71804 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.828953:0:71804:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c70353 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x336:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 71804 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.828960:0:71804:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c70353 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x336:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 71804 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.829016:0:71804:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c7034c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x336:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f368 expref: 88 pid: 71804 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.829029:0:71804:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000034fec1fd/0xa5e9c8c58c70353 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x336:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f368 expref: 87 pid: 71804 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.829035:0:71804:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x336:0x0].0x0 (000000003362a53c) 00010000:00010000:0.0:1772305941.829038:0:71804:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1772305941.829040:0:71804:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000034fec1fd, rc 0) 00000100:00100000:0.0:1772305941.829071:0:71804:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000367e8d8d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+87:100455:x1858396225418176:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 163us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305941.829078:0:71804:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1224 00000100:00100000:3.0:1772305941.829287:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305941.829341:0:71804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225418304 00000100:00100000:0.0:1772305941.829377:0:71804:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1225 00000100:00100000:0.0:1772305941.829385:0:71804:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e782a30d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+87:100454:x1858396225418304:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1772305941.829433:0:71804:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e782a30d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+87:100454:x1858396225418304:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 48us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305941.829442:0:71804:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1225 00000100:00100000:2.0:1772305941.829983:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305941.830020:0:71804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225418432 00000100:00100000:0.0:1772305941.830043:0:71804:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1226 00000100:00100000:0.0:1772305941.830047:0:71804:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b94be3cb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+87:100455:x1858396225418432:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1772305941.830074:0:71804:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c7035a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x336:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 71804 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.830082:0:71804:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c7035a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x336:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 71804 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.830088:0:71804:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c7035a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x336:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 71804 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1772305941.830165:0:71804:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000b94be3cb reply state 000000007ba54c8d transno 8589935000 ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c7035a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x336:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 71804 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305941.830208:0:71804:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b94be3cb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+89:100455:x1858396225418432:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 160us (227us total) trans 8589935000 rc 0/0 00000100:00100000:0.0:1772305941.830214:0:71804:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1226 00000100:00100000:3.0:1772305941.830328:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305941.830374:0:71804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225418496 00000100:00100000:0.0:1772305941.830405:0:71804:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1227 00000100:00100000:0.0:1772305941.830411:0:71804:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bb059566 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+89:100454:x1858396225418496:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1772305941.830419:0:71804:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305941.830427:0:71804:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c70361 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x330:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f36f expref: -99 pid: 71804 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.830439:0:71804:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000cb557b9d/0xa5e9c8c58c70368 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x330:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 71804 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.830445:0:71804:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cb557b9d/0xa5e9c8c58c70368 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x330:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 71804 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.830451:0:71804:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cb557b9d/0xa5e9c8c58c70368 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x330:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 71804 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.830489:0:71804:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c70361 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x330:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f36f expref: 91 pid: 71804 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.830498:0:71804:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000cb557b9d/0xa5e9c8c58c70368 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x330:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f36f expref: 90 pid: 71804 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.830503:0:71804:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x330:0x0].0x0 (00000000d9ebda3c) 00010000:00010000:0.0:1772305941.830505:0:71804:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1772305941.830507:0:71804:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000cb557b9d, rc 0) 00000100:00100000:0.0:1772305941.830531:0:71804:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bb059566 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+90:100454:x1858396225418496:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 121us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305941.830536:0:71804:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1227 00010000:00010000:2.0:1772305941.830716:0:2977:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c7035a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x336:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 71804 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.830727:0:2977:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c7035a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x336:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 71804 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.830734:0:2977:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c7035a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x336:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 71804 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.830741:0:2977:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a7782eea already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305941.830744:0:2977:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c7035a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x336:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 71804 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.830751:0:2977:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c7035a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x336:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 71804 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.830763:0:2977:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x336:0x0].0x0 (000000003362a53c) 00010000:00010000:2.0:1772305941.830767:0:2977:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1772305941.830770:0:2977:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c7035a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x336:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71804 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.830776:0:2977:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c7035a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x336:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71804 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305941.830794:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305941.830831:0:71804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225418560 00000100:00100000:0.0:1772305941.830863:0:71804:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1228 00000100:00100000:0.0:1772305941.830869:0:71804:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000495c9266 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+89:100455:x1858396225418560:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1772305941.830879:0:71804:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305941.830885:0:71804:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c7036f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x336:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f376 expref: -99 pid: 71804 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.830905:0:71804:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c7036f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x336:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f376 expref: 90 pid: 71804 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.830911:0:71804:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c7036f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x336:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f376 expref: 90 pid: 71804 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.830917:0:71804:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x336:0x0].0x0 (000000003362a53c) 00010000:00010000:0.0:1772305941.830919:0:71804:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1772305941.830921:0:71804:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a7ee7d5, rc 0) 00000100:00100000:0.0:1772305941.830946:0:71804:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000495c9266 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+90:100455:x1858396225418560:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 78us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305941.830950:0:71804:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1228 00000100:00100000:1.0:1772305941.831741:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305941.831780:0:71804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225418624 00000100:00100000:0.0:1772305941.831810:0:71804:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1229 00000100:00100000:0.0:1772305941.831815:0:71804:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000043720844 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+90:100454:x1858396225418624:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1772305941.831835:0:71804:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000402:0x330:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1772305941.831883:0:71804:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000043720844 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+90:100454:x1858396225418624:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 68us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305941.831889:0:71804:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1229 00000100:00100000:1.0:1772305941.831918:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305941.831958:0:54699:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225418688 00000100:00100000:0.0:1772305941.831996:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 161 00000100:00100000:0.0:1772305941.832000:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a9712d04 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+90:100455:x1858396225418688:12345-192.168.203.30@tcp:49:lhsmtool_posix.0 00000100:00100000:0.0:1772305941.832042:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a9712d04 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+90:100455:x1858396225418688:12345-192.168.203.30@tcp:49:lhsmtool_posix.0 Request processed in 42us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305941.832047:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 161 00000100:00100000:1.0:1772305941.832610:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305941.832711:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225418752 00000100:00100000:0.0:1772305941.832734:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5792 00000100:00100000:0.0:1772305941.832738:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002254491d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+226:2215:x1858396225418752:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1772305941.832760:0:6306:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000096601b0a/0xa5e9c8c58c70376 lrc: 3/1,0 mode: --/PR res: [0x1b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.832771:0:6306:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305941.832774:0:6306:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1772305941.832776:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00010000:0.0:1772305941.832780:0:6306:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096601b0a/0xa5e9c8c58c70376 lrc: 3/1,0 mode: PR/PR res: [0x1b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.832794:0:6306:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096601b0a/0xa5e9c8c58c70376 lrc: 3/1,0 mode: PR/PR res: [0x1b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.832813:0:6306:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000096601b0a/0xa5e9c8c58c70376 lrc: 3/1,0 mode: PR/PR res: [0x1b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.832826:0:6306:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096601b0a/0xa5e9c8c58c70376 lrc: 2/0,0 mode: PR/PR res: [0x1b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305941.832829:0:71804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225418880 00010000:00010000:0.0:1772305941.832848:0:6306:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1772305941.832865:0:5496:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1772305941.832865:0:71804:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1230 00010000:00010000:3.0:1772305941.832870:0:5496:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096601b0a/0xa5e9c8c58c70376 lrc: 2/0,0 mode: PR/PR res: [0x1b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305941.832872:0:71804:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000da8afc0a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+90:100455:x1858396225418880:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1772305941.832881:0:5496:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000096601b0a already unused, calling callback (00000000b5e4f3c0) 00010000:00010000:3.0:1772305941.832884:0:5496:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096601b0a/0xa5e9c8c58c70376 lrc: 2/0,0 mode: PR/PR res: [0x1b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305941.832892:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002254491d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+226:2215:x1858396225418752:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 Request processed in 149us (280us total) trans 0 rc 0/0 00010000:00010000:3.0:1772305941.832904:0:5496:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096601b0a/0xa5e9c8c58c70376 lrc: 3/0,0 mode: PR/PR res: [0x1b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305941.832907:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5792 00000100:00100000:1.0:1772305941.832917:0:71804:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000da8afc0a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+90:100455:x1858396225418880:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 44us (144us total) trans 0 rc 0/0 00010000:00010000:3.0:1772305941.832921:0:5496:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096601b0a/0xa5e9c8c58c70376 lrc: 1/0,0 mode: --/PR res: [0x1b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305941.832926:0:71804:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1230 00010000:00010000:3.0:1772305941.832929:0:5496:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096601b0a/0xa5e9c8c58c70376 lrc: 0/0,0 mode: --/PR res: [0x1b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305941.832942:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1772305941.832944:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1772305941.832948:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772305941.833681:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305941.833713:0:71804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225419008 00000100:00100000:0.0:1772305941.833747:0:71804:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1231 00000100:00100000:0.0:1772305941.833753:0:71804:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ccd4edae pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+90:100454:x1858396225419008:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1772305941.833869:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000040:00080000:0.0:1772305941.833919:0:71804:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772305941.833923:0:71804:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000100:00100000:3.0:1772305941.833934:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225419136 00000100:00100000:3.0:1772305941.833966:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1232 00000100:00100000:3.0:1772305941.833972:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000054615e61 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+92:100455:x1858396225419136:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1772305941.833983:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305941.833995:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c7037d lrc: 2/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f37d expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1772305941.833999:0:71804:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 50 count 24 00000040:00080000:0.0:1772305941.834009:0:71804:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 4 count 2 00010000:00010000:3.0:1772305941.834046:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c70384 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x336:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305941.834054:0:71804:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ccd4edae pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+93:100454:x1858396225419008:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 300us (376us total) trans 8589935001 rc 0/0 00000100:00100000:0.0:1772305941.834066:0:71804:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1231 00010000:00010000:3.0:1772305941.834069:0:54698:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c7036f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x336:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f376 expref: 93 pid: 71804 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305941.834079:0:54698:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c70384 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x336:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305941.834109:0:54698:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c7036f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x336:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f376 expref: 92 pid: 71804 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305941.834121:0:54698:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c7036f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x336:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f376 expref: 92 pid: 71804 timeout: 1353 lvb_type: 0 00000100:00100000:3.0:1772305941.834141:0:54698:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000051fd3951 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:54698:1858396216612416:192.168.203.30@tcp:104: 00000100:00100000:3.0:1772305941.834221:0:54698:0:(client.c:2500:ptlrpc_set_wait()) set 00000000bfa290c6 going to sleep for 6 seconds 00000100:00100000:2.0:1772305941.834710:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305941.834747:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225419264 00000100:00100000:0.0:1772305941.834782:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 162 00000100:00100000:0.0:1772305941.834790:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000044129035 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+93:100454:x1858396225419264:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1772305941.834948:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000044129035 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+94:100454:x1858396225419264:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 157us (237us total) trans 8589935002 rc 0/0 00000100:00100000:0.0:1772305941.834958:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 162 00000100:00100000:2.0:1772305941.835025:0:54698:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000051fd3951 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:54698:1858396216612416:192.168.203.30@tcp:104: 00010000:00010000:2.0:1772305941.835040:0:54698:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c70384 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x336:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305941.835356:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305941.835381:0:6323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225419328 00010000:00010000:3.0:1772305941.835396:0:6323:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c7036f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x336:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f376 expref: 94 pid: 71804 timeout: 1353 lvb_type: 0 00000100:00100000:2.0:1772305941.835442:0:5495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3159 00000100:00100000:2.0:1772305941.835448:0:5495:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005bcca74c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+94:2216:x1858396225419328:12345-192.168.203.30@tcp:103:ldlm_bl_08.0 00010000:00010000:2.0:1772305941.835460:0:5495:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1772305941.835467:0:5495:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c7036f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x336:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f376 expref: 94 pid: 71804 timeout: 1353 lvb_type: 0 00010000:00010000:2.0:1772305941.835481:0:5495:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c7036f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x336:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f376 expref: 94 pid: 71804 timeout: 1353 lvb_type: 0 00010000:00010000:2.0:1772305941.835493:0:5495:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c7036f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x336:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f376 expref: 94 pid: 71804 timeout: 1353 lvb_type: 0 00010000:00010000:2.0:1772305941.835504:0:5495:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x336:0x0].0x0 (000000003362a53c) 00010000:00010000:2.0:1772305941.835507:0:5495:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c70384 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x336:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.835515:0:5495:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c70384 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x336:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.835527:0:5495:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c70384 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x336:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.835551:0:5495:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1772305941.835556:0:54698:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c70384 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x336:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305941.835563:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c70384 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x336:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1772305941.835571:0:54698:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x336:0x0]: returning size 0 00000100:00100000:2.0:1772305941.835582:0:5495:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005bcca74c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+93:2216:x1858396225419328:12345-192.168.203.30@tcp:103:ldlm_bl_08.0 Request processed in 132us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305941.835592:0:5495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3159 00000004:00080000:3.0:1772305941.835828:0:54698:0:(osp_object.c:1645:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x100000000:0x1b5:0x0], index 0: 0 00010000:00010000:3.0:1772305941.835895:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c70384 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x336:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305941.835901:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c70384 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x336:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305941.835905:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c70384 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x336:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305941.835909:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a0648135 already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305941.835911:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c70384 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x336:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305941.835914:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c70384 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x336:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305941.835922:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x336:0x0].0x0 (000000003362a53c) 00010000:00010000:3.0:1772305941.835923:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1772305941.835925:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c70384 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x336:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305941.835929:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c70384 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x336:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305941.835947:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c7037d lrc: 1/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f37d expref: 93 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305941.835951:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c7037d lrc: 0/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f37d expref: 93 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305941.835956:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c6c2d285, rc 0) 00000100:00100000:3.0:1772305941.835983:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000054615e61 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+92:100455:x1858396225419136:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 2010us (2114us total) trans 8589935003 rc 301/301 00000100:00100000:3.0:1772305941.835990:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1232 00000100:00100000:2.0:1772305941.836986:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305941.837021:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225419456 00000100:00100000:0.0:1772305941.837045:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 163 00000100:00100000:0.0:1772305941.837049:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000053ca4080 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+92:100455:x1858396225419456:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1772305941.837165:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000053ca4080 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+93:100455:x1858396225419456:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 115us (181us total) trans 8589935004 rc 0/0 00000100:00100000:0.0:1772305941.837171:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 163 00000100:00100000:1.0:1772305941.837938:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305941.837969:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225419520 00000100:00100000:3.0:1772305941.837994:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1233 00000100:00100000:3.0:1772305941.837998:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005215dd7f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+93:100455:x1858396225419520:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1772305941.838007:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305941.838015:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c70392 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f384 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305941.838038:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c70399 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x336:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305941.838049:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c70399 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x336:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305941.838055:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c70399 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x336:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1772305941.838069:0:54698:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x336:0x0]: returning size 0 00000004:00200000:3.0:1772305941.838072:0:54698:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1772305941.838083:0:54698:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c70399 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x336:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305941.838092:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c70399 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x336:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305941.838107:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c70392 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x95:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f384 expref: 95 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305941.838120:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c70399 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x336:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f384 expref: 94 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305941.838127:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x336:0x0].0x0 (000000003362a53c) 00010000:00010000:3.0:1772305941.838130:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1772305941.838132:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000051c27e8b, rc 0) 00000100:00100000:3.0:1772305941.838157:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005215dd7f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+94:100455:x1858396225419520:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 158us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305941.838162:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1233 00000100:00100000:1.0:1772305941.839183:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305941.839220:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225419584 00000100:00100000:0.0:1772305941.839249:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5793 00000100:00100000:0.0:1772305941.839254:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cc3c0696 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+226:2215:x1858396225419584:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1772305941.839262:0:6306:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305941.839284:0:6306:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066b8a8ab/0xa5e9c8c58c703a0 lrc: 2/0,0 mode: --/PR res: [0x1b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f38b expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1772305941.839299:0:6306:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x1b5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1772305941.839307:0:6306:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305941.839309:0:6306:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305941.839313:0:6306:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066b8a8ab/0xa5e9c8c58c703a0 lrc: 3/0,0 mode: PR/PR res: [0x1b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f38b expref: 227 pid: 6306 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1772305941.839322:0:6306:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000066b8a8ab/0xa5e9c8c58c703a0 lrc: 3/0,0 mode: PR/PR res: [0x1b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f38b expref: 227 pid: 6306 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1772305941.839329:0:6306:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000066b8a8ab, rc 0) 00000100:00100000:0.0:1772305941.839354:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cc3c0696 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2215:x1858396225419584:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 100us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305941.839360:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5793 00000100:00100000:2.0:1772305941.840334:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305941.840370:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225419712 00000100:00100000:3.0:1772305941.840401:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1234 00000100:00100000:3.0:1772305941.840408:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ab9fc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+94:100455:x1858396225419712:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1772305941.840451:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ab9fc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+94:100455:x1858396225419712:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 44us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305941.840456:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1234 00000100:00100000:1.0:1772305941.841424:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305941.841481:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225419776 00000100:00100000:3.0:1772305941.841530:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1235 00000100:00100000:3.0:1772305941.841537:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000000ce11a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+94:100455:x1858396225419776:12345-192.168.203.30@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1772305941.851799:0:54724:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935004 is committed 00000020:00080000:1.0:1772305941.851854:0:54724:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt 00000000935fc697 refcount 2 committed 0 result 0 batchid 4295052958 00000020:00080000:1.0:1772305941.851860:0:54724:0:(update_trans.c:89:top_multiple_thandle_dump()) st 0000000043550ed2 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th 000000002fb1e96d 00000020:00080000:1.0:1772305941.851864:0:54724:0:(update_trans.c:89:top_multiple_thandle_dump()) st 000000007dee7810 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th 000000005870f56d 00000020:00080000:0.0:1772305941.851895:0:54735:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4295052958 committed batchid 4295052957 00000100:00100000:3.0:1772305941.851955:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000000ce11a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+82:100455:x1858396225419776:12345-192.168.203.30@tcp:44:lhsmtool_posix.0 Request processed in 10407us (10520us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305941.851974:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1235 00000020:00080000:0.0:1772305941.852044:0:54735:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4295052957 00000100:00100000:1.0:1772305941.853261:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305941.853321:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225419840 00000100:00100000:0.0:1772305941.853359:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5794 00000100:00100000:0.0:1772305941.853364:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e2a011a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2218:x1858396225419840:12345-192.168.203.30@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1772305941.853445:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e2a011a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2218:x1858396225419840:12345-192.168.203.30@tcp:16:lhsmtool_posix.0 Request processed in 81us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305941.853452:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5794 00000100:00100000:2.0:1772305941.854394:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305941.854441:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225419968 00000100:00100000:3.0:1772305941.854487:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1236 00000100:00100000:3.0:1772305941.854495:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ddcf1b3f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+82:100455:x1858396225419968:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1772305941.854545:0:54698:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1772305941.854579:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c70399 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x336:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f384 expref: 82 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305941.854603:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x336:0x0].0x0 (000000003362a53c) 00010000:00010000:3.0:1772305941.854609:0:54698:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1772305941.854759:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c703a7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x336:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.854776:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c703a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x336:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.854786:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c703a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x336:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.854810:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c703a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x336:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.854818:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c703a7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x336:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.854826:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c703a7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x336:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.854833:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000089dbe966 already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305941.854839:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c703a7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x336:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.854847:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c703a7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x336:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.854856:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x336:0x0].0x0 (000000003362a53c) 00010000:00010000:2.0:1772305941.854859:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305941.854863:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c703a7 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x336:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.854869:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c703a7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x336:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305941.854935:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ddcf1b3f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+81:100455:x1858396225419968:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 441us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305941.854941:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1236 00000100:00100000:1.0:1772305941.855795:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305941.855832:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225420032 00000100:00100000:2.0:1772305941.855859:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1237 00000100:00100000:2.0:1772305941.855862:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a9712d04 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+81:100455:x1858396225420032:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1772305941.855871:0:54698:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305941.855880:0:54698:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c703ae lrc: 2/0,0 mode: --/CR res: [0x200000402:0x336:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f392 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.855908:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c703ae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x336:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f392 expref: 82 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.855916:0:54698:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c703ae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x336:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f392 expref: 82 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.855933:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x336:0x0].0x0 (000000003362a53c) 00010000:00010000:2.0:1772305941.855935:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1772305941.855937:0:54698:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e5e5320a, rc 0) 00000100:00100000:2.0:1772305941.855966:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a9712d04 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+82:100455:x1858396225420032:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 103us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305941.855971:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1237 00000100:00100000:1.0:1772305941.856876:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305941.856912:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225420096 00000100:00100000:0.0:1772305941.856948:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5795 00000100:00100000:0.0:1772305941.856953:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c8b46b0c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2216:x1858396225420096:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1772305941.857123:0:6306:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x1b5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1772305941.857126:0:6306:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x1b5:0x0] updating lvb mtime from disk: 0 -> 1772305930 00002000:00010000:0.0:1772305941.857128:0:6306:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x1b5:0x0] updating lvb atime from disk: 0 -> 1772305930 00002000:00010000:0.0:1772305941.857129:0:6306:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x1b5:0x0] updating lvb ctime from disk: 0 -> 1772305930 00002000:00010000:0.0:1772305941.857130:0:6306:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x1b5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1772305941.857160:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c8b46b0c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+228:2216:x1858396225420096:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 Request processed in 206us (285us total) trans 4294968321 rc 0/0 00000100:00100000:0.0:1772305941.857166:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5795 00000100:00100000:1.0:1772305941.858049:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305941.858084:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225420160 00000100:00100000:0.0:1772305941.858109:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5796 00000100:00100000:0.0:1772305941.858112:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fca5ff81 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+228:2217:x1858396225420160:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1772305941.858133:0:6306:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c703b5 lrc: 3/1,0 mode: --/PR res: [0x1b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.858144:0:6306:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305941.858146:0:6306:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1772305941.858151:0:6306:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c703b5 lrc: 3/1,0 mode: PR/PR res: [0x1b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.858160:0:6306:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c703b5 lrc: 3/1,0 mode: PR/PR res: [0x1b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.858171:0:6306:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c703b5 lrc: 3/1,0 mode: PR/PR res: [0x1b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.858176:0:6306:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c703b5 lrc: 2/0,0 mode: PR/PR res: [0x1b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.858192:0:6306:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1772305941.858209:0:38581:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1772305941.858214:0:38581:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c703b5 lrc: 2/0,0 mode: PR/PR res: [0x1b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.858222:0:38581:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000809cda8f already unused, calling callback (00000000b5e4f3c0) 00000100:00100000:0.0:1772305941.858223:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fca5ff81 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+228:2217:x1858396225420160:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 Request processed in 109us (175us total) trans 0 rc 0/0 00010000:00010000:1.0:1772305941.858226:0:38581:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c703b5 lrc: 2/0,0 mode: PR/PR res: [0x1b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305941.858233:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5796 00010000:00010000:1.0:1772305941.858247:0:38581:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c703b5 lrc: 3/0,0 mode: PR/PR res: [0x1b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.858261:0:38581:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c703b5 lrc: 1/0,0 mode: --/PR res: [0x1b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.858265:0:38581:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c703b5 lrc: 0/0,0 mode: --/PR res: [0x1b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6306 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.858286:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1772305941.858288:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1772305941.858289:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772305941.858970:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305941.859010:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225420288 00000100:00100000:2.0:1772305941.859040:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1238 00000100:00100000:2.0:1772305941.859045:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003a8b295f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+82:100455:x1858396225420288:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1772305941.859299:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c703bc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x336:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.859315:0:54698:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c703ae lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x336:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f392 expref: 83 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.859323:0:54698:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c703bc lrc: 4/0,1 mode: --/EX res: [0x200000402:0x336:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.859358:0:54698:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c703ae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x336:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f392 expref: 83 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.859372:0:54698:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c703ae lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x336:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f392 expref: 83 pid: 54698 timeout: 1353 lvb_type: 0 00000100:00100000:2.0:1772305941.859387:0:54698:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bbc49ac3 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:54698:1858396216612480:192.168.203.30@tcp:104: 00000100:00100000:2.0:1772305941.859443:0:54698:0:(client.c:2500:ptlrpc_set_wait()) set 0000000009bb8391 going to sleep for 6 seconds 00000100:00100000:2.0:1772305941.859865:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305941.859912:0:71804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225420352 00000100:00100000:0.0:1772305941.859947:0:71804:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1239 00000100:00100000:0.0:1772305941.859955:0:71804:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007b4cc173 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:99828:x1858396225420352:12345-192.168.203.30@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1772305941.860027:0:71804:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007b4cc173 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:99828:x1858396225420352:12345-192.168.203.30@tcp:60:lhsmtool_posix.0 Request processed in 68us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305941.860034:0:71804:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1239 00000100:00100000:2.0:1772305941.860413:0:54698:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bbc49ac3 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:54698:1858396216612480:192.168.203.30@tcp:104: 00010000:00010000:2.0:1772305941.860438:0:54698:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c703bc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x336:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305941.860667:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305941.860714:0:5495:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225420416 00010000:00010000:0.0:1772305941.860734:0:5495:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c703ae lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x336:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f392 expref: 84 pid: 54698 timeout: 1353 lvb_type: 0 00000100:00100000:0.0:1772305941.860758:0:5495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3160 00000100:00100000:0.0:1772305941.860762:0:5495:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bbc49ac3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2216:x1858396225420416:12345-192.168.203.30@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1772305941.860771:0:5495:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1772305941.860775:0:5495:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c703ae lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x336:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f392 expref: 84 pid: 54698 timeout: 1353 lvb_type: 0 00010000:00010000:0.0:1772305941.860783:0:5495:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c703ae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x336:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f392 expref: 84 pid: 54698 timeout: 1353 lvb_type: 0 00010000:00010000:0.0:1772305941.860796:0:5495:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c703ae lrc: 0/0,0 mode: --/CR res: [0x200000402:0x336:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f392 expref: 84 pid: 54698 timeout: 1353 lvb_type: 0 00010000:00010000:0.0:1772305941.860813:0:5495:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x336:0x0].0x0 (000000003362a53c) 00010000:00010000:0.0:1772305941.860816:0:5495:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c703bc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x336:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.860823:0:5495:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c703bc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x336:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.860828:0:5495:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c703bc lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x336:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.860848:0:5495:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1772305941.860869:0:54698:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c703bc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x336:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.860878:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c703bc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x336:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305941.860886:0:5495:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bbc49ac3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+83:2216:x1858396225420416:12345-192.168.203.30@tcp:103:ldlm_bl_03.0 Request processed in 115us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305941.860899:0:5495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3160 00000001:00080000:2.0:1772305941.860978:0:54698:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589935005 00000001:00080000:2.0:1772305941.861057:0:54698:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589935005 00000001:00080000:2.0:1772305941.861083:0:54698:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589935005 00000100:00100000:2.0:1772305941.861142:0:54698:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000044129035 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:54698:1858396216612544:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1772305941.861175:0:54698:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772305941.861192:0:54698:0:(client.c:2500:ptlrpc_set_wait()) set 0000000045bd76cd going to sleep for 6 seconds 00000100:00100000:1.0:1772305941.861215:0:57220:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216612544 00000100:00100000:1.0:1772305941.861244:0:57220:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1772305941.861247:0:57220:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000090b11f09 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:54698:x1858396216612544:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1772305941.861319:0:57220:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000090b11f09 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:54698:x1858396216612544:12345-0@lo:1000:mdt00_002.0 Request processed in 71us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305941.861325:0:57220:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1772305941.861352:0:54698:0:(client.c:2868:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968320 gen 2 00000004:00080000:2.0:1772305941.861358:0:54698:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 0000000085acb02d, transno 4294968320 00000100:00100000:2.0:1772305941.861371:0:54698:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000044129035 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:54698:1858396216612544:0@lo:1000:mdt00_002.0 00000040:00100000:0.0:1772305941.861409:0:54719:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 13 in log [0xb:0x1:0x0] 00000001:00080000:2.0:1772305941.861612:0:54698:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589935005 00000100:00100000:2.0:1772305941.861675:0:54698:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003132ee1a pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:54698:1858396216612608:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1772305941.861707:0:54698:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772305941.861726:0:54698:0:(client.c:2500:ptlrpc_set_wait()) set 0000000009bb8391 going to sleep for 6 seconds 00000100:00100000:1.0:1772305941.861743:0:57220:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216612608 00000100:00100000:1.0:1772305941.861767:0:57220:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1772305941.861770:0:57220:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006755215f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:54698:x1858396216612608:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1772305941.861898:0:57220:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006755215f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:54698:x1858396216612608:12345-0@lo:1000:mdt00_002.0 Request processed in 127us (192us total) trans 4294968322 rc 0/0 00000100:00100000:1.0:1772305941.861904:0:57220:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1772305941.861942:0:54698:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003132ee1a pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:54698:1858396216612608:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1772305941.862001:0:54698:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589935005 00010000:00010000:2.0:1772305941.862010:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c703bc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x336:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.862017:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c703bc lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x336:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.862022:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c703bc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x336:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.862026:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000063369192 already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305941.862028:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c703bc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x336:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.862032:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c703bc lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x336:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.862040:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x336:0x0].0x0 (000000003362a53c) 00010000:00010000:2.0:1772305941.862041:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1772305941.862044:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c703bc lrc: 2/0,0 mode: --/EX res: [0x200000402:0x336:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.862047:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c703bc lrc: 0/0,0 mode: --/EX res: [0x200000402:0x336:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.862061:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c701a8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x332:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.862065:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c701a8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x332:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.862069:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c701a8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x332:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.862076:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000001967872f already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305941.862078:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c701a8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x332:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.862081:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c701a8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x332:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.862085:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x332:0x0].0x0 (000000007f5f418e) 00010000:00010000:2.0:1772305941.862086:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1772305941.862087:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c701a8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x332:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.862090:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c701a8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x332:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.862108:0:54698:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c703c3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x332:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.862114:0:54698:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c703c3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x332:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.862119:0:54698:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c703c3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x332:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.862123:0:54698:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c703c3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x332:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.862126:0:54698:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c703c3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x332:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.862132:0:54698:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c703c3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x332:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.862135:0:54698:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000004e3177f5 already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305941.862136:0:54698:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c703c3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x332:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.862139:0:54698:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c703c3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x332:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.862143:0:54698:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x332:0x0].0x0 (000000008fd1be63) 00010000:00010000:2.0:1772305941.862144:0:54698:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305941.862146:0:54698:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c703c3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x332:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305941.862149:0:54698:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c703c3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x332:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54698 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1772305941.862209:0:54698:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305941.862212:0:54698:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305941.862287:0:54698:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 51 count 24 00000040:00080000:2.0:1772305941.862293:0:54698:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 4 count 2 00000100:00100000:2.0:1772305941.862347:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003a8b295f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+82:100455:x1858396225420288:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 3301us (3377us total) trans 8589935005 rc 0/0 00000100:00100000:2.0:1772305941.862355:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1238 00000040:00080000:1.0:1772305941.862401:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305941.862405:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305941.862840:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 24 00000040:00080000:1.0:1772305941.862848:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:2.0:1772305941.865355:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305941.865411:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225420544 00000100:00100000:0.0:1772305941.865443:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 164 00000100:00100000:0.0:1772305941.865447:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000044129035 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+82:100455:x1858396225420544:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1772305941.865703:0:57054:0:(mdd_object.c:3529:mdd_close()) Object [0x200000402:0x336:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1772305941.865745:0:57054:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 8589935006 00010000:00010000:0.0:1772305941.865763:0:57054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c703ca lrc: 3/0,1 mode: --/PW res: [0x200000402:0x336:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.865774:0:57054:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c703ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x336:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446631280743258432 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.865782:0:57054:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c703ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x336:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446631280743258432 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.865788:0:57054:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c703ca lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x336:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446631280743258432 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.865792:0:57054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c703ca lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x336:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446631280743258432 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.865796:0:57054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c703ca lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x336:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446631280743258432 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305941.865810:0:57054:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1772305941.865853:0:5497:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1772305941.865860:0:5497:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c703ca lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x336:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446631280743258432 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.865870:0:5497:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a68ed1bf already unused, calling callback (00000000b5e4f3c0) 00010000:00010000:1.0:1772305941.865874:0:5497:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c703ca lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x336:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446631280743258432 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.865883:0:5497:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c703ca lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x336:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446631280743258432 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.865896:0:5497:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x336:0x0].0x0 (000000003362a53c) 00010000:00010000:1.0:1772305941.865899:0:5497:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1772305941.865903:0:5497:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c703ca lrc: 1/0,0 mode: --/PW res: [0x200000402:0x336:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446631280743258432 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1772305941.865910:0:5497:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c703ca lrc: 0/0,0 mode: --/PW res: [0x200000402:0x336:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446631280743258432 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 57054 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305941.865915:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000044129035 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+83:100455:x1858396225420544:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 462us (558us total) trans 8589935006 rc 0/0 00000100:00100000:0.0:1772305941.865933:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 164 00010000:00010000:1.0:1772305941.865941:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1772305941.865944:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1772305941.865946:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1772305941.960758:0:2994:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1772305941.960762:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000120e5172 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216612672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1772305941.960781:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000763eeae7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216612736:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1772305941.960860:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305941.960902:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305941.960909:0:6310:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216612736 00000100:00100000:1.0:1772305941.960952:0:7591:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216612672 00000100:00100000:3.0:1772305941.960971:0:6310:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 463 00000100:00100000:3.0:1772305941.960978:0:6310:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000276761c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:2994:x1858396216612736:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1772305941.961000:0:6309:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 464 00000100:00100000:0.0:1772305941.961008:0:6309:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000004473942 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:2992:x1858396216612672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1772305941.961018:0:6310:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 1703936 granted 744685568 pending 0 free 3828350976 avail 3826253824 00002000:00000024:0.0:1772305941.961038:0:6309:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 695140352 pending 0 free 3606052864 avail 3603955712 00000100:00100000:3.0:1772305941.961070:0:6310:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000276761c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:2994:x1858396216612736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305941.961081:0:6310:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 463 00000100:00100000:0.0:1772305941.961094:0:6309:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000004473942 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:2992:x1858396216612672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305941.961101:0:6309:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 464 00000100:00100000:1.0:1772305941.961111:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000763eeae7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216612736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1772305941.961134:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000120e5172 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216612672:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1772305941.972379:0:7114:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-OST0001: transno 4294968355 is committed 00000001:00080000:3.0:1772305941.972395:0:7114:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-OST0001: transno 4294968354 is committed 00010000:00010000:1.0:1772305942.217774:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1772305942.472812:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000051e590c2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:70aae467-c860-409f-ba1b-742f4d042da6:2994:1858396216612800:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772305942.472832:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000eae1ffd6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2991:1858396216612864:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772305942.472909:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772305942.472911:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305942.472929:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000028c6430b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2992:1858396216612928:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772305942.472955:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007af21754 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2991:1858396216613120:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772305942.472956:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000de6d83ec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216613056:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772305942.473004:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305942.473006:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003b5a8f12 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216612992:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772305942.473014:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305942.473057:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772305942.473074:0:54689:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216612800 00000100:00100000:1.0:1772305942.473084:0:71804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216612864 00000100:00100000:3.0:1772305942.473099:0:18149:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216613056 00000100:00100000:0.0:1772305942.473127:0:54689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1772305942.473132:0:71804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216612928 00000100:00100000:0.0:1772305942.473136:0:54689:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009c22b6fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70aae467-c860-409f-ba1b-742f4d042da6+18:2994:x1858396216612800:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772305942.473137:0:18149:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216612992 00000100:00100000:1.0:1772305942.473168:0:71804:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1772305942.473172:0:18149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1204 00000100:00100000:1.0:1772305942.473178:0:71804:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000120e5172 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:2991:x1858396216612864:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772305942.473180:0:18149:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007af842fc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216613056:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772305942.473201:0:54689:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009c22b6fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70aae467-c860-409f-ba1b-742f4d042da6+18:2994:x1858396216612800:12345-0@lo:400:kworker/u8:1.0 Request processed in 65us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305942.473207:0:54689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1772305942.473240:0:18149:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007af842fc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216613056:12345-0@lo:400:kworker/u8:1.0 Request processed in 60us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305942.473245:0:71804:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000120e5172 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:2991:x1858396216612864:12345-0@lo:400:kworker/u8:1.0 Request processed in 66us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305942.473249:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1205 00000100:00100000:0.0:1772305942.473257:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f1168a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:2993:x1858396216612992:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772305942.473260:0:18149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1204 00000100:00100000:1.0:1772305942.473263:0:71804:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1772305942.473305:0:71804:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1772305942.473313:0:71804:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005dcbb4b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:2992:x1858396216612928:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772305942.473335:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f1168a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:2993:x1858396216612992:12345-0@lo:400:kworker/u8:1.0 Request processed in 75us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305942.473345:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1205 00000100:00100000:3.0:1772305942.473349:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003b5a8f12 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216612992:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772305942.473369:0:71804:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005dcbb4b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:2992:x1858396216612928:12345-0@lo:400:kworker/u8:1.0 Request processed in 55us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305942.473376:0:71804:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1772305942.473389:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772305942.473394:0:2994:0:(client.c:2868:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968355 gen 2 00000004:00080000:0.0:1772305942.473402:0:2994:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req 00000000537dbec0, transno 4294968353 00000100:00100000:1.0:1772305942.473409:0:71804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216613120 00000004:00080000:0.0:1772305942.473419:0:2994:0:(osp_trans.c:1044:osp_request_commit_cb()) trans no 4294968355 committed transno 4294968355 00000100:00100000:3.0:1772305942.473430:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000eae1ffd6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2991:1858396216612864:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772305942.473445:0:71804:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1772305942.473449:0:71804:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cae996b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:2991:x1858396216613120:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772305942.473454:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000de6d83ec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216613056:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772305942.473473:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000051e590c2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:70aae467-c860-409f-ba1b-742f4d042da6:2994:1858396216612800:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772305942.473502:0:71804:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cae996b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:2991:x1858396216613120:12345-0@lo:400:kworker/u8:1.0 Request processed in 50us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305942.473510:0:71804:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1772305942.473519:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007af21754 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2991:1858396216613120:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772305942.473550:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000028c6430b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2992:1858396216612928:0@lo:400:kworker/u8:1.0 00000040:00100000:1.0:1772305942.473553:0:54721:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 14 in log [0xd:0x1:0x0] 00000400:00000080:1.0:1772305943.055243:0:71939:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1772305943.055248:0:71939:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 251: Coordinator request timeout ====== 14:12:22 (1772305942) 00000100:00100000:1.0:1772305943.074092:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305943.074156:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225420608 00000100:00100000:2.0:1772305943.074229:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1240 00000100:00100000:2.0:1772305943.074245:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ffc6c4ba pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+64:100633:x1858396225420608:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1772305943.074289:0:54696:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305943.074319:0:54696:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c703d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f399 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305943.074393:0:54696:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c703d8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305943.074407:0:54696:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c703d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305943.074418:0:54696:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c703d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305943.074546:0:54696:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c703df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305943.074566:0:54696:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c703df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305943.074578:0:54696:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c703df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305943.074737:0:54696:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c703d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305943.074744:0:54696:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c703d8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305943.074751:0:54696:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c703d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305943.074760:0:54696:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000001967872f already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305943.074763:0:54696:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c703d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305943.074771:0:54696:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c703d8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305943.074789:0:54696:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:2.0:1772305943.074791:0:54696:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305943.074794:0:54696:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c703d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305943.074799:0:54696:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c703d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305943.074810:0:54696:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c703df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305943.074815:0:54696:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c703df lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305943.074819:0:54696:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c703df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305943.074825:0:54696:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000063369192 already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305943.074827:0:54696:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c703df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305943.074831:0:54696:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c703df lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305943.074837:0:54696:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x74e38b4e (00000000228cb01d) 00010000:00010000:2.0:1772305943.074838:0:54696:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305943.074841:0:54696:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c703df lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305943.074844:0:54696:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c703df lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305943.074904:0:54696:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c703d1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f399 expref: 65 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305943.074910:0:54696:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c703d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f399 expref: 65 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305943.074920:0:54696:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004e3177f5, rc 0) 00000100:00100000:2.0:1772305943.075001:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ffc6c4ba pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+64:100633:x1858396225420608:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 754us (908us total) trans 0 rc 301/301 00000100:00100000:2.0:1772305943.075013:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1240 00000100:00100000:1.0:1772305943.076523:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305943.076577:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225420672 00000100:00100000:2.0:1772305943.076623:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1241 00000100:00100000:2.0:1772305943.076676:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004f8db88b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+83:100633:x1858396225420672:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1772305943.076699:0:54696:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305943.076712:0:54696:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c703e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f3a0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305943.076751:0:54696:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c703ed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305943.076763:0:54696:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c703ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305943.076769:0:54696:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c703ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1772305943.076808:0:54696:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:2.0:1772305943.076812:0:54696:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 110 stripe count 1 MDT count 1 00000004:00010000:2.0:1772305943.076829:0:54696:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c703ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305943.076844:0:54696:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c703e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f3a0 expref: 85 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305943.076854:0:54696:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c703ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f3a0 expref: 84 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305943.076859:0:54696:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:2.0:1772305943.076861:0:54696:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1772305943.076862:0:54696:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f20d88bd, rc 0) 00000100:00100000:2.0:1772305943.076893:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004f8db88b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:100633:x1858396225420672:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 220us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305943.076900:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1241 00000100:00100000:1.0:1772305943.078068:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305943.078129:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225420800 00000100:00100000:2.0:1772305943.078172:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1242 00000100:00100000:2.0:1772305943.078180:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000028c6430b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+64:100633:x1858396225420800:12345-192.168.203.30@tcp:36:lfs.0 00010000:00010000:2.0:1772305943.078207:0:54696:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1772305943.078221:0:54696:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c6fe36 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f1d9 expref: 64 pid: 54698 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305943.078232:0:54696:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:2.0:1772305943.078235:0:54696:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1772305943.078298:0:54696:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c703f4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305943.078308:0:54696:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c703ed lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f3a0 expref: 83 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305943.078313:0:54696:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c703f4 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305943.078338:0:54696:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c703ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f3a0 expref: 83 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305943.078350:0:54696:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c703ed lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f3a0 expref: 83 pid: 54696 timeout: 1354 lvb_type: 0 00000100:00100000:2.0:1772305943.078361:0:54696:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003bb53c21 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:54696:1858396216613184:192.168.203.30@tcp:104: 00000100:00100000:2.0:1772305943.078405:0:54696:0:(client.c:2500:ptlrpc_set_wait()) set 000000007feb9551 going to sleep for 6 seconds 00000100:00100000:3.0:1772305943.079193:0:54696:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003bb53c21 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:54696:1858396216613184:192.168.203.30@tcp:104: 00010000:00010000:3.0:1772305943.079335:0:54696:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c703f4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305943.079385:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305943.079444:0:5495:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225420864 00010000:00010000:0.0:1772305943.079477:0:5495:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c703ed lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f3a0 expref: 84 pid: 54696 timeout: 1354 lvb_type: 0 00000100:00100000:0.0:1772305943.079519:0:5495:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3161 00000100:00100000:0.0:1772305943.079527:0:5495:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007af21754 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2216:x1858396225420864:12345-192.168.203.30@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1772305943.079542:0:5495:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1772305943.079550:0:5495:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c703ed lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f3a0 expref: 84 pid: 54696 timeout: 1354 lvb_type: 0 00010000:00010000:0.0:1772305943.079564:0:5495:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c703ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f3a0 expref: 84 pid: 54696 timeout: 1354 lvb_type: 0 00010000:00010000:0.0:1772305943.079584:0:5495:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c703ed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f3a0 expref: 84 pid: 54696 timeout: 1354 lvb_type: 0 00010000:00010000:0.0:1772305943.079600:0:5495:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:0.0:1772305943.079603:0:5495:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c703f4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305943.079611:0:5495:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c703f4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305943.079616:0:5495:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c703f4 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305943.079680:0:5495:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1772305943.079694:0:54696:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c703f4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.079705:0:54696:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c703f4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.079729:0:54696:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c703fb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.079740:0:54696:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c703fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305943.079741:0:5495:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007af21754 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+83:2216:x1858396225420864:12345-192.168.203.30@tcp:103:ldlm_bl_02.0 Request processed in 212us (357us total) trans 0 rc 0/0 00010000:00010000:3.0:1772305943.079760:0:54696:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c703fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1772305943.079761:0:5495:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3161 00000004:00200000:3.0:1772305943.080499:0:54696:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000408:0x98:0x0]: returning size 512 00010000:00010000:3.0:1772305943.080507:0:54696:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c703f4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.080514:0:54696:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c703f4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.080520:0:54696:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c703f4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.080524:0:54696:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e5e5320a already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305943.080527:0:54696:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c703f4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.080533:0:54696:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c703f4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.080542:0:54696:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:3.0:1772305943.080544:0:54696:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305943.080546:0:54696:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c703f4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.080551:0:54696:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e5e5320a/0xa5e9c8c58c703f4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1772305943.080559:0:54696:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000028c6430b reply state 000000000da34494 transno 8589935007 ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c703fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1772305943.080613:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000028c6430b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+65:100633:x1858396225420800:12345-192.168.203.30@tcp:36:lfs.0 Request processed in 2436us (2548us total) trans 8589935007 rc 0/0 00000100:00100000:3.0:1772305943.080619:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1242 00010000:00010000:3.0:1772305943.081244:0:2978:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c703fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.081255:0:2978:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c703fb lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.081275:0:2978:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c703fb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.081282:0:2978:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000051c27e8b already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305943.081285:0:2978:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c703fb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.081293:0:2978:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c703fb lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.081305:0:2978:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x74e38b4e (00000000c3a8f5b5) 00010000:00010000:3.0:1772305943.081309:0:2978:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305943.081311:0:2978:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c703fb lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.081318:0:2978:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c703fb lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1772305943.096746:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305943.096921:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225420992 00000100:00100000:3.0:1772305943.097004:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1243 00000100:00100000:3.0:1772305943.097015:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000051e590c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+83:100642:x1858396225420992:12345-192.168.203.30@tcp:36:mkdir.0 00000100:00100000:3.0:1772305943.097327:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000051e590c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+83:100642:x1858396225420992:12345-192.168.203.30@tcp:36:mkdir.0 Request processed in 311us (585us total) trans 0 rc -17/-17 00000100:00100000:3.0:1772305943.097337:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1243 00000100:00100000:1.0:1772305943.098762:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305943.098829:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225421056 00000100:00100000:3.0:1772305943.098876:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1244 00000100:00100000:3.0:1772305943.098884:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000de6d83ec pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+83:100642:x1858396225421056:12345-192.168.203.30@tcp:101:mkdir.0 00010000:00010000:3.0:1772305943.098899:0:54696:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305943.098927:0:54696:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c70402 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f3a7 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.098986:0:54696:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c70409 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.099006:0:54696:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c70409 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.099027:0:54696:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c70409 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.099050:0:54696:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c70410 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.099060:0:54696:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c70410 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.099068:0:54696:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c70410 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.099146:0:54696:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c70417 lrc: 3/1,0 mode: --/PR res: [0x200000408:0x98:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.099163:0:54696:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c70417 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x98:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.099171:0:54696:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c70417 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x98:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1772305943.099224:0:54696:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000408:0x98:0x0]: returning size 512 00000004:00200000:3.0:1772305943.099229:0:54696:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1772305943.099279:0:54696:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c70417 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x98:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.099294:0:54696:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c70409 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.099302:0:54696:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c70409 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.099312:0:54696:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c70409 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.099319:0:54696:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000617aea8a already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305943.099324:0:54696:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c70409 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.099333:0:54696:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c70409 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.099348:0:54696:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:3.0:1772305943.099351:0:54696:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305943.099357:0:54696:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c70409 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.099364:0:54696:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000617aea8a/0xa5e9c8c58c70409 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.099380:0:54696:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c70410 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.099387:0:54696:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c70410 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.099394:0:54696:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c70410 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.099402:0:54696:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c6c2d285 already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305943.099405:0:54696:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c70410 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.099414:0:54696:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c70410 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.099424:0:54696:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x74e38b4e (00000000c3a8f5b5) 00010000:00010000:3.0:1772305943.099428:0:54696:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305943.099431:0:54696:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c70410 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.099438:0:54696:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c6c2d285/0xa5e9c8c58c70410 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.099483:0:54696:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000051c27e8b/0xa5e9c8c58c70402 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f3a7 expref: 85 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.099501:0:54696:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c70417 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x98:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f3a7 expref: 84 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.099510:0:54696:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x98:0x0].0x0 (00000000a8b16304) 00010000:00010000:3.0:1772305943.099513:0:54696:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1772305943.099516:0:54696:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0648135, rc 0) 00000100:00100000:3.0:1772305943.099566:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000de6d83ec pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:100642:x1858396225421056:12345-192.168.203.30@tcp:101:mkdir.0 Request processed in 681us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305943.099576:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1244 00000100:00100000:1.0:1772305943.104389:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305943.104453:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225421120 00000100:00100000:3.0:1772305943.104499:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1245 00000100:00100000:3.0:1772305943.104508:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000eae1ffd6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:100644:x1858396225421120:12345-192.168.203.30@tcp:101:rm.0 00010000:00010000:3.0:1772305943.104528:0:54696:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1772305943.104549:0:54696:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d05ed1ee/0xa5e9c8c58c7041e lrc: 2/0,0 mode: --/CR res: [0x200000408:0x98:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f3ae expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.104591:0:54696:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000a8209eab/0xa5e9c8c58c70425 lrc: 3/1,0 mode: --/CR res: [0x200000408:0x98:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.104604:0:54696:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a8209eab/0xa5e9c8c58c70425 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x98:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.104616:0:54696:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a8209eab/0xa5e9c8c58c70425 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x98:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.104704:0:54696:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c12bdb6b/0xa5e9c8c58c7042c lrc: 3/1,0 mode: --/PR res: [0x200000408:0x98:0x0].0x63615bf2 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.104712:0:54696:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c12bdb6b/0xa5e9c8c58c7042c lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x98:0x0].0x63615bf2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.104722:0:54696:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c12bdb6b/0xa5e9c8c58c7042c lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x98:0x0].0x63615bf2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.104794:0:54696:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000a8209eab/0xa5e9c8c58c70425 lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x98:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.104804:0:54696:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a8209eab/0xa5e9c8c58c70425 lrc: 2/0,0 mode: CR/CR res: [0x200000408:0x98:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.104812:0:54696:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000a8209eab/0xa5e9c8c58c70425 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x98:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.104820:0:54696:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a8209eab already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305943.104825:0:54696:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a8209eab/0xa5e9c8c58c70425 lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x98:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.104833:0:54696:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a8209eab/0xa5e9c8c58c70425 lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x98:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.104850:0:54696:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x98:0x0].0x0 (00000000a8b16304) 00010000:00010000:3.0:1772305943.104853:0:54696:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305943.104857:0:54696:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000a8209eab/0xa5e9c8c58c70425 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x98:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.104865:0:54696:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a8209eab/0xa5e9c8c58c70425 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x98:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.104885:0:54696:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c12bdb6b/0xa5e9c8c58c7042c lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x98:0x0].0x63615bf2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.104892:0:54696:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c12bdb6b/0xa5e9c8c58c7042c lrc: 2/0,0 mode: PR/PR res: [0x200000408:0x98:0x0].0x63615bf2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.104904:0:54696:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c12bdb6b/0xa5e9c8c58c7042c lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x98:0x0].0x63615bf2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.104910:0:54696:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c12bdb6b already unused, calling callback (00000000909eb10b) 00010000:00010000:3.0:1772305943.104914:0:54696:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c12bdb6b/0xa5e9c8c58c7042c lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x98:0x0].0x63615bf2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.104919:0:54696:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c12bdb6b/0xa5e9c8c58c7042c lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x98:0x0].0x63615bf2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.104929:0:54696:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x98:0x0].0x63615bf2 (00000000c3a8f5b5) 00010000:00010000:3.0:1772305943.104933:0:54696:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1772305943.104936:0:54696:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c12bdb6b/0xa5e9c8c58c7042c lrc: 2/0,0 mode: --/PR res: [0x200000408:0x98:0x0].0x63615bf2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.104943:0:54696:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c12bdb6b/0xa5e9c8c58c7042c lrc: 0/0,0 mode: --/PR res: [0x200000408:0x98:0x0].0x63615bf2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.104996:0:54696:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000d05ed1ee/0xa5e9c8c58c7041e lrc: 1/0,0 mode: --/CR res: [0x200000408:0x98:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f3ae expref: 85 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.105006:0:54696:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d05ed1ee/0xa5e9c8c58c7041e lrc: 0/0,0 mode: --/CR res: [0x200000408:0x98:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f3ae expref: 85 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1772305943.105017:0:54696:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d05ed1ee, rc 0) 00000100:00100000:3.0:1772305943.105071:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000eae1ffd6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:100644:x1858396225421120:12345-192.168.203.30@tcp:101:rm.0 Request processed in 563us (686us total) trans 0 rc 301/301 00000100:00100000:3.0:1772305943.105082:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1245 00000100:00100000:2.0:1772305943.110802:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305943.110840:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225421248 00000100:00100000:0.0:1772305943.110887:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1246 00000100:00100000:0.0:1772305943.110896:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bb867392 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:100645:x1858396225421248:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:0.0:1772305943.110913:0:54696:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305943.110916:0:54696:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1772305943.110940:0:54696:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a0648135/0xa5e9c8c58c70417 lrc: 0/0,0 mode: --/PR res: [0x200000408:0x98:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f3a7 expref: 84 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305943.110959:0:54696:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x98:0x0].0x0 (00000000a8b16304) 00010000:00010000:0.0:1772305943.110968:0:54696:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1772305943.110980:0:54696:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c70433 lrc: 2/0,0 mode: --/CW res: [0x200000408:0x98:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f3b5 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305943.111112:0:54696:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c7043a lrc: 3/0,1 mode: --/CW res: [0x200000408:0x98:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305943.111124:0:54696:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c7043a lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x98:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305943.111136:0:54696:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c7043a lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x98:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305943.111149:0:54696:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c70441 lrc: 3/0,1 mode: --/PW res: [0x200000408:0x98:0x0].0x63615bf2 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305943.111154:0:54696:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c70441 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x98:0x0].0x63615bf2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305943.111165:0:54696:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c70441 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x98:0x0].0x63615bf2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1772305943.111948:0:54696:0:(osp_object.c:1645:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x100010000:0x1b6:0x0], index 1: 0 00010000:00010000:0.0:1772305943.112142:0:54696:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c70448 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x338:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305943.112150:0:54696:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c70448 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x338:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305943.112155:0:54696:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c70448 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x338:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305943.112181:0:54696:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c7043a lrc: 3/0,1 mode: CW/CW res: [0x200000408:0x98:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305943.112187:0:54696:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c7043a lrc: 2/0,0 mode: CW/CW res: [0x200000408:0x98:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305943.112193:0:54696:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c7043a lrc: 3/0,0 mode: CW/CW res: [0x200000408:0x98:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305943.112199:0:54696:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000005803c629 already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305943.112202:0:54696:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c7043a lrc: 3/0,0 mode: CW/CW res: [0x200000408:0x98:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305943.112207:0:54696:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c7043a lrc: 4/0,0 mode: CW/CW res: [0x200000408:0x98:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305943.112217:0:54696:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x98:0x0].0x0 (00000000176e8e72) 00010000:00010000:0.0:1772305943.112219:0:54696:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305943.112222:0:54696:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c7043a lrc: 2/0,0 mode: --/CW res: [0x200000408:0x98:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305943.112226:0:54696:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c7043a lrc: 0/0,0 mode: --/CW res: [0x200000408:0x98:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1772305943.112234:0:54696:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000bb867392 reply state 00000000166d89ac transno 8589935008 ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c70441 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x98:0x0].0x63615bf2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305943.112250:0:54696:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c70433 lrc: 0/0,0 mode: --/CW res: [0x200000408:0x98:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f3b5 expref: 86 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305943.112276:0:54696:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000b501871d/0xa5e9c8c58c70448 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x338:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f3b5 expref: 85 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305943.112281:0:54696:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x338:0x0].0x0 (000000002cd22d98) 00010000:00010000:0.0:1772305943.112284:0:54696:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1772305943.112286:0:54696:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b501871d, rc 0) 00000100:00100000:0.0:1772305943.112336:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bb867392 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+86:100645:x1858396225421248:12345-192.168.203.30@tcp:101:dd.0 Request processed in 1442us (1540us total) trans 8589935008 rc 0/0 00000100:00100000:0.0:1772305943.112343:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1246 00010000:00010000:2.0:1772305943.112991:0:2977:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c70441 lrc: 3/0,1 mode: PW/PW res: [0x200000408:0x98:0x0].0x63615bf2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305943.113000:0:2977:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c70441 lrc: 2/0,0 mode: PW/PW res: [0x200000408:0x98:0x0].0x63615bf2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305943.113006:0:2977:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c70441 lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x98:0x0].0x63615bf2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305943.113011:0:2977:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c571a25b already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305943.113013:0:2977:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c70441 lrc: 3/0,0 mode: PW/PW res: [0x200000408:0x98:0x0].0x63615bf2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305943.113019:0:2977:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c70441 lrc: 4/0,0 mode: PW/PW res: [0x200000408:0x98:0x0].0x63615bf2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305943.113030:0:2977:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x98:0x0].0x63615bf2 (000000001ccb4b89) 00010000:00010000:2.0:1772305943.113034:0:2977:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305943.113036:0:2977:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c70441 lrc: 2/0,0 mode: --/PW res: [0x200000408:0x98:0x0].0x63615bf2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305943.113042:0:2977:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c70441 lrc: 0/0,0 mode: --/PW res: [0x200000408:0x98:0x0].0x63615bf2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1772305943.113392:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305943.113436:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225421376 00000100:00100000:0.0:1772305943.113475:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 165 00000100:00100000:0.0:1772305943.113481:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003e88e354 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+85:100645:x1858396225421376:12345-192.168.203.30@tcp:35:dd.0 00000100:00100000:0.0:1772305943.113616:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003e88e354 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+86:100645:x1858396225421376:12345-192.168.203.30@tcp:35:dd.0 Request processed in 133us (224us total) trans 8589935009 rc 0/0 00000100:00100000:0.0:1772305943.113867:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 165 00000100:00100000:3.0:1772305943.123452:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305943.123517:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225421440 00000100:00100000:0.0:1772305943.123564:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1247 00000100:00100000:0.0:1772305943.123571:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d0e10cf7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+86:100646:x1858396225421440:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1772305943.123590:0:54696:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305943.123604:0:54696:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c70456 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f3bc expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305943.123683:0:54696:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c7045d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305943.123696:0:54696:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c7045d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305943.123704:0:54696:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c7045d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305943.123713:0:54696:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c70464 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305943.123718:0:54696:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c70464 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305943.123722:0:54696:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c70464 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305943.123814:0:54696:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c7046b lrc: 3/1,0 mode: --/PR res: [0x200000408:0x98:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305943.123823:0:54696:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c7046b lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x98:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305943.123828:0:54696:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c7046b lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x98:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305943.123849:0:54696:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000408:0x98:0x0]: returning size 512 00000004:00200000:0.0:1772305943.123852:0:54696:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1772305943.123867:0:54696:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c7046b lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x98:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305943.123874:0:54696:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c7045d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305943.123878:0:54696:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c7045d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305943.123883:0:54696:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c7045d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305943.123886:0:54696:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000005803c629 already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305943.123889:0:54696:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c7045d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305943.123893:0:54696:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c7045d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305943.123900:0:54696:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:0.0:1772305943.123902:0:54696:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305943.123906:0:54696:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c7045d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305943.123910:0:54696:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c7045d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305943.123916:0:54696:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c70464 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305943.123919:0:54696:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c70464 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305943.123923:0:54696:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c70464 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305943.123926:0:54696:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a68ed1bf already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305943.123927:0:54696:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c70464 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305943.123931:0:54696:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c70464 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305943.123941:0:54696:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x74e38b4e (00000000176e8e72) 00010000:00010000:0.0:1772305943.123943:0:54696:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305943.123944:0:54696:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c70464 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305943.123948:0:54696:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c70464 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305943.123967:0:54696:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c70456 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f3bc expref: 88 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305943.123976:0:54696:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000809cda8f/0xa5e9c8c58c7046b lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x98:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f3bc expref: 87 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305943.123980:0:54696:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x98:0x0].0x0 (00000000bbfe3173) 00010000:00010000:0.0:1772305943.123982:0:54696:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1772305943.123983:0:54696:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000809cda8f, rc 0) 00000100:00100000:0.0:1772305943.124040:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d0e10cf7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+87:100646:x1858396225421440:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 468us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305943.124048:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1247 00010000:00010000:3.0:1772305943.240799:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1772305943.619994:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305943.620052:0:21399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225421504 00002000:00100000:0.0:1772305943.620098:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ae:0x0] (0->1515) req@0000000045e54637 x1858396225421504/t0(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:74/0 lens 2008/0 e 0 to 0 dl 1772305949 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cp.0' 00002000:00100000:0.0:1772305943.620111:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 0000000045e54637 with x1858396225421504 ext(0->1515) 00002000:00010000:0.0:1772305943.620116:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000045e54637 00000100:00100000:0.0:1772305943.620147:0:21399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2052 00000100:00100000:0.0:1772305943.620155:0:21399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000045e54637 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+228:2215:x1858396225421504:12345-192.168.203.30@tcp:4:cp.0 00000100:00100000:0.0:1772305943.620725:0:21399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000045e54637 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2215:x1858396225421504:12345-192.168.203.30@tcp:4:cp.0 Request processed in 569us (733us total) trans 4294968323 rc 0/0 00000100:00100000:0.0:1772305943.620735:0:21399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2052 00002000:00100000:0.0:1772305943.620744:0:21399:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x1ae:0x0] (0->1515) req@0000000045e54637 x1858396225421504/t4294968323(0) o4->370cd859-ca07-4cc9-a865-ed970d9eaddd@192.168.203.30@tcp:74/0 lens 2008/448 e 0 to 0 dl 1772305949 ref 1 fl Complete:/0/0 rc 0/0 job:'cp.0' 00002000:00100000:0.0:1772305943.620753:0:21399:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req 0000000045e54637 with x1858396225421504 ext(0->1515) 00002000:00010000:0.0:1772305943.620756:0:21399:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000045e54637 00010000:00010000:1.0:1772305944.264798:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1772305944.643736:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305944.643782:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225421568 00000100:00100000:2.0:1772305944.643784:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305944.643821:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305944.643828:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225421632 00000100:00100000:1.0:1772305944.643833:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 154 00000100:00100000:1.0:1772305944.643841:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d640d5a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2217:x1858396225421568:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1772305944.643857:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305944.643872:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 173 00000100:00100000:0.0:1772305944.643879:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d2a6474b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+87:2218:x1858396225421632:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1772305944.643902:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d640d5a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2217:x1858396225421568:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 60us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305944.643916:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 154 00000100:00100000:0.0:1772305944.643921:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d2a6474b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+87:2218:x1858396225421632:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 38us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305944.643922:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305944.643932:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 173 00000100:00100000:2.0:1772305944.643980:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225421760 00000100:00100000:0.0:1772305944.643989:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225421696 00000100:00100000:1.0:1772305944.644009:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305944.644020:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225421888 00000100:00100000:0.0:1772305944.644029:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1206 00000100:00100000:0.0:1772305944.644034:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003bb53c21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2218:x1858396225421760:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1772305944.644052:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305944.644059:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1207 00000100:00100000:0.0:1772305944.644063:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003bb53c21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2218:x1858396225421760:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 28us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305944.644071:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008068be20 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2217:x1858396225421696:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:0.0:1772305944.644076:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1206 00000100:00100000:1.0:1772305944.644089:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225421952 00000100:00100000:0.0:1772305944.644096:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1208 00000100:00100000:0.0:1772305944.644101:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000005e96666 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2218:x1858396225421888:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1772305944.644117:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008068be20 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2217:x1858396225421696:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 49us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305944.644130:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1209 00000100:00100000:0.0:1772305944.644131:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000005e96666 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2218:x1858396225421888:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 25us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305944.644140:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1207 00000100:00100000:1.0:1772305944.644141:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000537dbec0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+142:2217:x1858396225421952:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:0.0:1772305944.644147:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1208 00000100:00100000:1.0:1772305944.644175:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000537dbec0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+142:2217:x1858396225421952:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 36us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305944.644181:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1209 00000100:00100000:2.0:1772305944.644204:0:71804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225421824 00000100:00100000:2.0:1772305944.644237:0:71804:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 174 00000100:00100000:2.0:1772305944.644242:0:71804:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003b5a8f12 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f935b4d0-e17f-49c8-8011-4be99ba75430+64:2217:x1858396225421824:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1772305944.644296:0:71804:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003b5a8f12 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f935b4d0-e17f-49c8-8011-4be99ba75430+64:2217:x1858396225421824:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 53us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305944.644304:0:71804:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 174 00010000:00010000:1.0:1772305945.289719:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1772305945.592157:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305945.592225:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225422016 00000100:00100000:2.0:1772305945.592291:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1248 00000100:00100000:2.0:1772305945.592297:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a28db514 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+87:100747:x1858396225422016:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1772305945.592316:0:54696:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305945.592334:0:54696:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c70472 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f3c3 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305945.592383:0:54696:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c70479 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305945.592398:0:54696:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c70479 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305945.592410:0:54696:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c70479 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1772305945.592468:0:54696:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:2.0:1772305945.592472:0:54696:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 111 stripe count 1 MDT count 1 00000004:00010000:2.0:1772305945.592492:0:54696:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c70479 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305945.592515:0:54696:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000089dbe966/0xa5e9c8c58c70472 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f3c3 expref: 89 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305945.592527:0:54696:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000004e3177f5/0xa5e9c8c58c70479 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f3c3 expref: 88 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305945.592532:0:54696:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:2.0:1772305945.592534:0:54696:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1772305945.592537:0:54696:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004e3177f5, rc 0) 00000100:00100000:2.0:1772305945.592583:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a28db514 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+88:100747:x1858396225422016:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 286us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305945.592588:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1248 00000100:00100000:0.0:1772305945.595272:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305945.595317:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225422144 00000100:00100000:2.0:1772305945.595352:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1249 00000100:00100000:2.0:1772305945.595360:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008f2b99af pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+88:100748:x1858396225422144:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1772305945.595372:0:54696:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1772305945.595384:0:54696:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c70480 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f3ca expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305945.595428:0:54696:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c70487 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305945.595439:0:54696:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c70487 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305945.595446:0:54696:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c70487 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305945.595466:0:54696:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c7048e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305945.595474:0:54696:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c7048e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305945.595481:0:54696:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c7048e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1772305945.595572:0:54696:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 10752 00010000:00010000:2.0:1772305945.595691:0:54696:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c70487 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305945.595699:0:54696:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c70487 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305945.595706:0:54696:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c70487 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305945.595712:0:54696:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000001967872f already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305945.595716:0:54696:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c70487 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305945.595723:0:54696:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c70487 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305945.595733:0:54696:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (000000006b52a2ed) 00010000:00010000:2.0:1772305945.595735:0:54696:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305945.595738:0:54696:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c70487 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305945.595744:0:54696:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001967872f/0xa5e9c8c58c70487 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305945.595754:0:54696:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c7048e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305945.595760:0:54696:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c7048e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305945.595766:0:54696:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c7048e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305945.595771:0:54696:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f20d88bd already unused, calling callback (00000000909eb10b) 00010000:00010000:2.0:1772305945.595773:0:54696:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c7048e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305945.595778:0:54696:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c7048e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305945.595785:0:54696:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (000000008fd1be63) 00010000:00010000:2.0:1772305945.595787:0:54696:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1772305945.595789:0:54696:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c7048e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305945.595794:0:54696:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f20d88bd/0xa5e9c8c58c7048e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305945.595817:0:54696:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c70480 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f3ca expref: 90 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305945.595829:0:54696:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000063369192/0xa5e9c8c58c70480 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f3ca expref: 90 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1772305945.595836:0:54696:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000063369192, rc 0) 00000100:00100000:2.0:1772305945.595872:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008f2b99af pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+89:100748:x1858396225422144:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 512us (600us total) trans 8589935010 rc 301/301 00000100:00100000:2.0:1772305945.595881:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1249 00000100:00100000:1.0:1772305945.596775:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305945.596821:0:57054:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225422272 00000100:00100000:0.0:1772305945.596846:0:57054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 166 00000100:00100000:0.0:1772305945.596850:0:57054:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009707a2f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+89:100748:x1858396225422272:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1772305945.596993:0:57054:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009707a2f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+90:100748:x1858396225422272:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 140us (219us total) trans 8589935011 rc 0/0 00000100:00100000:0.0:1772305945.597001:0:57054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 166 00000100:00100000:3.0:1772305945.597865:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305945.597897:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225422336 00000100:00100000:2.0:1772305945.597924:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1250 00000100:00100000:2.0:1772305945.597927:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c230ed64 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+90:100748:x1858396225422336:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1772305945.597970:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c230ed64 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+90:100748:x1858396225422336:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 Request processed in 42us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305945.597976:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1250 00000100:00100000:2.0:1772305945.642712:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305945.642781:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225422400 00000100:00100000:0.0:1772305945.642844:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1251 00000100:00100000:0.0:1772305945.642854:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003084e0c8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+64:100757:x1858396225422400:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1772305945.642877:0:54696:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305945.642898:0:54696:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c7049c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f3d1 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.642957:0:54696:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c704a3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.642972:0:54696:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c704a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.642984:0:54696:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c704a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.642998:0:54696:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c704aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.643006:0:54696:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c704aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.643013:0:54696:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c704aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.643128:0:54696:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c704b1 lrc: 3/1,0 mode: --/PR res: [0x200000408:0x98:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.643138:0:54696:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c704b1 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x98:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.643146:0:54696:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c704b1 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x98:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305945.643176:0:54696:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000408:0x98:0x0]: returning size 512 00000004:00200000:0.0:1772305945.643180:0:54696:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1772305945.643203:0:54696:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c704b1 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x98:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.643215:0:54696:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c704a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.643222:0:54696:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c704a3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.643229:0:54696:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c704a3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.643236:0:54696:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a68ed1bf already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305945.643239:0:54696:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c704a3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.643287:0:54696:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c704a3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.643299:0:54696:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:0.0:1772305945.643302:0:54696:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305945.643306:0:54696:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c704a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.643313:0:54696:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a68ed1bf/0xa5e9c8c58c704a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.643328:0:54696:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c704aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.643335:0:54696:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c704aa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.643341:0:54696:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c704aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.643348:0:54696:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000005803c629 already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305945.643350:0:54696:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c704aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.643356:0:54696:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c704aa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.643363:0:54696:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x74e38b4e (0000000013d42fff) 00010000:00010000:0.0:1772305945.643365:0:54696:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305945.643367:0:54696:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c704aa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.643372:0:54696:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005803c629/0xa5e9c8c58c704aa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x74e38b4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.643401:0:54696:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b8f73038/0xa5e9c8c58c7049c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f3d1 expref: 66 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.643414:0:54696:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000009a7ee7d5/0xa5e9c8c58c704b1 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x98:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f3d1 expref: 65 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.643421:0:54696:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x98:0x0].0x0 (00000000bbfe3173) 00010000:00010000:0.0:1772305945.643424:0:54696:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1772305945.643426:0:54696:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a7ee7d5, rc 0) 00000100:00100000:0.0:1772305945.643479:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003084e0c8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+65:100757:x1858396225422400:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 627us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305945.643488:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1251 00000100:00100000:1.0:1772305945.644403:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305945.644450:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225422464 00000100:00100000:0.0:1772305945.644478:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1252 00000100:00100000:0.0:1772305945.644481:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001bb6be06 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+65:100757:x1858396225422464:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1772305945.644489:0:54696:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305945.644497:0:54696:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000096601b0a/0xa5e9c8c58c704b8 lrc: 2/0,0 mode: --/CR res: [0x200000408:0x98:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f3d8 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.644521:0:54696:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c704bf lrc: 3/1,0 mode: --/CR res: [0x200000408:0x98:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.644527:0:54696:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c704bf lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x98:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.644533:0:54696:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c704bf lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x98:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.644546:0:54696:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c704c6 lrc: 3/1,0 mode: --/PR res: [0x200000408:0x98:0x0].0x63615bf2 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.644554:0:54696:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c704c6 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x98:0x0].0x63615bf2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.644561:0:54696:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c704c6 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x98:0x0].0x63615bf2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.644619:0:54696:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c704cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x338:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.644647:0:54696:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c704cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x338:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.644653:0:54696:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c704cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x338:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305945.644671:0:54696:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x338:0x0]: returning size 0 00000004:00200000:0.0:1772305945.644673:0:54696:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1772305945.644680:0:54696:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c704cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x338:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.644686:0:54696:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c704cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x338:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.644691:0:54696:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c704bf lrc: 3/1,0 mode: CR/CR res: [0x200000408:0x98:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.644694:0:54696:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c704bf lrc: 2/0,0 mode: CR/CR res: [0x200000408:0x98:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.644698:0:54696:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c704bf lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x98:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.644701:0:54696:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c571a25b already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305945.644702:0:54696:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c704bf lrc: 3/0,0 mode: CR/CR res: [0x200000408:0x98:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.644710:0:54696:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c704bf lrc: 4/0,0 mode: CR/CR res: [0x200000408:0x98:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.644715:0:54696:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x98:0x0].0x0 (00000000bbfe3173) 00010000:00010000:0.0:1772305945.644717:0:54696:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305945.644718:0:54696:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c704bf lrc: 2/0,0 mode: --/CR res: [0x200000408:0x98:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.644722:0:54696:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c571a25b/0xa5e9c8c58c704bf lrc: 0/0,0 mode: --/CR res: [0x200000408:0x98:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.644729:0:54696:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c704c6 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x98:0x0].0x63615bf2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.644732:0:54696:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c704c6 lrc: 2/0,0 mode: PR/PR res: [0x200000408:0x98:0x0].0x63615bf2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.644736:0:54696:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c704c6 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x98:0x0].0x63615bf2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.644739:0:54696:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000001e903b7f already unused, calling callback (00000000909eb10b) 00010000:00010000:0.0:1772305945.644741:0:54696:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c704c6 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x98:0x0].0x63615bf2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.644744:0:54696:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c704c6 lrc: 4/0,0 mode: PR/PR res: [0x200000408:0x98:0x0].0x63615bf2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.644748:0:54696:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x98:0x0].0x63615bf2 (00000000499b0bdb) 00010000:00010000:0.0:1772305945.644750:0:54696:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1772305945.644751:0:54696:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c704c6 lrc: 2/0,0 mode: --/PR res: [0x200000408:0x98:0x0].0x63615bf2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.644755:0:54696:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001e903b7f/0xa5e9c8c58c704c6 lrc: 0/0,0 mode: --/PR res: [0x200000408:0x98:0x0].0x63615bf2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.644768:0:54696:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000096601b0a/0xa5e9c8c58c704b8 lrc: 0/0,0 mode: --/CR res: [0x200000408:0x98:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f3d8 expref: 67 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.644774:0:54696:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000870ce7f2/0xa5e9c8c58c704cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x338:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f3d8 expref: 66 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.644778:0:54696:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x338:0x0].0x0 (000000002cd22d98) 00010000:00010000:0.0:1772305945.644780:0:54696:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1772305945.644781:0:54696:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000870ce7f2, rc 0) 00000100:00100000:0.0:1772305945.644812:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001bb6be06 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+66:100757:x1858396225422464:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 329us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305945.644824:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1252 00000100:00100000:3.0:1772305945.645924:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305945.645967:0:6308:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225422528 00000100:00100000:1.0:1772305945.646005:0:6308:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5797 00000100:00100000:1.0:1772305945.646012:0:6308:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000051fd3951 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+142:2216:x1858396225422528:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1772305945.646023:0:6308:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1772305945.646038:0:6308:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f0eacd6/0xa5e9c8c58c704d4 lrc: 2/0,0 mode: --/PR res: [0x1b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f3df expref: -99 pid: 6308 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1772305945.646058:0:6308:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x1b6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1772305945.646070:0:6308:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305945.646071:0:6308:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1772305945.646076:0:6308:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f0eacd6/0xa5e9c8c58c704d4 lrc: 3/0,0 mode: PR/PR res: [0x1b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f3df expref: 143 pid: 6308 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1772305945.646086:0:6308:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004f0eacd6/0xa5e9c8c58c704d4 lrc: 3/0,0 mode: PR/PR res: [0x1b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f3df expref: 143 pid: 6308 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1772305945.646093:0:6308:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004f0eacd6, rc 0) 00000100:00100000:1.0:1772305945.646120:0:6308:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000051fd3951 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2216:x1858396225422528:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 110us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305945.646125:0:6308:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5797 00000100:00100000:2.0:1772305945.646967:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305945.647007:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225422592 00000100:00100000:0.0:1772305945.647040:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1253 00000100:00100000:0.0:1772305945.647045:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003fdd35f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+66:100757:x1858396225422592:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1772305945.647055:0:54696:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305945.647064:0:54696:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c704db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f3e6 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.647093:0:54696:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c704e2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.647103:0:54696:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c704e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.647111:0:54696:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c704e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305945.647139:0:54696:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16896 00000004:00200000:0.0:1772305945.647142:0:54696:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 111 stripe count 1 MDT count 1 00000004:00010000:0.0:1772305945.647157:0:54696:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c704e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.647176:0:54696:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000fd93d0b1/0xa5e9c8c58c704db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f3e6 expref: 68 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.647188:0:54696:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000004820b6c/0xa5e9c8c58c704e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f3e6 expref: 67 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.647195:0:54696:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (00000000e4b7f386) 00010000:00010000:0.0:1772305945.647197:0:54696:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1772305945.647199:0:54696:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000004820b6c, rc 0) 00000100:00100000:0.0:1772305945.647232:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003fdd35f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+67:100757:x1858396225422592:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 187us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305945.647241:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1253 00000100:00100000:3.0:1772305945.648003:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305945.648034:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225422656 00000100:00100000:0.0:1772305945.648059:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1254 00000100:00100000:0.0:1772305945.648063:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000be70edad pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+67:100757:x1858396225422656:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1772305945.648069:0:54696:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1772305945.648075:0:54696:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c704e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xca1b2e5b3196f3ed expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.648099:0:54696:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c704f0 lrc: 3/1,0 mode: --/PR res: [0x200000408:0x98:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.648105:0:54696:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c704f0 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x98:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.648110:0:54696:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c704f0 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x98:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1772305945.648127:0:54696:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000408:0x98:0x0]: returning size 512 00000004:00200000:0.0:1772305945.648129:0:54696:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1772305945.648137:0:54696:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c704f0 lrc: 3/1,0 mode: PR/PR res: [0x200000408:0x98:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.648147:0:54696:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000079ce3603/0xa5e9c8c58c704e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f3ed expref: 69 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.648155:0:54696:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000a7782eea/0xa5e9c8c58c704f0 lrc: 3/0,0 mode: PR/PR res: [0x200000408:0x98:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xca1b2e5b3196f3ed expref: 68 pid: 54696 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1772305945.648159:0:54696:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000408:0x98:0x0].0x0 (00000000bbfe3173) 00010000:00010000:0.0:1772305945.648161:0:54696:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1772305945.648163:0:54696:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a7782eea, rc 0) 00000100:00100000:0.0:1772305945.648187:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000be70edad pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+68:100757:x1858396225422656:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 123us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305945.648191:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1254 00000100:00100000:3.0:1772305945.649555:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305945.649595:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225422784 00000100:00100000:0.0:1772305945.649660:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1255 00000100:00100000:0.0:1772305945.649666:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000caaee5d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+68:100757:x1858396225422784:12345-192.168.203.30@tcp:58:lfs.0 00000040:00080000:0.0:1772305945.649831:0:54696:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xf:0x0].52, 136 off15264 00000100:00100000:0.0:1772305945.649883:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000caaee5d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+68:100757:x1858396225422784:12345-192.168.203.30@tcp:58:lfs.0 Request processed in 216us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305945.649892:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1255 00000040:00080000:0.0:1772305945.926368:0:72372:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772305945.926372:0:72372:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772305945.926453:0:72372:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 25 00000040:00080000:0.0:1772305945.926459:0:72372:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:0.0:1772305945.926496:0:72372:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772305945.926498:0:72372:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772305945.926616:0:72372:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 25 00000040:00080000:0.0:1772305945.926621:0:72372:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:2.0:1772305945.992767:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305945.992773:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00100000:2.0:1772305945.992798:0:54732:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 29 in log [0xf:0x1:0x0] 00000040:00080000:2.0:1772305945.992881:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 24 00000040:00080000:2.0:1772305945.992886:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:2.0:1772305945.993055:0:54732:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d0ab861f pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:54732:1858396216613248:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1772305945.993125:0:54732:0:(client.c:2500:ptlrpc_set_wait()) set 000000004f9214ed going to sleep for 6 seconds 00000100:00100000:2.0:1772305945.994378:0:54732:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d0ab861f pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:54732:1858396216613248:192.168.203.30@tcp:107:hsm_cdtr.0 00000040:00080000:2.0:1772305945.994427:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305945.994429:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305945.994463:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 24 00000040:00080000:2.0:1772305945.994466:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000001:00080000:2.0:1772305946.065292:0:6332:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-OST0000: transno 4294968323 is committed 00000001:00080000:2.0:1772305946.065311:0:6332:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-OST0000: transno 4294968322 is committed 00010000:00010000:1.0:1772305946.312841:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1772305947.016763:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305947.016771:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305947.016871:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 24 00000040:00080000:2.0:1772305947.016879:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:2.0:1772305947.016898:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305947.016899:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305947.017321:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 24 00000040:00080000:2.0:1772305947.017326:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:2.0:1772305947.080743:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000fb2f2c9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216613312:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1772305947.080806:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772305947.080844:0:6309:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216613312 00000100:00100000:0.0:1772305947.080886:0:6309:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 465 00000100:00100000:0.0:1772305947.080892:0:6309:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d0ab861f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216613312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1772305947.080922:0:6309:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 695140352 pending 0 free 3606052864 avail 3603955712 00000100:00100000:0.0:1772305947.080969:0:6309:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d0ab861f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216613312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305947.080975:0:6309:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 465 00000100:00100000:2.0:1772305947.081007:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000fb2f2c9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216613312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1772305947.081718:0:2994:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1772305947.081727:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000028e6916d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216613376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1772305947.081758:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772305947.081785:0:6309:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216613376 00000100:00100000:0.0:1772305947.081817:0:6309:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 466 00000100:00100000:0.0:1772305947.081821:0:6309:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007de8ec07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216613376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1772305947.082023:0:6309:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 742981632 pending 0 free 3828350976 avail 3826253824 00000100:00100000:0.0:1772305947.082071:0:6309:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007de8ec07 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216613376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 248us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305947.082110:0:6309:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 466 00000100:00100000:0.0:1772305947.082264:0:2994:0:(client.c:2868:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968322 gen 2 00000004:00080000:0.0:1772305947.082269:0:2994:0:(osp_trans.c:1044:osp_request_commit_cb()) trans no 4294968322 committed transno 4294968322 00000100:00100000:0.0:1772305947.082317:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000028e6916d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216613376:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1772305947.092842:0:54724:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935011 is committed 00000020:00080000:3.0:1772305947.092867:0:54724:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 4295052958 batchid updated 00000020:00080000:0.0:1772305947.092886:0:54735:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4295052958 00000020:00080000:3.0:1772305947.092898:0:54724:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt 0000000045bd76cd refcount 2 committed 0 result 0 batchid 4295052959 00000020:00080000:0.0:1772305947.092900:0:54735:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4295052958 00000020:00080000:3.0:1772305947.092905:0:54724:0:(update_trans.c:89:top_multiple_thandle_dump()) st 000000006944e659 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th 00000000157f4a82 00000020:00080000:3.0:1772305947.092909:0:54724:0:(update_trans.c:89:top_multiple_thandle_dump()) st 000000006b2d1ec8 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th 00000000bb4e58bd 00000020:00080000:0.0:1772305947.092923:0:54735:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4295052959 committed batchid 4295052958 00000001:00080000:3.0:1772305947.092931:0:54724:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935007 is committed 00000020:00080000:0.0:1772305947.093054:0:54735:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4295052958 00000040:00080000:0.0:1772305947.214719:0:72428:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772305947.214724:0:72428:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772305947.214801:0:72428:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 24 00000040:00080000:0.0:1772305947.214806:0:72428:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:0.0:1772305947.214839:0:72428:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772305947.214841:0:72428:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772305947.214905:0:72428:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 24 00000040:00080000:0.0:1772305947.214908:0:72428:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772305947.336807:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1772305947.592899:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002d3be4cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:70aae467-c860-409f-ba1b-742f4d042da6:2994:1858396216613440:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772305947.592933:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009b7fc1cf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2991:1858396216613504:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772305947.592946:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e634e198 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216613632:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772305947.592980:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305947.592985:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772305947.592998:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b4a2cd7a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2992:1858396216613568:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772305947.593004:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305947.593023:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc9c50ef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2991:1858396216613760:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772305947.593028:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008d141ae1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216613696:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772305947.593042:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772305947.593064:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216613504 00000100:00100000:1.0:1772305947.593078:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305947.593080:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772305947.593103:0:71804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216613568 00000100:00100000:0.0:1772305947.593109:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216613760 00000100:00100000:2.0:1772305947.593148:0:71804:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1772305947.593156:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1772305947.593157:0:71804:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008907f4c8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:2991:x1858396216613504:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772305947.593164:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000022a16ea pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:2992:x1858396216613568:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772305947.593172:0:6308:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216613632 00000100:00100000:3.0:1772305947.593200:0:54689:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216613440 00000100:00100000:1.0:1772305947.593209:0:6308:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216613696 00000100:00100000:0.0:1772305947.593221:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000022a16ea pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:2992:x1858396216613568:12345-0@lo:400:kworker/u8:1.0 Request processed in 57us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305947.593248:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1772305947.593249:0:71804:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008907f4c8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:2991:x1858396216613504:12345-0@lo:400:kworker/u8:1.0 Request processed in 72us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305947.593258:0:71804:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1772305947.593262:0:54689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1772305947.593272:0:6308:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1210 00000100:00100000:3.0:1772305947.593273:0:54689:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000085166dbd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70aae467-c860-409f-ba1b-742f4d042da6+18:2994:x1858396216613440:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772305947.593278:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1772305947.593283:0:6308:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000028e6916d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216613632:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772305947.593289:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007ce64e92 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:2991:x1858396216613760:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772305947.593313:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b4a2cd7a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2992:1858396216613568:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772305947.593342:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009b7fc1cf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2991:1858396216613504:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772305947.593351:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc9c50ef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2991:1858396216613760:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772305947.593379:0:48470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1211 00000100:00100000:2.0:1772305947.593382:0:48470:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000db3403a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216613696:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772305947.593456:0:54689:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000085166dbd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70aae467-c860-409f-ba1b-742f4d042da6+18:2994:x1858396216613440:12345-0@lo:400:kworker/u8:1.0 Request processed in 185us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305947.593464:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007ce64e92 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:2991:x1858396216613760:12345-0@lo:400:kworker/u8:1.0 Request processed in 176us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305947.593470:0:54689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1772305947.593476:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1772305947.593483:0:6308:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000028e6916d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216613632:12345-0@lo:400:kworker/u8:1.0 Request processed in 202us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305947.593494:0:6308:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1210 00000100:00100000:2.0:1772305947.593496:0:48470:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000db3403a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216613696:12345-0@lo:400:kworker/u8:1.0 Request processed in 109us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305947.593506:0:48470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1211 00000100:00100000:1.0:1772305947.593542:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e634e198 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216613632:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772305947.593583:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008d141ae1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216613696:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772305947.593596:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002d3be4cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:70aae467-c860-409f-ba1b-742f4d042da6:2994:1858396216613440:0@lo:400:kworker/u8:1.0 00000040:00080000:2.0:1772305948.040779:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305948.040786:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00100000:2.0:1772305948.040814:0:54732:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 30 in log [0xf:0x1:0x0] 00000040:00080000:2.0:1772305948.040910:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 23 00000040:00080000:2.0:1772305948.040916:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:0.0:1772305948.360746:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1772305948.495081:0:72480:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305948.495087:0:72480:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305948.495205:0:72480:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 23 00000040:00080000:1.0:1772305948.495213:0:72480:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:1.0:1772305948.495274:0:72480:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305948.495277:0:72480:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305948.495398:0:72480:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 23 00000040:00080000:1.0:1772305948.495402:0:72480:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:2.0:1772305949.064858:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305949.064865:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305949.064903:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 23 00000040:00080000:2.0:1772305949.064912:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:1.0:1772305949.384781:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772305949.763880:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305949.763929:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305949.763947:0:54689:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225422848 00000100:00100000:1.0:1772305949.763958:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305949.763996:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305949.763999:0:54689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 156 00000100:00100000:2.0:1772305949.764007:0:54689:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000061054f35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2218:x1858396225422848:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:0.0:1772305949.764009:0:48470:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225422976 00000100:00100000:1.0:1772305949.764024:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305949.764047:0:48470:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225423040 00000100:00100000:1.0:1772305949.764050:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305949.764075:0:48470:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225423168 00000100:00100000:2.0:1772305949.764089:0:54689:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000061054f35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2218:x1858396225422848:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 80us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305949.764099:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305949.764101:0:54689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 156 00000100:00100000:0.0:1772305949.764111:0:48470:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225423232 00000100:00100000:0.0:1772305949.764142:0:48470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1212 00000100:00100000:2.0:1772305949.764146:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225422912 00000100:00100000:0.0:1772305949.764149:0:48470:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000068687bb0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2218:x1858396225422976:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1772305949.764179:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225423104 00000100:00100000:1.0:1772305949.764201:0:6308:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1213 00000100:00100000:0.0:1772305949.764202:0:48470:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000068687bb0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2218:x1858396225422976:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 52us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305949.764211:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 178 00000100:00100000:1.0:1772305949.764211:0:6308:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d12426c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2217:x1858396225423040:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1772305949.764235:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e634e198 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2217:x1858396225422912:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:0.0:1772305949.764235:0:48470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1212 00000100:00100000:0.0:1772305949.764258:0:48470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1214 00000100:00100000:2.0:1772305949.764263:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e634e198 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2217:x1858396225422912:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 44us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305949.764263:0:6308:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d12426c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2217:x1858396225423040:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 53us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305949.764269:0:48470:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d6661384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2217:x1858396225423168:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1772305949.764278:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 178 00000100:00100000:1.0:1772305949.764278:0:6308:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1213 00000100:00100000:2.0:1772305949.764302:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 179 00000100:00100000:1.0:1772305949.764302:0:6308:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1215 00000100:00100000:0.0:1772305949.764306:0:48470:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d6661384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2217:x1858396225423168:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 38us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305949.764314:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b82f8f38 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2218:x1858396225423104:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:1.0:1772305949.764314:0:6308:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003397d536 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2218:x1858396225423232:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:0.0:1772305949.764320:0:48470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1214 00000100:00100000:2.0:1772305949.764347:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b82f8f38 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2218:x1858396225423104:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 35us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305949.764347:0:6308:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003397d536 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2218:x1858396225423232:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 35us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305949.764356:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 179 00000100:00100000:1.0:1772305949.764356:0:6308:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1215 00000040:00080000:3.0:1772305949.779284:0:72531:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305949.779288:0:72531:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305949.779352:0:72531:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 23 00000040:00080000:3.0:1772305949.779356:0:72531:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:3.0:1772305949.779378:0:72531:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305949.779379:0:72531:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305949.779438:0:72531:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 23 00000040:00080000:3.0:1772305949.779440:0:72531:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:2.0:1772305950.088827:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305950.088833:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305950.088859:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 23 00000040:00080000:2.0:1772305950.088866:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:1.0:1772305950.408811:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1772305951.073179:0:72582:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305951.073184:0:72582:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305951.073268:0:72582:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 23 00000040:00080000:3.0:1772305951.073273:0:72582:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:3.0:1772305951.073293:0:72582:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305951.073295:0:72582:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305951.073390:0:72582:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 23 00000040:00080000:3.0:1772305951.073394:0:72582:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:2.0:1772305951.112772:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305951.112778:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00100000:2.0:1772305951.112819:0:54732:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 31 in log [0xf:0x1:0x0] 00000040:00080000:2.0:1772305951.112959:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 22 00000040:00080000:2.0:1772305951.112967:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772305951.432829:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1772305952.136736:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305952.136741:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305952.136786:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 22 00000040:00080000:2.0:1772305952.136793:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:1.0:1772305952.200804:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000084e1bde0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216613824:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1772305952.200804:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000000d187c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216613888:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1772305952.200885:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305952.200919:0:6309:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216613888 00000100:00100000:1.0:1772305952.200963:0:6309:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 467 00000100:00100000:1.0:1772305952.200969:0:6309:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000040ceeec7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216613888:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1772305952.200986:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1772305952.201007:0:6309:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 742981632 pending 0 free 3828350976 avail 3826253824 00000100:00100000:0.0:1772305952.201046:0:6310:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216613824 00000100:00100000:1.0:1772305952.201052:0:6309:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000040ceeec7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216613888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305952.201059:0:6309:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 467 00000100:00100000:1.0:1772305952.201083:0:6309:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 468 00000100:00100000:1.0:1772305952.201088:0:6309:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002294ffc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216613824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1772305952.201104:0:6309:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 695140352 pending 0 free 3606052864 avail 3603955712 00000100:00100000:1.0:1772305952.201131:0:6309:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002294ffc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216613824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305952.201136:0:6309:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 468 00000100:00100000:1.0:1772305952.201183:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000084e1bde0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216613824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1772305952.201216:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000000d187c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216613888:0@lo:13:osp-pre-0-0.0 00000020:00080000:3.0:1772305952.208959:0:54724:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 4295052959 batchid updated 00000020:00080000:0.0:1772305952.208987:0:54735:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4295052959 00000020:00080000:0.0:1772305952.209000:0:54735:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4295052959 00000040:00080000:0.0:1772305952.351844:0:72634:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772305952.351848:0:72634:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772305952.351912:0:72634:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 22 00000040:00080000:0.0:1772305952.351916:0:72634:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:0.0:1772305952.351935:0:72634:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772305952.351936:0:72634:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772305952.351997:0:72634:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 22 00000040:00080000:0.0:1772305952.351999:0:72634:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:0.0:1772305952.456804:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772305952.712764:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004f59895e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:70aae467-c860-409f-ba1b-742f4d042da6:2994:1858396216613952:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1772305952.712780:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085c3cd20 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2992:1858396216614080:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1772305952.712781:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001b3faa60 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2991:1858396216614016:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1772305952.712835:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772305952.712838:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007e97bd92 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:2993:1858396216614144:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1772305952.712839:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772305952.712871:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305952.712877:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216613952 00000100:00100000:1.0:1772305952.712896:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216614016 00000100:00100000:2.0:1772305952.712910:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216614144 00000100:00100000:3.0:1772305952.712922:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1772305952.712927:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305952.712931:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000056f79513 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2994:x1858396216613952:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1772305952.712945:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216614080 00000100:00100000:2.0:1772305952.712951:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1772305952.712959:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b515ed90 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:2991:x1858396216614016:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1772305952.712966:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1772305952.712972:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001bcee677 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:2993:x1858396216614144:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1772305952.712977:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1772305952.712983:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000056f79513 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2994:x1858396216613952:12345-0@lo:400:kworker/u8:0.0 Request processed in 52us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305952.712985:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000edabdca1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:2992:x1858396216614080:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305952.712997:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1772305952.713017:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001bcee677 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:2993:x1858396216614144:12345-0@lo:400:kworker/u8:0.0 Request processed in 45us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305952.713018:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b515ed90 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:2991:x1858396216614016:12345-0@lo:400:kworker/u8:0.0 Request processed in 60us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305952.713027:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1772305952.713033:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1772305952.713038:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000edabdca1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:2992:x1858396216614080:12345-0@lo:400:kworker/u8:0.0 Request processed in 54us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305952.713046:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1772305952.713081:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085c3cd20 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2992:1858396216614080:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1772305952.713083:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004f59895e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:70aae467-c860-409f-ba1b-742f4d042da6:2994:1858396216613952:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305952.713089:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001b3faa60 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2991:1858396216614016:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1772305952.713134:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007e97bd92 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:2993:1858396216614144:0@lo:400:kworker/u8:0.0 00000040:00080000:2.0:1772305953.160840:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305953.160848:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00100000:2.0:1772305953.160884:0:54732:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 32 in log [0xf:0x1:0x0] 00000040:00080000:2.0:1772305953.161028:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 21 00000040:00080000:2.0:1772305953.161037:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:1.0:1772305953.480744:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1772305953.633450:0:72685:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772305953.633456:0:72685:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772305953.633565:0:72685:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 21 00000040:00080000:0.0:1772305953.633571:0:72685:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:0.0:1772305953.633606:0:72685:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772305953.633609:0:72685:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772305953.633734:0:72685:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 21 00000040:00080000:0.0:1772305953.633738:0:72685:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:2.0:1772305954.184795:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305954.184801:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305954.184829:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 21 00000040:00080000:2.0:1772305954.184836:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:1.0:1772305954.504800:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1772305954.883830:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305954.883879:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305954.883887:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225423360 00000100:00100000:3.0:1772305954.883914:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305954.883920:0:54689:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225423296 00000100:00100000:3.0:1772305954.883942:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305954.883960:0:54689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 158 00000100:00100000:0.0:1772305954.883965:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 183 00000100:00100000:3.0:1772305954.883970:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305954.883970:0:54689:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000037758792 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2215:x1858396225423296:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:0.0:1772305954.883979:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001b3faa60 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2216:x1858396225423360:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:3.0:1772305954.883994:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305954.884036:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305954.884040:0:54689:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000037758792 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2215:x1858396225423296:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 71us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305954.884044:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001b3faa60 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2216:x1858396225423360:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 66us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305954.884054:0:54689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 158 00000100:00100000:0.0:1772305954.884059:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 183 00000100:00100000:0.0:1772305954.884083:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225423552 00000100:00100000:0.0:1772305954.884115:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 184 00000100:00100000:0.0:1772305954.884121:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002fe0dc56 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2215:x1858396225423552:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1772305954.884123:0:18149:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225423424 00000100:00100000:3.0:1772305954.884154:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225423488 00000100:00100000:2.0:1772305954.884154:0:18149:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225423616 00000100:00100000:0.0:1772305954.884168:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002fe0dc56 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2215:x1858396225423552:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 45us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305954.884177:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 184 00000100:00100000:2.0:1772305954.884179:0:18149:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225423680 00000100:00100000:2.0:1772305954.884230:0:18149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1216 00000100:00100000:2.0:1772305954.884236:0:18149:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a85e5eb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2215:x1858396225423424:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:3.0:1772305954.884250:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1217 00000100:00100000:3.0:1772305954.884256:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ad14d1c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2216:x1858396225423616:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1772305954.884269:0:18149:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a85e5eb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2215:x1858396225423424:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 32us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305954.884282:0:18149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1216 00000100:00100000:3.0:1772305954.884284:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ad14d1c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2216:x1858396225423616:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 27us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305954.884291:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1217 00000100:00100000:2.0:1772305954.884306:0:18149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1218 00000100:00100000:3.0:1772305954.884313:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1219 00000100:00100000:2.0:1772305954.884313:0:18149:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a9a770cc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2216:x1858396225423488:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:3.0:1772305954.884319:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005254ed4a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2215:x1858396225423680:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1772305954.884342:0:18149:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a9a770cc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2216:x1858396225423488:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 30us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305954.884350:0:18149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1218 00000100:00100000:3.0:1772305954.884471:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005254ed4a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2215:x1858396225423680:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 70us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305954.884478:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1219 00000040:00080000:2.0:1772305954.912123:0:72737:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305954.912128:0:72737:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305954.912210:0:72737:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 21 00000040:00080000:2.0:1772305954.912215:0:72737:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:2.0:1772305954.912235:0:72737:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305954.912237:0:72737:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305954.912290:0:72737:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 21 00000040:00080000:2.0:1772305954.912293:0:72737:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:2.0:1772305955.208749:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305955.208756:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305955.208807:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 21 00000040:00080000:2.0:1772305955.208815:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772305955.528827:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1772305956.204114:0:72788:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305956.204121:0:72788:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305956.204219:0:72788:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 21 00000040:00080000:1.0:1772305956.204225:0:72788:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:1.0:1772305956.204247:0:72788:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305956.204248:0:72788:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305956.204306:0:72788:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 21 00000040:00080000:1.0:1772305956.204309:0:72788:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:2.0:1772305956.232733:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305956.232738:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305956.232765:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 21 00000040:00080000:2.0:1772305956.232770:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:0.0:1772305956.552778:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1772305957.256757:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305957.256762:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305957.256789:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 21 00000040:00080000:2.0:1772305957.256795:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:1.0:1772305957.320769:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000676f9e41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216614208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1772305957.320785:0:2992:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1772305957.320799:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011976c6e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216614272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1772305957.320845:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305957.320892:0:7591:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216614208 00000100:00100000:1.0:1772305957.320903:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305957.320942:0:6309:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216614272 00000100:00100000:3.0:1772305957.320946:0:7591:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 469 00000100:00100000:3.0:1772305957.320952:0:7591:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000084e1bde0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216614208:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1772305957.320982:0:6309:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 470 00002000:00000024:3.0:1772305957.320983:0:7591:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 695140352 pending 0 free 3606052864 avail 3603955712 00000100:00100000:1.0:1772305957.320990:0:6309:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002d3be4cb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216614272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1772305957.321016:0:6309:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 742981632 pending 0 free 3828350976 avail 3826253824 00000100:00100000:3.0:1772305957.321029:0:7591:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000084e1bde0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216614208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305957.321035:0:7591:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 469 00000100:00100000:1.0:1772305957.321065:0:6309:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002d3be4cb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216614272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305957.321078:0:6309:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 470 00000100:00100000:1.0:1772305957.321128:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000676f9e41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216614208:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1772305957.321186:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011976c6e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216614272:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1772305957.491658:0:72841:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305957.491663:0:72841:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305957.491775:0:72841:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 21 00000040:00080000:3.0:1772305957.491781:0:72841:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:3.0:1772305957.491816:0:72841:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305957.491818:0:72841:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305957.491885:0:72841:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 21 00000040:00080000:3.0:1772305957.491890:0:72841:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:1.0:1772305957.576780:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772305957.832858:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008a50b90b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:70aae467-c860-409f-ba1b-742f4d042da6:2992:1858396216614336:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1772305957.832873:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000282b51c2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:2993:1858396216614400:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305957.832886:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b0099b15 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:2994:1858396216614464:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1772305957.832944:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772305957.832945:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305957.832954:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011976c6e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2991:1858396216614528:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305957.832998:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772305957.833005:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216614400 00000100:00100000:1.0:1772305957.833033:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216614336 00000100:00100000:2.0:1772305957.833035:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772305957.833052:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216614528 00000100:00100000:3.0:1772305957.833072:0:71804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216614464 00000100:00100000:1.0:1772305957.833080:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1772305957.833085:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1772305957.833089:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000020694155 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2992:x1858396216614336:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1772305957.833093:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004ca67c10 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:2993:x1858396216614400:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1772305957.833097:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1772305957.833105:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d23a5281 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:2991:x1858396216614528:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305957.833112:0:71804:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1772305957.833119:0:71804:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ca616e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:2994:x1858396216614464:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1772305957.833155:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000020694155 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2992:x1858396216614336:12345-0@lo:400:kworker/u8:0.0 Request processed in 67us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305957.833180:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1772305957.833184:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d23a5281 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:2991:x1858396216614528:12345-0@lo:400:kworker/u8:0.0 Request processed in 79us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305957.833191:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004ca67c10 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:2993:x1858396216614400:12345-0@lo:400:kworker/u8:0.0 Request processed in 98us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305957.833194:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1772305957.833207:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1772305957.833208:0:71804:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ca616e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:2994:x1858396216614464:12345-0@lo:400:kworker/u8:0.0 Request processed in 84us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305957.833220:0:71804:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1772305957.833239:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011976c6e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2991:1858396216614528:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1772305957.833255:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008a50b90b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:70aae467-c860-409f-ba1b-742f4d042da6:2992:1858396216614336:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1772305957.833262:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000282b51c2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:2993:1858396216614400:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772305957.833289:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b0099b15 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:2994:1858396216614464:0@lo:400:kworker/u8:0.0 00000040:00080000:2.0:1772305958.280772:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305958.280778:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00100000:2.0:1772305958.280807:0:54732:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 33 in log [0xf:0x1:0x0] 00000040:00080000:2.0:1772305958.280928:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 20 00000040:00080000:2.0:1772305958.280937:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772305958.600795:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1772305958.773207:0:72892:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305958.773211:0:72892:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305958.773274:0:72892:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 20 00000040:00080000:3.0:1772305958.773278:0:72892:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:3.0:1772305958.773298:0:72892:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305958.773299:0:72892:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305958.773351:0:72892:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 20 00000040:00080000:3.0:1772305958.773353:0:72892:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:2.0:1772305959.304800:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305959.304806:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00100000:2.0:1772305959.304844:0:54732:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 34 in log [0xf:0x1:0x0] 00000040:00080000:2.0:1772305959.304926:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 19 00000040:00080000:2.0:1772305959.304933:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772305959.624761:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1772305960.003886:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305960.003918:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305960.003941:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305960.003952:0:54689:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225423744 00000100:00100000:2.0:1772305960.003980:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305960.004004:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225423808 00000100:00100000:0.0:1772305960.004009:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225423872 00000100:00100000:1.0:1772305960.004011:0:54689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 160 00000100:00100000:2.0:1772305960.004019:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305960.004022:0:54689:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000084fb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2216:x1858396225423744:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1772305960.004058:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305960.004073:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225423936 00000100:00100000:3.0:1772305960.004095:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225424000 00000100:00100000:1.0:1772305960.004096:0:54689:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000084fb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2216:x1858396225423744:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 71us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305960.004108:0:54689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 160 00000100:00100000:0.0:1772305960.004110:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225424064 00000100:00100000:2.0:1772305960.004111:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305960.004169:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 188 00000100:00100000:0.0:1772305960.004177:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225424128 00000100:00100000:3.0:1772305960.004179:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d8679794 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2215:x1858396225423808:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:1.0:1772305960.004193:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1220 00000100:00100000:1.0:1772305960.004200:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006483edc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2216:x1858396225423872:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:0.0:1772305960.004221:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1221 00000100:00100000:0.0:1772305960.004229:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000091689862 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2215:x1858396225423936:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:1.0:1772305960.004241:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006483edc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2216:x1858396225423872:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 40us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305960.004250:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1220 00000100:00100000:1.0:1772305960.004272:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1222 00000100:00100000:0.0:1772305960.004275:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000091689862 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2215:x1858396225423936:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 44us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305960.004283:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000094f3bd7e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2215:x1858396225424064:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:0.0:1772305960.004287:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1221 00000100:00100000:0.0:1772305960.004308:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1223 00000100:00100000:0.0:1772305960.004313:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000e418178 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2216:x1858396225424128:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1772305960.004327:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d8679794 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2215:x1858396225423808:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 139us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305960.004329:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000094f3bd7e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2215:x1858396225424064:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 39us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305960.004344:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000e418178 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2216:x1858396225424128:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 30us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305960.004350:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1222 00000100:00100000:0.0:1772305960.004357:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1223 00000100:00100000:2.0:1772305960.004361:0:71804:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 189 00000100:00100000:2.0:1772305960.004370:0:71804:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c30d8750 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2216:x1858396225424000:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1772305960.004406:0:71804:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c30d8750 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2216:x1858396225424000:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 38us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305960.004411:0:71804:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 189 00000100:00100000:3.0:1772305960.004506:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 188 00000040:00080000:2.0:1772305960.062382:0:72943:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305960.062387:0:72943:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305960.062493:0:72943:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 19 00000040:00080000:2.0:1772305960.062498:0:72943:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:2.0:1772305960.062522:0:72943:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305960.062523:0:72943:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305960.062577:0:72943:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 19 00000040:00080000:2.0:1772305960.062580:0:72943:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:2.0:1772305960.328768:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305960.328774:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305960.328800:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 19 00000040:00080000:2.0:1772305960.328807:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:0.0:1772305960.648821:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1772305961.352001:0:72994:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305961.352006:0:72994:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305961.352073:0:72994:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 19 00000040:00080000:3.0:1772305961.352078:0:72994:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:3.0:1772305961.352109:0:72994:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305961.352112:0:72994:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305961.352196:0:72994:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 19 00000040:00080000:3.0:1772305961.352200:0:72994:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:2.0:1772305961.353697:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305961.353701:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305961.353722:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 19 00000040:00080000:2.0:1772305961.353727:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:1.0:1772305961.672773:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1772305962.376763:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305962.376770:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305962.376806:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 19 00000040:00080000:2.0:1772305962.376815:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:1.0:1772305962.440810:0:2991:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1772305962.440827:0:2994:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1772305962.440833:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000012371d1b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216614592:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1772305962.440837:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a41f6911 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216614656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1772305962.440902:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772305962.440966:0:6309:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216614592 00000100:00100000:0.0:1772305962.441025:0:6309:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 471 00000100:00100000:0.0:1772305962.441033:0:6309:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008d141ae1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216614592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1772305962.441070:0:6309:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 742981632 pending 0 free 3828350976 avail 3826253824 00000100:00100000:0.0:1772305962.441127:0:6309:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008d141ae1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216614592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305962.441151:0:6309:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 471 00000100:00100000:0.0:1772305962.441211:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000012371d1b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216614592:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1772305962.441219:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772305962.441246:0:6309:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216614656 00000100:00100000:0.0:1772305962.441282:0:6309:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 472 00000100:00100000:0.0:1772305962.441288:0:6309:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004c826b2e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216614656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1772305962.441310:0:6309:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 695140352 pending 0 free 3606052864 avail 3603955712 00000100:00100000:0.0:1772305962.441358:0:6309:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004c826b2e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216614656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305962.441371:0:6309:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 472 00000100:00100000:1.0:1772305962.441450:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a41f6911 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216614656:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1772305962.631466:0:73047:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305962.631471:0:73047:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305962.631534:0:73047:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 19 00000040:00080000:3.0:1772305962.631538:0:73047:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:3.0:1772305962.631561:0:73047:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305962.631563:0:73047:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305962.631615:0:73047:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 19 00000040:00080000:3.0:1772305962.631617:0:73047:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772305962.696722:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1772305962.952872:0:2993:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1772305962.952883:0:2994:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1772305962.952891:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003b46920d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2991:1858396216614784:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772305962.952893:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003bce9793 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:70aae467-c860-409f-ba1b-742f4d042da6:2993:1858396216614720:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772305962.952897:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a41f6911 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:2994:1858396216614912:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772305962.952920:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000873b4f3c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2992:1858396216614848:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772305962.952976:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772305962.952982:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772305962.953016:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305962.953021:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216614784 00000100:00100000:3.0:1772305962.953054:0:71804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216614848 00000100:00100000:0.0:1772305962.953054:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216614720 00000100:00100000:1.0:1772305962.953068:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1772305962.953074:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000ec0ed54 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:2991:x1858396216614784:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772305962.953094:0:71804:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1772305962.953101:0:71804:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008df3460f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:2992:x1858396216614848:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772305962.953105:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1772305962.953113:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002b8558a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2993:x1858396216614720:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772305962.953145:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000ec0ed54 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:2991:x1858396216614784:12345-0@lo:400:kworker/u8:1.0 Request processed in 70us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305962.953154:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1772305962.953177:0:71804:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008df3460f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:2992:x1858396216614848:12345-0@lo:400:kworker/u8:1.0 Request processed in 76us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305962.953181:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003b46920d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2991:1858396216614784:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772305962.953187:0:71804:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1772305962.953198:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002b8558a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2993:x1858396216614720:12345-0@lo:400:kworker/u8:1.0 Request processed in 81us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305962.953199:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305962.953208:0:71804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216614912 00000100:00100000:0.0:1772305962.953210:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1772305962.953241:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1772305962.953247:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dc9c50ef pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:2994:x1858396216614912:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772305962.953253:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000873b4f3c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2992:1858396216614848:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772305962.953282:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003bce9793 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:70aae467-c860-409f-ba1b-742f4d042da6:2993:1858396216614720:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772305962.953291:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dc9c50ef pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:2994:x1858396216614912:12345-0@lo:400:kworker/u8:1.0 Request processed in 44us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305962.953299:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1772305962.953324:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a41f6911 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:2994:1858396216614912:0@lo:400:kworker/u8:1.0 00000040:00080000:2.0:1772305963.400882:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305963.400890:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305963.400949:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 19 00000040:00080000:2.0:1772305963.400957:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772305963.720733:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1772305963.906151:0:73098:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305963.906156:0:73098:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305963.906218:0:73098:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 19 00000040:00080000:2.0:1772305963.906222:0:73098:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:2.0:1772305963.906250:0:73098:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305963.906251:0:73098:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305963.906303:0:73098:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 19 00000040:00080000:2.0:1772305963.906305:0:73098:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:2.0:1772305964.424765:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305964.424771:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00100000:2.0:1772305964.424811:0:54732:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 35 in log [0xf:0x1:0x0] 00000040:00080000:2.0:1772305964.424920:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 18 00000040:00080000:2.0:1772305964.424925:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:0.0:1772305964.744824:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1772305965.123707:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305965.123742:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305965.123763:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225424192 00000100:00100000:1.0:1772305965.123818:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225424256 00000100:00100000:0.0:1772305965.123825:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 162 00000100:00100000:0.0:1772305965.123834:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008ba675a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2217:x1858396225424192:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:1.0:1772305965.123869:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 193 00000100:00100000:1.0:1772305965.123876:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000096e59de2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2217:x1858396225424256:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1772305965.123903:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305965.123914:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008ba675a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2217:x1858396225424192:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 79us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305965.123923:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000096e59de2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2217:x1858396225424256:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 42us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305965.123931:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 162 00000100:00100000:1.0:1772305965.123936:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 193 00000100:00100000:1.0:1772305965.123985:0:18149:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225424384 00000100:00100000:2.0:1772305965.123992:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305965.124026:0:18149:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225424320 00000100:00100000:0.0:1772305965.124037:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1224 00000100:00100000:0.0:1772305965.124043:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008806aae9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2218:x1858396225424384:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:1.0:1772305965.124062:0:18149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1225 00000100:00100000:1.0:1772305965.124069:0:18149:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000161e896c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2217:x1858396225424320:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:0.0:1772305965.124081:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008806aae9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2218:x1858396225424384:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 36us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305965.124093:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1224 00000100:00100000:2.0:1772305965.124099:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305965.124106:0:18149:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000161e896c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2217:x1858396225424320:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 34us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305965.124129:0:18149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1225 00000100:00100000:0.0:1772305965.124151:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225424448 00000100:00100000:0.0:1772305965.124191:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 194 00000100:00100000:0.0:1772305965.124195:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005d647dd1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2217:x1858396225424448:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1772305965.124224:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305965.124254:0:18149:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225424512 00000100:00100000:0.0:1772305965.124269:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005d647dd1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2217:x1858396225424448:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 70us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305965.124279:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 194 00000100:00100000:1.0:1772305965.124285:0:18149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1226 00000100:00100000:1.0:1772305965.124293:0:18149:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000815b9e7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2218:x1858396225424512:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:1.0:1772305965.124333:0:18149:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000815b9e7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2218:x1858396225424512:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 41us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305965.124341:0:18149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1226 00000100:00100000:3.0:1772305965.124503:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305965.124549:0:18149:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225424576 00000100:00100000:1.0:1772305965.124577:0:18149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1227 00000100:00100000:1.0:1772305965.124581:0:18149:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000038ede71c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2217:x1858396225424576:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:1.0:1772305965.124710:0:18149:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000038ede71c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2217:x1858396225424576:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 127us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305965.124718:0:18149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1227 00000040:00080000:2.0:1772305965.180739:0:73149:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305965.180744:0:73149:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305965.180829:0:73149:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 18 00000040:00080000:2.0:1772305965.180835:0:73149:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:2.0:1772305965.448812:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305965.448822:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00100000:2.0:1772305965.448872:0:54732:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 36 in log [0xf:0x1:0x0] 00000040:00080000:2.0:1772305965.448954:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 17 00000040:00080000:2.0:1772305965.448961:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:1.0:1772305965.768811:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1772305966.469727:0:73200:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305966.469734:0:73200:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305966.469807:0:73200:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 17 00000040:00080000:3.0:1772305966.469811:0:73200:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:2.0:1772305966.472725:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305966.472728:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305966.472750:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 17 00000040:00080000:2.0:1772305966.472754:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772305966.792787:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1772305967.496806:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305967.496812:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305967.496838:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 17 00000040:00080000:2.0:1772305967.496843:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:3.0:1772305967.560780:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000080e4cc77 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216614976:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1772305967.560853:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009b7fc1cf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216615040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1772305967.560877:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772305967.560948:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305967.560986:0:6309:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216614976 00000100:00100000:0.0:1772305967.561001:0:6310:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216615040 00000100:00100000:0.0:1772305967.561049:0:6310:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 473 00000100:00100000:0.0:1772305967.561059:0:6310:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ae1f1e77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216614976:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1772305967.561087:0:55611:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 474 00002000:00000024:0.0:1772305967.561109:0:6310:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 742981632 pending 0 free 3828350976 avail 3826253824 00000100:00100000:3.0:1772305967.561111:0:55611:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000282b51c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216615040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1772305967.561141:0:55611:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 695140352 pending 0 free 3606052864 avail 3603955712 00000100:00100000:0.0:1772305967.561172:0:6310:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ae1f1e77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216614976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305967.561182:0:6310:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 473 00000100:00100000:3.0:1772305967.561200:0:55611:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000282b51c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216615040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305967.561209:0:55611:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 474 00000100:00100000:3.0:1772305967.561275:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009b7fc1cf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216615040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1772305967.561275:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000080e4cc77 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216614976:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1772305967.743948:0:73254:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305967.743953:0:73254:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305967.744023:0:73254:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 17 00000040:00080000:2.0:1772305967.744026:0:73254:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772305967.816752:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1772305968.072781:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000002b05fb2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:2994:1858396216615232:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772305968.072781:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a3ed84e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:2993:1858396216615168:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772305968.072786:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005f1fba5b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:70aae467-c860-409f-ba1b-742f4d042da6:2992:1858396216615104:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772305968.072797:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d23582b4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2991:1858396216615296:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772305968.072884:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772305968.072886:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305968.072941:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216615232 00000100:00100000:3.0:1772305968.072952:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216615104 00000100:00100000:2.0:1772305968.072975:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305968.072996:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216615296 00000100:00100000:3.0:1772305968.072998:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1772305968.073005:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000073ab1f7b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2992:x1858396216615104:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772305968.073010:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1772305968.073018:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009b6b3602 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:2994:x1858396216615232:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772305968.073043:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1772305968.073053:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000081fffd7c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:2991:x1858396216615296:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772305968.073063:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000073ab1f7b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2992:x1858396216615104:12345-0@lo:400:kworker/u8:1.0 Request processed in 57us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305968.073071:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1772305968.073086:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009b6b3602 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:2994:x1858396216615232:12345-0@lo:400:kworker/u8:1.0 Request processed in 66us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305968.073110:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1772305968.073117:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005f1fba5b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:70aae467-c860-409f-ba1b-742f4d042da6:2992:1858396216615104:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772305968.073138:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000081fffd7c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:2991:x1858396216615296:12345-0@lo:400:kworker/u8:1.0 Request processed in 82us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305968.073148:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1772305968.073154:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000002b05fb2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:2994:1858396216615232:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772305968.073159:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305968.073174:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216615168 00000100:00100000:2.0:1772305968.073184:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d23582b4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2991:1858396216615296:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772305968.073227:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1772305968.073235:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000000d187c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:2993:x1858396216615168:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772305968.073278:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000000d187c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:2993:x1858396216615168:12345-0@lo:400:kworker/u8:1.0 Request processed in 45us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305968.073285:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1772305968.073322:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a3ed84e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:2993:1858396216615168:0@lo:400:kworker/u8:1.0 00000040:00080000:2.0:1772305968.520903:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305968.520917:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305968.520986:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 17 00000040:00080000:2.0:1772305968.520996:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:0.0:1772305968.840763:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1772305969.065923:0:73305:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772305969.065930:0:73305:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772305969.066018:0:73305:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 17 00000040:00080000:0.0:1772305969.066022:0:73305:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:2.0:1772305969.544798:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305969.544806:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305969.544839:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 17 00000040:00080000:2.0:1772305969.544846:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:1.0:1772305969.864777:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1772305970.243987:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305970.244071:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305970.244088:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225424640 00000100:00100000:0.0:1772305970.244127:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305970.244152:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 164 00000100:00100000:3.0:1772305970.244159:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000324275e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2218:x1858396225424640:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1772305970.244165:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225424704 00000100:00100000:0.0:1772305970.244173:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305970.244204:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305970.244223:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225424896 00000100:00100000:3.0:1772305970.244244:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000324275e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2218:x1858396225424640:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 81us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305970.244256:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 164 00000100:00100000:0.0:1772305970.244260:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305970.244267:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 198 00000100:00100000:2.0:1772305970.244279:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000763eeae7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2217:x1858396225424704:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1772305970.244314:0:71804:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 199 00000100:00100000:3.0:1772305970.244322:0:71804:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008a50b90b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2218:x1858396225424896:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1772305970.244335:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000763eeae7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2217:x1858396225424704:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 56us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305970.244349:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 198 00000100:00100000:3.0:1772305970.244366:0:71804:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008a50b90b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2218:x1858396225424896:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 41us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305970.244376:0:71804:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 199 00000100:00100000:0.0:1772305970.244395:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305970.244440:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225424768 00000100:00100000:2.0:1772305970.244445:0:48463:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225424832 00000100:00100000:0.0:1772305970.244488:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225424960 00000100:00100000:2.0:1772305970.244504:0:48463:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225425024 00000100:00100000:0.0:1772305970.244524:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1228 00000100:00100000:0.0:1772305970.244531:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000009b41aad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2218:x1858396225424768:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1772305970.244560:0:48463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1229 00000100:00100000:0.0:1772305970.244570:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000009b41aad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2218:x1858396225424768:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 35us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305970.244576:0:48463:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b0099b15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2217:x1858396225424832:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:0.0:1772305970.244586:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1228 00000100:00100000:0.0:1772305970.244647:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1230 00000100:00100000:0.0:1772305970.244652:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000011976c6e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2217:x1858396225424960:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1772305970.244742:0:48463:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b0099b15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2217:x1858396225424832:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 168us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305970.244749:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000011976c6e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2217:x1858396225424960:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 90us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305970.244766:0:48463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1229 00000100:00100000:0.0:1772305970.244775:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1230 00000100:00100000:2.0:1772305970.244797:0:48463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1231 00000100:00100000:2.0:1772305970.244809:0:48463:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003132ee1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2218:x1858396225425024:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1772305970.244850:0:48463:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003132ee1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2218:x1858396225425024:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 43us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305970.244859:0:48463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1231 00000040:00080000:3.0:1772305970.368553:0:73357:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305970.368560:0:73357:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305970.368687:0:73357:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 17 00000040:00080000:3.0:1772305970.368692:0:73357:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:2.0:1772305970.568797:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305970.568805:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305970.568845:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 17 00000040:00080000:2.0:1772305970.568852:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772305970.888831:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1772305971.592762:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305971.592769:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305971.592807:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 17 00000040:00080000:2.0:1772305971.592813:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:0.0:1772305971.672437:0:73408:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772305971.672442:0:73408:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772305971.672511:0:73408:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 17 00000040:00080000:0.0:1772305971.672516:0:73408:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772305971.912795:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1772305972.616820:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305972.616841:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00100000:2.0:1772305972.616880:0:54732:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 37 in log [0xf:0x1:0x0] 00000040:00080000:2.0:1772305972.617027:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 16 00000040:00080000:2.0:1772305972.617034:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:3.0:1772305972.680943:0:2994:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1772305972.680950:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d23582b4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216615424:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1772305972.680973:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000747b88e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216615360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1772305972.681029:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305972.681102:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772305972.681161:0:6309:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216615424 00000100:00100000:3.0:1772305972.681197:0:55611:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216615360 00000100:00100000:2.0:1772305972.681252:0:7591:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 475 00000100:00100000:2.0:1772305972.681261:0:7591:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005f1fba5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216615424:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1772305972.681279:0:55611:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 476 00000100:00100000:3.0:1772305972.681292:0:55611:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a870219c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216615360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1772305972.681297:0:7591:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 742981632 pending 0 free 3828350976 avail 3826253824 00002000:00000024:3.0:1772305972.681347:0:55611:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 695140352 pending 0 free 3606052864 avail 3603955712 00000100:00100000:2.0:1772305972.681369:0:7591:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005f1fba5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216615424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305972.681381:0:7591:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 475 00000100:00100000:3.0:1772305972.681445:0:55611:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a870219c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216615360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 149us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305972.681462:0:55611:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 476 00000100:00100000:2.0:1772305972.681476:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d23582b4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216615424:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1772305972.681580:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000747b88e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216615360:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1772305972.936795:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1772305973.002186:0:73461:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305973.002197:0:73461:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305973.002334:0:73461:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 16 00000040:00080000:1.0:1772305973.002360:0:73461:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:1.0:1772305973.192897:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d23582b4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:70aae467-c860-409f-ba1b-742f4d042da6:2994:1858396216615488:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772305973.192973:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000df58eb45 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2991:1858396216615552:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772305973.192994:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000339dc28b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216615680:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772305973.193035:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ba314d1a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2992:1858396216615616:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772305973.193038:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305973.193107:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305973.193136:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a3ed84e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216615744:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772305973.193137:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772305973.193188:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305973.193203:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000002b05fb2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2991:1858396216615808:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772305973.193244:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772305973.193245:0:54689:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216615488 00000100:00100000:3.0:1772305973.193269:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772305973.193339:0:54689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1772305973.193343:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216615552 00000100:00100000:0.0:1772305973.193351:0:54689:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ad4fae50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70aae467-c860-409f-ba1b-742f4d042da6+18:2994:x1858396216615488:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772305973.193355:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216615680 00000100:00100000:3.0:1772305973.193371:0:71804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216615616 00000100:00100000:2.0:1772305973.193441:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216615808 00000100:00100000:1.0:1772305973.193448:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216615744 00000100:00100000:0.0:1772305973.193456:0:54689:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ad4fae50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70aae467-c860-409f-ba1b-742f4d042da6+18:2994:x1858396216615488:12345-0@lo:400:kworker/u8:1.0 Request processed in 100us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305973.193461:0:71804:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1772305973.193487:0:71804:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f237ebcd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:2991:x1858396216615552:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772305973.193488:0:54689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1772305973.193501:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1232 00000100:00100000:1.0:1772305973.193514:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e72c7c57 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216615680:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772305973.193525:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1772305973.193538:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a41f6911 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:2992:x1858396216615616:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772305973.193590:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1233 00000100:00100000:0.0:1772305973.193614:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b4a2cd7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216615744:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772305973.193616:0:71804:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f237ebcd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:2991:x1858396216615552:12345-0@lo:400:kworker/u8:1.0 Request processed in 127us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305973.193619:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e72c7c57 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216615680:12345-0@lo:400:kworker/u8:1.0 Request processed in 105us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305973.193683:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1232 00000100:00100000:2.0:1772305973.193704:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a41f6911 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:2992:x1858396216615616:12345-0@lo:400:kworker/u8:1.0 Request processed in 159us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305973.193724:0:71804:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1772305973.193744:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1772305973.193761:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000339dc28b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216615680:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772305973.193779:0:71804:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1772305973.193783:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b4a2cd7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216615744:12345-0@lo:400:kworker/u8:1.0 Request processed in 177us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305973.193794:0:71804:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000747b88e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:2991:x1858396216615808:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772305973.193805:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1233 00000100:00100000:1.0:1772305973.193869:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a3ed84e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216615744:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772305973.193889:0:71804:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000747b88e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:2991:x1858396216615808:12345-0@lo:400:kworker/u8:1.0 Request processed in 91us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305973.193895:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ba314d1a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2992:1858396216615616:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772305973.193904:0:71804:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1772305973.193910:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d23582b4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:70aae467-c860-409f-ba1b-742f4d042da6:2994:1858396216615488:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772305973.193964:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000002b05fb2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2991:1858396216615808:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772305973.193977:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000df58eb45 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2991:1858396216615552:0@lo:400:kworker/u8:1.0 00000040:00080000:2.0:1772305973.640833:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305973.640843:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305973.640876:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 16 00000040:00080000:2.0:1772305973.640883:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:1.0:1772305973.960978:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1772305974.376182:0:73512:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772305974.376187:0:73512:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772305974.376255:0:73512:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 16 00000040:00080000:0.0:1772305974.376259:0:73512:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:2.0:1772305974.664786:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305974.664793:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00100000:2.0:1772305974.664823:0:54732:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 38 in log [0xf:0x1:0x0] 00000040:00080000:2.0:1772305974.664946:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 15 00000040:00080000:2.0:1772305974.664952:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772305974.984766:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1772305975.363990:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305975.364129:0:71804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225425152 00000100:00100000:3.0:1772305975.364230:0:71804:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 203 00000100:00100000:3.0:1772305975.364242:0:71804:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003bce9793 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2218:x1858396225425152:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1772305975.364263:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305975.364319:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305975.364396:0:6308:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225425280 00000100:00100000:3.0:1772305975.364399:0:71804:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003bce9793 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2218:x1858396225425152:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 145us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305975.364411:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225425088 00000100:00100000:3.0:1772305975.364420:0:71804:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 203 00000100:00100000:2.0:1772305975.364437:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305975.364502:0:6308:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225425216 00000100:00100000:1.0:1772305975.364548:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 166 00000100:00100000:3.0:1772305975.364549:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1234 00000100:00100000:0.0:1772305975.364579:0:6308:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1235 00000100:00100000:3.0:1772305975.364581:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000873b4f3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2218:x1858396225425280:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:1.0:1772305975.364594:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000db950d37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2217:x1858396225425088:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:0.0:1772305975.364610:0:6308:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003b46920d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2217:x1858396225425216:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1772305975.364719:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000873b4f3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2218:x1858396225425280:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 154us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305975.364733:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1234 00000100:00100000:0.0:1772305975.364775:0:6308:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003b46920d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2217:x1858396225425216:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 163us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305975.364789:0:6308:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1235 00000100:00100000:2.0:1772305975.364805:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305975.364815:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000db950d37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2217:x1858396225425088:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 242us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305975.364828:0:6308:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225425408 00000100:00100000:1.0:1772305975.364834:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 166 00000100:00100000:0.0:1772305975.364909:0:6308:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1236 00000100:00100000:0.0:1772305975.364921:0:6308:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000924bcdea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2218:x1858396225425408:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:0.0:1772305975.364990:0:6308:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000924bcdea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2218:x1858396225425408:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 66us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305975.365004:0:6308:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1236 00000100:00100000:2.0:1772305975.365219:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305975.365302:0:71804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225425344 00000100:00100000:0.0:1772305975.365368:0:71804:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 204 00000100:00100000:0.0:1772305975.365376:0:71804:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cd147362 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2217:x1858396225425344:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1772305975.365410:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305975.365474:0:71804:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cd147362 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2217:x1858396225425344:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 96us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305975.365484:0:71804:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 204 00000100:00100000:3.0:1772305975.365871:0:6308:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225425472 00000100:00100000:3.0:1772305975.365932:0:6308:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1237 00000100:00100000:3.0:1772305975.365942:0:6308:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a26b6941 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2217:x1858396225425472:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1772305975.366158:0:6308:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a26b6941 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2217:x1858396225425472:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 216us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305975.366168:0:6308:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1237 00000040:00080000:2.0:1772305975.688792:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305975.688797:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305975.688844:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 15 00000040:00080000:2.0:1772305975.688851:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:3.0:1772305975.761963:0:73563:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305975.761972:0:73563:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305975.762115:0:73563:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 15 00000040:00080000:3.0:1772305975.762124:0:73563:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772305976.008908:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1772305976.712920:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305976.712928:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305976.712973:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 15 00000040:00080000:2.0:1772305976.712982:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:0.0:1772305977.033745:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1772305977.164342:0:73615:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772305977.164346:0:73615:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772305977.164409:0:73615:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 15 00000040:00080000:0.0:1772305977.164414:0:73615:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:2.0:1772305977.736858:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305977.736870:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305977.736938:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 15 00000040:00080000:2.0:1772305977.736949:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:2.0:1772305977.800902:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000049ea3c34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216615872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1772305977.800974:0:2994:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1772305977.801013:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000080e4cc77 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216615936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1772305977.801140:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305977.801250:0:6310:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216615872 00000100:00100000:2.0:1772305977.801260:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305977.801364:0:6310:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216615936 00000100:00100000:3.0:1772305977.801421:0:6310:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 477 00000100:00100000:3.0:1772305977.801434:0:6310:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008e341f60 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216615872:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1772305977.801484:0:7591:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 478 00002000:00000024:3.0:1772305977.801497:0:6310:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 742981632 pending 0 free 3828350976 avail 3826253824 00000100:00100000:0.0:1772305977.801506:0:7591:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009adfd4b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216615936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1772305977.801548:0:7591:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 695140352 pending 0 free 3606052864 avail 3603955712 00000100:00100000:3.0:1772305977.801782:0:6310:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008e341f60 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216615872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 339us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305977.801800:0:6310:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 477 00000100:00100000:0.0:1772305977.801930:0:7591:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009adfd4b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216615936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 427us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305977.801943:0:7591:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 478 00000100:00100000:2.0:1772305977.802053:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000080e4cc77 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216615936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1772305977.802188:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000049ea3c34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216615872:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1772305978.056867:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1772305978.312926:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000012371d1b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:70aae467-c860-409f-ba1b-742f4d042da6:2994:1858396216616000:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772305978.312961:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000676f9e41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2991:1858396216616064:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772305978.312961:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007e97bd92 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2992:1858396216616128:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772305978.313052:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305978.313059:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772305978.313072:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085c3cd20 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216616192:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772305978.313119:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004f59895e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216616256:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772305978.313121:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000fb2f2c9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2991:1858396216616320:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772305978.313125:0:54689:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216616000 00000100:00100000:0.0:1772305978.313127:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772305978.313185:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305978.313192:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772305978.313198:0:71804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216616064 00000100:00100000:3.0:1772305978.313201:0:54689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1772305978.313211:0:54689:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001c628d59 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70aae467-c860-409f-ba1b-742f4d042da6+18:2994:x1858396216616000:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772305978.313257:0:48463:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216616192 00000100:00100000:0.0:1772305978.313262:0:71804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216616320 00000100:00100000:1.0:1772305978.313271:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1772305978.313279:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009b7fc1cf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:2991:x1858396216616064:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772305978.313293:0:54689:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001c628d59 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70aae467-c860-409f-ba1b-742f4d042da6+18:2994:x1858396216616000:12345-0@lo:400:kworker/u8:1.0 Request processed in 80us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305978.313303:0:54689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1772305978.313308:0:71804:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1772305978.313315:0:48463:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216616256 00000100:00100000:0.0:1772305978.313319:0:71804:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000df58eb45 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:2991:x1858396216616320:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772305978.313347:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009b7fc1cf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:2991:x1858396216616064:12345-0@lo:400:kworker/u8:1.0 Request processed in 66us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305978.313355:0:48463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1238 00000100:00100000:1.0:1772305978.313360:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1772305978.313367:0:48463:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000085acb02d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216616192:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772305978.313381:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1239 00000100:00100000:0.0:1772305978.313382:0:71804:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000df58eb45 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:2991:x1858396216616320:12345-0@lo:400:kworker/u8:1.0 Request processed in 64us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305978.313394:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009e643511 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216616256:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772305978.313398:0:71804:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1772305978.313424:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000fb2f2c9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2991:1858396216616320:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772305978.313436:0:48463:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000085acb02d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216616192:12345-0@lo:400:kworker/u8:1.0 Request processed in 70us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305978.313464:0:48463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1238 00000100:00100000:1.0:1772305978.313473:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000676f9e41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2991:1858396216616064:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772305978.313502:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085c3cd20 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216616192:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772305978.313503:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009e643511 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216616256:12345-0@lo:400:kworker/u8:1.0 Request processed in 105us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305978.313520:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1239 00000100:00100000:1.0:1772305978.313551:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772305978.313572:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004f59895e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216616256:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772305978.313616:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000012371d1b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:70aae467-c860-409f-ba1b-742f4d042da6:2994:1858396216616000:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772305978.313618:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216616128 00000100:00100000:0.0:1772305978.313679:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1772305978.313686:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000002b05fb2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:2992:x1858396216616128:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772305978.313730:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000002b05fb2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:2992:x1858396216616128:12345-0@lo:400:kworker/u8:1.0 Request processed in 46us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305978.313736:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1772305978.313791:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007e97bd92 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2992:1858396216616128:0@lo:400:kworker/u8:1.0 00000040:00080000:0.0:1772305978.499871:0:73668:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772305978.499878:0:73668:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772305978.499940:0:73668:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 15 00000040:00080000:0.0:1772305978.499944:0:73668:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:2.0:1772305978.760903:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305978.760915:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305978.760964:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 15 00000040:00080000:2.0:1772305978.760975:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772305979.080865:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1772305979.784845:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772305979.784852:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772305979.784903:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 15 00000040:00080000:0.0:1772305979.784910:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:1.0:1772305979.806289:0:73719:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305979.806295:0:73719:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305979.806365:0:73719:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 15 00000040:00080000:1.0:1772305979.806370:0:73719:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772305980.104921:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772305980.483849:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305980.483889:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305980.483930:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305980.483947:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225425536 00000100:00100000:3.0:1772305980.483957:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225425664 00000100:00100000:1.0:1772305980.483975:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305980.483983:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225425792 00000100:00100000:1.0:1772305980.484030:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305980.484039:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225425920 00000100:00100000:0.0:1772305980.484044:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 168 00000100:00100000:2.0:1772305980.484049:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225425600 00000100:00100000:0.0:1772305980.484055:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000248f02fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2215:x1858396225425536:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1772305980.484070:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305980.484073:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1240 00000100:00100000:3.0:1772305980.484080:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fc5f2f70 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2215:x1858396225425664:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1772305980.484084:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 208 00000100:00100000:2.0:1772305980.484091:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d23582b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2215:x1858396225425792:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1772305980.484155:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d23582b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2215:x1858396225425792:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 62us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305980.484164:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fc5f2f70 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2215:x1858396225425664:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 74us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305980.484164:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000248f02fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2215:x1858396225425536:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 101us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305980.484171:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305980.484176:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 208 00000100:00100000:3.0:1772305980.484187:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1240 00000100:00100000:0.0:1772305980.484193:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 168 00000100:00100000:2.0:1772305980.484201:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 209 00000100:00100000:2.0:1772305980.484205:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ba314d1a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2215:x1858396225425600:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1772305980.484231:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ba314d1a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2215:x1858396225425600:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 25us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305980.484237:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 209 00000100:00100000:0.0:1772305980.484268:0:6308:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225425728 00000100:00100000:2.0:1772305980.484269:0:48463:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225425856 00000100:00100000:0.0:1772305980.484310:0:6308:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1241 00000100:00100000:2.0:1772305980.484321:0:48463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1242 00000100:00100000:0.0:1772305980.484322:0:6308:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a3ed84e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2215:x1858396225425920:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1772305980.484336:0:48463:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000339dc28b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2215:x1858396225425728:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1772305980.484337:0:18149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1243 00000100:00100000:1.0:1772305980.484349:0:18149:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009692b1d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2215:x1858396225425856:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:0.0:1772305980.484361:0:6308:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a3ed84e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2215:x1858396225425920:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 44us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305980.484374:0:6308:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1241 00000100:00100000:2.0:1772305980.484375:0:48463:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000339dc28b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2215:x1858396225425728:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 40us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305980.484383:0:48463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1242 00000100:00100000:1.0:1772305980.484394:0:18149:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009692b1d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2215:x1858396225425856:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 45us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305980.484406:0:18149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1243 00000040:00080000:0.0:1772305980.808938:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772305980.808949:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772305980.808989:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 15 00000040:00080000:0.0:1772305980.808997:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:2.0:1772305981.116496:0:73770:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305981.116502:0:73770:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305981.116598:0:73770:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 15 00000040:00080000:2.0:1772305981.116603:0:73770:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:0.0:1772305981.128718:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1772305981.832886:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772305981.832897:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772305981.832944:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 15 00000040:00080000:0.0:1772305981.832953:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:1.0:1772305982.152993:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1772305982.430067:0:73821:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305982.430075:0:73821:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305982.430174:0:73821:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 15 00000040:00080000:3.0:1772305982.430181:0:73821:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:0.0:1772305982.856905:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772305982.856914:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772305982.856952:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 15 00000040:00080000:0.0:1772305982.856959:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:2.0:1772305982.920800:0:2994:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1772305982.920820:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000db3403a9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216616384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1772305982.920820:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000065549302 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216616448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1772305982.920918:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772305982.920979:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305982.920980:0:6310:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216616448 00000100:00100000:2.0:1772305982.921042:0:7591:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216616384 00000100:00100000:3.0:1772305982.921060:0:6310:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 479 00000100:00100000:3.0:1772305982.921069:0:6310:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000039584847 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216616448:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1772305982.921092:0:7591:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 480 00000100:00100000:2.0:1772305982.921098:0:7591:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d410c5a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216616384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1772305982.921118:0:6310:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 742981632 pending 0 free 3828350976 avail 3826253824 00002000:00000024:2.0:1772305982.921128:0:7591:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 695140352 pending 0 free 3606052864 avail 3603955712 00000100:00100000:3.0:1772305982.921188:0:6310:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000039584847 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216616448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305982.921200:0:6310:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 479 00000100:00100000:2.0:1772305982.921201:0:7591:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d410c5a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216616384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305982.921211:0:7591:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 480 00000100:00100000:3.0:1772305982.921281:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000065549302 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216616448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1772305982.921281:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000db3403a9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216616384:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1772305983.176925:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1772305983.433221:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000184f2b0a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:70aae467-c860-409f-ba1b-742f4d042da6:2994:1858396216616512:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772305983.433286:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004486c7f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2991:1858396216616576:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772305983.433293:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000066c449e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2992:1858396216616640:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772305983.433332:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305983.433357:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772305983.433365:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004bdec287 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216616704:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772305983.433388:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002e5d5c7c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216616768:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772305983.433416:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772305983.433446:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216616640 00000100:00100000:0.0:1772305983.433493:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216616704 00000100:00100000:2.0:1772305983.433534:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1772305983.433546:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004c9f0c35 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:2992:x1858396216616640:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772305983.433562:0:54689:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216616512 00000100:00100000:0.0:1772305983.433563:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1244 00000100:00100000:0.0:1772305983.433573:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f5fe1428 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216616704:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772305983.433579:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305983.433608:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ffad9327 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2991:1858396216616832:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772305983.433679:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004c9f0c35 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:2992:x1858396216616640:12345-0@lo:400:kworker/u8:1.0 Request processed in 133us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305983.433688:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f5fe1428 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216616704:12345-0@lo:400:kworker/u8:1.0 Request processed in 115us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305983.433692:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1772305983.433700:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772305983.433706:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1244 00000100:00100000:2.0:1772305983.433730:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216616576 00000100:00100000:0.0:1772305983.433757:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1772305983.433764:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000001ef4b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2994:x1858396216616512:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772305983.433767:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216616832 00000100:00100000:2.0:1772305983.433799:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1772305983.433805:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004bdec287 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216616704:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772305983.433812:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e0d19a66 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:2991:x1858396216616576:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772305983.433812:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000001ef4b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2994:x1858396216616512:12345-0@lo:400:kworker/u8:1.0 Request processed in 43us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305983.433827:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1772305983.433858:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1772305983.433865:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e6635d8a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:2991:x1858396216616832:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772305983.433893:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e0d19a66 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:2991:x1858396216616576:12345-0@lo:400:kworker/u8:1.0 Request processed in 86us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305983.433904:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1772305983.433909:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000066c449e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2992:1858396216616640:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772305983.433919:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e6635d8a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:2991:x1858396216616832:12345-0@lo:400:kworker/u8:1.0 Request processed in 51us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305983.433928:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1772305983.433980:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004486c7f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2991:1858396216616576:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772305983.434017:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ffad9327 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2991:1858396216616832:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772305983.434144:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772305983.434218:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216616768 00000100:00100000:3.0:1772305983.434233:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000184f2b0a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:70aae467-c860-409f-ba1b-742f4d042da6:2994:1858396216616512:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772305983.434275:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1245 00000100:00100000:0.0:1772305983.434287:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a85e5eb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216616768:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772305983.434360:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a85e5eb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216616768:12345-0@lo:400:kworker/u8:1.0 Request processed in 76us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305983.434367:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1245 00000100:00100000:3.0:1772305983.434428:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002e5d5c7c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216616768:0@lo:400:kworker/u8:1.0 00000040:00080000:0.0:1772305983.789451:0:73873:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772305983.789458:0:73873:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772305983.789524:0:73873:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 15 00000040:00080000:0.0:1772305983.789529:0:73873:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:0.0:1772305983.880797:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772305983.880804:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772305983.880838:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 15 00000040:00080000:0.0:1772305983.880843:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772305984.200864:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1772305984.904829:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772305984.904837:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772305984.904883:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 15 00000040:00080000:0.0:1772305984.904891:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:2.0:1772305985.096959:0:73924:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305985.096964:0:73924:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305985.097053:0:73924:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 15 00000040:00080000:2.0:1772305985.097059:0:73924:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:0.0:1772305985.224741:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772305985.604155:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305985.604224:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305985.604248:0:71804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225426048 00000100:00100000:1.0:1772305985.604264:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305985.604293:0:54689:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225425984 00000100:00100000:1.0:1772305985.604320:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305985.604342:0:54689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 170 00000100:00100000:2.0:1772305985.604350:0:71804:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 213 00000100:00100000:3.0:1772305985.604355:0:54689:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d866bd46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2216:x1858396225425984:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1772305985.604369:0:71804:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004bdec287 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2215:x1858396225426048:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1772305985.604370:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305985.604371:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225426176 00000100:00100000:1.0:1772305985.604411:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305985.604418:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225426112 00000100:00100000:0.0:1772305985.604446:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225426304 00000100:00100000:3.0:1772305985.604450:0:54689:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d866bd46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2216:x1858396225425984:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 98us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305985.604459:0:71804:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004bdec287 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2215:x1858396225426048:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 92us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305985.604471:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1246 00000100:00100000:3.0:1772305985.604478:0:54689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 170 00000100:00100000:2.0:1772305985.604484:0:71804:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 213 00000100:00100000:0.0:1772305985.604484:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000002171660 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2215:x1858396225426176:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1772305985.604528:0:71804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225426240 00000100:00100000:0.0:1772305985.604536:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000002171660 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2215:x1858396225426176:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 56us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305985.604549:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1246 00000100:00100000:3.0:1772305985.604560:0:48463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1247 00000100:00100000:3.0:1772305985.604567:0:48463:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002e5d5c7c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2216:x1858396225426112:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1772305985.604580:0:71804:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 214 00000100:00100000:0.0:1772305985.604586:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1248 00000100:00100000:1.0:1772305985.604592:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305985.604594:0:71804:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ffad9327 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2216:x1858396225426240:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:3.0:1772305985.604608:0:48463:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002e5d5c7c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2216:x1858396225426112:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 31us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305985.604608:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000184f2b0a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2215:x1858396225426304:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:3.0:1772305985.604673:0:48463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1247 00000100:00100000:3.0:1772305985.604695:0:48463:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225426368 00000100:00100000:2.0:1772305985.604710:0:71804:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ffad9327 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2216:x1858396225426240:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 115us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305985.604716:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000184f2b0a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2215:x1858396225426304:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 114us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305985.604728:0:48463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1249 00000100:00100000:2.0:1772305985.604735:0:71804:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 214 00000100:00100000:0.0:1772305985.604744:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1248 00000100:00100000:3.0:1772305985.604745:0:48463:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004486c7f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2216:x1858396225426368:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:3.0:1772305985.604787:0:48463:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004486c7f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2216:x1858396225426368:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 50us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305985.604793:0:48463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1249 00000040:00080000:0.0:1772305985.928787:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772305985.928795:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00100000:0.0:1772305985.928836:0:54732:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 39 in log [0xf:0x1:0x0] 00000040:00080000:0.0:1772305985.928989:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 14 00000040:00080000:0.0:1772305985.928995:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:0.0:1772305986.248769:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1772305986.408421:0:73976:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305986.408429:0:73976:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305986.408508:0:73976:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 14 00000040:00080000:2.0:1772305986.408514:0:73976:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:0.0:1772305986.952885:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772305986.952894:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00100000:0.0:1772305986.952935:0:54732:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 40 in log [0xf:0x1:0x0] 00000040:00080000:0.0:1772305986.953054:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 13 00000040:00080000:0.0:1772305986.953061:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772305987.272890:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1772305987.697923:0:74027:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305987.697930:0:74027:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305987.698035:0:74027:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 13 00000040:00080000:3.0:1772305987.698043:0:74027:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:0.0:1772305987.976816:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772305987.976826:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00100000:0.0:1772305987.976867:0:54732:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 41 in log [0xf:0x1:0x0] 00000040:00080000:0.0:1772305987.977003:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 12 00000040:00080000:0.0:1772305987.977010:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:0.0:1772305988.040952:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e72c7c57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216616896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1772305988.041007:0:2994:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1772305988.041032:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e9e81c30 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216616960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1772305988.041094:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772305988.041154:0:55611:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216616896 00000100:00100000:2.0:1772305988.041236:0:55611:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 481 00000100:00100000:2.0:1772305988.041245:0:55611:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000085acb02d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216616896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1772305988.041309:0:55611:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 695140352 pending 0 free 3606052864 avail 3603955712 00000100:00100000:3.0:1772305988.041445:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772305988.041478:0:55611:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000085acb02d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216616896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 229us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305988.041493:0:55611:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 481 00000100:00100000:3.0:1772305988.041508:0:6309:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216616960 00000100:00100000:3.0:1772305988.041566:0:6309:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 482 00000100:00100000:2.0:1772305988.041573:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e72c7c57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216616896:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1772305988.041579:0:6309:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000026aa4ec0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216616960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1772305988.041618:0:6309:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 742981632 pending 0 free 3828350976 avail 3826253824 00000100:00100000:3.0:1772305988.041732:0:6309:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000026aa4ec0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216616960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 156us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305988.041747:0:6309:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 482 00000100:00100000:2.0:1772305988.041780:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e9e81c30 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216616960:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1772305988.296929:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772305988.552881:0:2993:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1772305988.552895:0:2994:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1772305988.552912:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c51b6958 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:70aae467-c860-409f-ba1b-742f4d042da6:2993:1858396216617024:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772305988.552921:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004d20d3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2991:1858396216617088:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772305988.552929:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e72c7c57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216617280:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772305988.552943:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cbca2acb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2992:1858396216617152:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772305988.553056:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305988.553057:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305988.553123:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000006d21792 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2991:1858396216617344:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772305988.553130:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772305988.553140:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305988.553144:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216617024 00000100:00100000:3.0:1772305988.553212:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772305988.553217:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085acb02d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216617216:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772305988.553227:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1772305988.553235:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000031580b1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2993:x1858396216617024:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772305988.553265:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216617088 00000100:00100000:2.0:1772305988.553266:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772305988.553313:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216617280 00000100:00100000:1.0:1772305988.553325:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000031580b1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2993:x1858396216617024:12345-0@lo:400:kworker/u8:1.0 Request processed in 86us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305988.553331:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216617152 00000100:00100000:1.0:1772305988.553336:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1772305988.553388:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1772305988.553394:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216617344 00000100:00100000:0.0:1772305988.553395:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216617216 00000100:00100000:3.0:1772305988.553397:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000041a87633 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:2991:x1858396216617088:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772305988.553413:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c51b6958 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:70aae467-c860-409f-ba1b-742f4d042da6:2993:1858396216617024:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772305988.553463:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1250 00000100:00100000:3.0:1772305988.553478:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000041a87633 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:2991:x1858396216617088:12345-0@lo:400:kworker/u8:1.0 Request processed in 75us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305988.553480:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e9e81c30 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216617280:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772305988.553491:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1772305988.553497:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1251 00000100:00100000:2.0:1772305988.553503:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1772305988.553507:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fd7b4ff5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216617216:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772305988.553514:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007d3428b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:2992:x1858396216617152:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772305988.553524:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1772305988.553533:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004c826b2e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:2991:x1858396216617344:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772305988.553549:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e9e81c30 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216617280:12345-0@lo:400:kworker/u8:1.0 Request processed in 76us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305988.553556:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fd7b4ff5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216617216:12345-0@lo:400:kworker/u8:1.0 Request processed in 51us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305988.553561:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1250 00000100:00100000:3.0:1772305988.553568:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004c826b2e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:2991:x1858396216617344:12345-0@lo:400:kworker/u8:1.0 Request processed in 34us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305988.553574:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1251 00000100:00100000:3.0:1772305988.553580:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1772305988.553623:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007d3428b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:2992:x1858396216617152:12345-0@lo:400:kworker/u8:1.0 Request processed in 107us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305988.553688:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004d20d3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2991:1858396216617088:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772305988.553689:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1772305988.553696:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cbca2acb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2992:1858396216617152:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772305988.553718:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000006d21792 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2991:1858396216617344:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772305988.553769:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e72c7c57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216617280:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772305988.553781:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085acb02d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216617216:0@lo:400:kworker/u8:1.0 00000040:00080000:2.0:1772305989.001827:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305989.001836:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305989.001890:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 12 00000040:00080000:2.0:1772305989.001898:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:3.0:1772305989.059554:0:74080:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305989.059560:0:74080:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305989.059666:0:74080:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 12 00000040:00080000:3.0:1772305989.059674:0:74080:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:0.0:1772305989.320855:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1772305990.024861:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305990.024868:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305990.024897:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 12 00000040:00080000:2.0:1772305990.024904:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:0.0:1772305990.346452:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1772305990.353842:0:74131:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305990.353847:0:74131:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305990.353899:0:74131:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 12 00000040:00080000:1.0:1772305990.353903:0:74131:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:0.0:1772305990.723864:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305990.723899:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305990.723922:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305990.723952:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225426432 00000100:00100000:2.0:1772305990.723966:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225426496 00000100:00100000:0.0:1772305990.723971:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305990.723998:0:6308:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225426560 00000100:00100000:0.0:1772305990.724005:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305990.724016:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 218 00000100:00100000:1.0:1772305990.724017:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 172 00000100:00100000:2.0:1772305990.724025:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d4ebb128 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2216:x1858396225426496:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1772305990.724031:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000af8f29a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2215:x1858396225426432:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:3.0:1772305990.724036:0:6308:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225426624 00000100:00100000:0.0:1772305990.724040:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305990.724061:0:6308:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225426752 00000100:00100000:0.0:1772305990.724076:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305990.724090:0:6308:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225426816 00000100:00100000:2.0:1772305990.724100:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d4ebb128 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2216:x1858396225426496:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 75us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305990.724107:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000af8f29a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2215:x1858396225426432:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 78us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305990.724110:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 218 00000100:00100000:3.0:1772305990.724116:0:6308:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1252 00000100:00100000:3.0:1772305990.724127:0:6308:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000039c4cb43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2215:x1858396225426560:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1772305990.724131:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 172 00000100:00100000:2.0:1772305990.724133:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225426688 00000100:00100000:2.0:1772305990.724167:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 219 00000100:00100000:3.0:1772305990.724168:0:6308:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000039c4cb43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2215:x1858396225426560:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 39us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305990.724175:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000033506aed pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2215:x1858396225426688:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:3.0:1772305990.724182:0:6308:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1252 00000100:00100000:1.0:1772305990.724189:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1253 00000100:00100000:1.0:1772305990.724196:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000d7fa04a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2216:x1858396225426624:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:3.0:1772305990.724203:0:6308:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1254 00000100:00100000:2.0:1772305990.724208:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000033506aed pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2215:x1858396225426688:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 33us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305990.724214:0:6308:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f086b207 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2216:x1858396225426752:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1772305990.724221:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 219 00000100:00100000:1.0:1772305990.724233:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000d7fa04a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2216:x1858396225426624:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 36us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305990.724242:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1253 00000100:00100000:1.0:1772305990.724268:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1255 00000100:00100000:1.0:1772305990.724275:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000098196c2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2215:x1858396225426816:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1772305990.724316:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000098196c2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2215:x1858396225426816:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 41us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305990.724325:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1255 00000100:00100000:3.0:1772305990.724334:0:6308:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f086b207 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2216:x1858396225426752:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 122us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305990.724342:0:6308:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1254 00000040:00080000:2.0:1772305991.048794:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305991.048803:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00100000:2.0:1772305991.048834:0:54732:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 42 in log [0xf:0x1:0x0] 00000040:00080000:2.0:1772305991.048994:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 11 00000040:00080000:2.0:1772305991.049003:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772305991.368721:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1772305991.633952:0:74183:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772305991.633957:0:74183:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772305991.634015:0:74183:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 11 00000040:00080000:0.0:1772305991.634019:0:74183:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:2.0:1772305992.072861:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305992.072867:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305992.072894:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 11 00000040:00080000:2.0:1772305992.072899:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772305992.392795:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1772305992.923073:0:74234:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305992.923077:0:74234:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305992.923127:0:74234:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 11 00000040:00080000:1.0:1772305992.923131:0:74234:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:2.0:1772305993.096834:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305993.096843:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00100000:2.0:1772305993.096883:0:54732:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 43 in log [0xf:0x1:0x0] 00000040:00080000:2.0:1772305993.097045:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 10 00000040:00080000:2.0:1772305993.097055:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:2.0:1772305993.160849:0:2991:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1772305993.160867:0:2994:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1772305993.160873:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004ebc4db7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216617408:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1772305993.160883:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae1f1e77 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216617472:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1772305993.160988:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772305993.161050:0:6309:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216617472 00000100:00100000:3.0:1772305993.161061:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772305993.161111:0:6309:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216617408 00000100:00100000:3.0:1772305993.161126:0:55611:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 483 00000100:00100000:3.0:1772305993.161134:0:55611:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a870219c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216617472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1772305993.161174:0:55611:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 695140352 pending 0 free 3606052864 avail 3603955712 00000100:00100000:2.0:1772305993.161209:0:7591:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 484 00000100:00100000:2.0:1772305993.161217:0:7591:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ad14d1c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216617408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1772305993.161258:0:7591:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 742981632 pending 0 free 3828350976 avail 3826253824 00000100:00100000:3.0:1772305993.161267:0:55611:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a870219c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216617472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305993.161276:0:55611:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 483 00000100:00100000:2.0:1772305993.161318:0:7591:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ad14d1c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216617408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305993.161325:0:7591:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 484 00000100:00100000:3.0:1772305993.161344:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae1f1e77 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216617472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1772305993.161400:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004ebc4db7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216617408:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1772305993.416836:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1772305993.672822:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000016a92645 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:70aae467-c860-409f-ba1b-742f4d042da6:2994:1858396216617536:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772305993.672823:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d831f9af pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:2993:1858396216617728:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772305993.672831:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000451e9247 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2992:1858396216617664:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772305993.672838:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c42ef24f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2991:1858396216617600:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772305993.672910:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772305993.672914:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772305993.672966:0:54689:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216617536 00000100:00100000:1.0:1772305993.672973:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772305993.673007:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216617664 00000100:00100000:0.0:1772305993.673008:0:71804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216617728 00000100:00100000:2.0:1772305993.673014:0:54689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1772305993.673020:0:54689:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cc54b45f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70aae467-c860-409f-ba1b-742f4d042da6+18:2994:x1858396216617536:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772305993.673046:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1772305993.673052:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e3d2d7c7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:2992:x1858396216617664:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772305993.673059:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772305993.673063:0:71804:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1772305993.673071:0:71804:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000066c449e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:2993:x1858396216617728:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772305993.673076:0:54689:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cc54b45f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70aae467-c860-409f-ba1b-742f4d042da6+18:2994:x1858396216617536:12345-0@lo:400:kworker/u8:1.0 Request processed in 54us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305993.673083:0:54689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1772305993.673104:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e3d2d7c7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:2992:x1858396216617664:12345-0@lo:400:kworker/u8:1.0 Request processed in 52us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305993.673112:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1772305993.673119:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216617600 00000100:00100000:2.0:1772305993.673143:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000016a92645 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:70aae467-c860-409f-ba1b-742f4d042da6:2994:1858396216617536:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772305993.673151:0:71804:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000066c449e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:2993:x1858396216617728:12345-0@lo:400:kworker/u8:1.0 Request processed in 71us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305993.673159:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1772305993.673163:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007cf7287e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:2991:x1858396216617600:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772305993.673172:0:71804:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1772305993.673193:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d831f9af pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:2993:1858396216617728:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772305993.673211:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007cf7287e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:2991:x1858396216617600:12345-0@lo:400:kworker/u8:1.0 Request processed in 45us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305993.673217:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1772305993.673235:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000451e9247 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2992:1858396216617664:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772305993.673268:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c42ef24f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2991:1858396216617600:0@lo:400:kworker/u8:1.0 00000040:00080000:2.0:1772305994.120815:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305994.120821:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00100000:2.0:1772305994.120859:0:54732:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 44 in log [0xf:0x1:0x0] 00000040:00080000:2.0:1772305994.121041:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 9 00000040:00080000:2.0:1772305994.121049:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:3.0:1772305994.221308:0:74286:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305994.221313:0:74286:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305994.221363:0:74286:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 9 00000040:00080000:3.0:1772305994.221368:0:74286:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:0.0:1772305994.440815:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1772305995.144849:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305995.144856:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00100000:2.0:1772305995.144890:0:54732:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 45 in log [0xf:0x1:0x0] 00000040:00080000:2.0:1772305995.145001:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 8 00000040:00080000:2.0:1772305995.145008:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772305995.465744:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1772305995.543511:0:74337:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305995.543517:0:74337:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305995.543607:0:74337:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 8 00000040:00080000:2.0:1772305995.543613:0:74337:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:2.0:1772305995.844071:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305995.844105:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305995.844126:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305995.844163:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772305995.844173:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225426944 00000100:00100000:0.0:1772305995.844173:0:54689:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225426880 00000100:00100000:2.0:1772305995.844187:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772305995.844213:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772305995.844218:0:6308:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225427008 00000100:00100000:3.0:1772305995.844238:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225427136 00000100:00100000:0.0:1772305995.844243:0:54689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 174 00000100:00100000:2.0:1772305995.844251:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772305995.844256:0:54689:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f6e86c39 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2218:x1858396225426880:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1772305995.844257:0:6308:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1256 00000100:00100000:1.0:1772305995.844265:0:6308:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b7808eb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2218:x1858396225427008:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:3.0:1772305995.844271:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 223 00000100:00100000:3.0:1772305995.844278:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004ebc4db7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2217:x1858396225426944:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1772305995.844283:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225427072 00000100:00100000:2.0:1772305995.844323:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225427200 00000100:00100000:1.0:1772305995.844342:0:6308:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b7808eb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2218:x1858396225427008:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 76us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305995.844344:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225427264 00000100:00100000:3.0:1772305995.844349:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004ebc4db7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2217:x1858396225426944:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 63us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305995.844349:0:54689:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f6e86c39 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2218:x1858396225426880:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 90us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305995.844359:0:6308:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1256 00000100:00100000:3.0:1772305995.844367:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 223 00000100:00100000:2.0:1772305995.844373:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1257 00000100:00100000:0.0:1772305995.844374:0:54689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 174 00000100:00100000:2.0:1772305995.844382:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006f4c803f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2217:x1858396225427072:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1772305995.844389:0:6308:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1258 00000100:00100000:3.0:1772305995.844402:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 224 00000100:00100000:1.0:1772305995.844413:0:6308:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008e341f60 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2217:x1858396225427200:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:3.0:1772305995.844414:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000edb23783 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2218:x1858396225427136:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1772305995.844427:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006f4c803f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2217:x1858396225427072:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 46us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305995.844445:0:18149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1259 00000100:00100000:3.0:1772305995.844450:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000edb23783 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2218:x1858396225427136:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 41us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305995.844456:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1257 00000100:00100000:0.0:1772305995.844461:0:18149:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009adfd4b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2218:x1858396225427264:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1772305995.844462:0:6308:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008e341f60 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2217:x1858396225427200:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 49us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305995.844470:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 224 00000100:00100000:1.0:1772305995.844479:0:6308:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1258 00000100:00100000:0.0:1772305995.844500:0:18149:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009adfd4b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2218:x1858396225427264:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 46us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305995.844511:0:18149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1259 00000040:00080000:2.0:1772305996.168765:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305996.168771:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305996.168797:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 8 00000040:00080000:2.0:1772305996.168802:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772305996.488757:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1772305996.836102:0:74388:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772305996.836107:0:74388:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772305996.836180:0:74388:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 8 00000040:00080000:1.0:1772305996.836185:0:74388:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:2.0:1772305997.192793:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305997.192801:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305997.192831:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 8 00000040:00080000:2.0:1772305997.192838:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:0.0:1772305997.512844:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1772305998.112551:0:74440:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305998.112556:0:74440:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305998.112608:0:74440:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 8 00000040:00080000:2.0:1772305998.112612:0:74440:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:2.0:1772305998.216753:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305998.216759:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305998.216785:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 8 00000040:00080000:2.0:1772305998.216790:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:2.0:1772305998.280794:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d410c5a7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216617792:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1772305998.280818:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009ce141ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216617856:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1772305998.280866:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305998.280938:0:6309:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216617792 00000100:00100000:2.0:1772305998.280950:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305998.280990:0:6309:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216617856 00000100:00100000:2.0:1772305998.280996:0:7591:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 485 00000100:00100000:2.0:1772305998.281004:0:7591:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000065549302 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216617792:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1772305998.281019:0:6309:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 486 00000100:00100000:1.0:1772305998.281024:0:6309:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000924bcdea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216617856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1772305998.281048:0:6309:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 695140352 pending 0 free 3606052864 avail 3603955712 00002000:00000024:2.0:1772305998.281050:0:7591:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 742981632 pending 0 free 3828350976 avail 3826253824 00000100:00100000:2.0:1772305998.281105:0:7591:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000065549302 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216617792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305998.281112:0:7591:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 485 00000100:00100000:1.0:1772305998.281138:0:6309:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000924bcdea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216617856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1772305998.281145:0:6309:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 486 00000100:00100000:2.0:1772305998.281282:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009ce141ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216617856:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1772305998.281329:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d410c5a7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216617792:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1772305998.536788:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1772305998.792844:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d6f2aba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:70aae467-c860-409f-ba1b-742f4d042da6:2992:1858396216617920:0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772305998.792860:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085acb02d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2991:1858396216618112:0@lo:400:kworker/u8:4.0 00000100:00100000:0.0:1772305998.792861:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000039584847 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:2993:1858396216617984:0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772305998.792896:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009ce141ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:2994:1858396216618048:0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772305998.792960:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772305998.792960:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305998.793000:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216617920 00000100:00100000:3.0:1772305998.793016:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772305998.793019:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216617984 00000100:00100000:0.0:1772305998.793036:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772305998.793049:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1772305998.793056:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009f6ac3b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2992:x1858396216617920:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772305998.793070:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216618112 00000100:00100000:2.0:1772305998.793071:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216618048 00000100:00100000:0.0:1772305998.793088:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1772305998.793096:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000db51b4fe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:2993:x1858396216617984:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772305998.793111:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009f6ac3b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2992:x1858396216617920:12345-0@lo:400:kworker/u8:4.0 Request processed in 53us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305998.793118:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1772305998.793122:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1772305998.793128:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ae1f1e77 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:2991:x1858396216618112:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772305998.793130:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1772305998.793140:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f8a1bcf1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:2994:x1858396216618048:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:0.0:1772305998.793166:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000db51b4fe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:2993:x1858396216617984:12345-0@lo:400:kworker/u8:4.0 Request processed in 69us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1772305998.793175:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1772305998.793186:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ae1f1e77 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:2991:x1858396216618112:12345-0@lo:400:kworker/u8:4.0 Request processed in 59us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1772305998.793193:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1772305998.793208:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000039584847 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:2993:1858396216617984:0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772305998.793220:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f8a1bcf1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:2994:x1858396216618048:12345-0@lo:400:kworker/u8:4.0 Request processed in 79us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1772305998.793231:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1772305998.793233:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085acb02d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2991:1858396216618112:0@lo:400:kworker/u8:4.0 00000100:00100000:0.0:1772305998.793266:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009ce141ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:2994:1858396216618048:0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772305998.793286:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d6f2aba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:70aae467-c860-409f-ba1b-742f4d042da6:2992:1858396216617920:0@lo:400:kworker/u8:4.0 00000040:00080000:2.0:1772305999.240807:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772305999.240816:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772305999.240854:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 8 00000040:00080000:2.0:1772305999.240862:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:3.0:1772305999.394015:0:74493:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772305999.394021:0:74493:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772305999.394088:0:74493:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 8 00000040:00080000:3.0:1772305999.394095:0:74493:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772305999.560811:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1772306000.264799:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306000.264805:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306000.264832:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 8 00000040:00080000:2.0:1772306000.264838:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772306000.585744:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1772306000.677234:0:74544:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306000.677238:0:74544:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306000.677279:0:74544:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 8 00000040:00080000:2.0:1772306000.677283:0:74544:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:0.0:1772306000.963781:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772306000.963828:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772306000.963841:0:54689:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225427328 00000100:00100000:0.0:1772306000.963856:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772306000.963900:0:54689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 176 00000100:00100000:2.0:1772306000.963907:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225427392 00000100:00100000:1.0:1772306000.963913:0:54689:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000094ded96f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2216:x1858396225427328:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1772306000.963919:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306000.963923:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225427456 00000100:00100000:2.0:1772306000.963952:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 228 00000100:00100000:0.0:1772306000.963954:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772306000.963959:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c42ef24f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2215:x1858396225427392:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1772306000.963961:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225427520 00000100:00100000:1.0:1772306000.963979:0:54689:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000094ded96f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2216:x1858396225427328:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 70us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306000.963989:0:54689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 176 00000100:00100000:0.0:1772306000.963995:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306000.963996:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1260 00000100:00100000:3.0:1772306000.964006:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000451e9247 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2216:x1858396225427456:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1772306000.964006:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c42ef24f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2215:x1858396225427392:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 43us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306000.964021:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 228 00000100:00100000:2.0:1772306000.964041:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225427584 00000100:00100000:3.0:1772306000.964047:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000451e9247 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2216:x1858396225427456:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 41us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306000.964051:0:18149:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225427648 00000100:00100000:3.0:1772306000.964055:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1260 00000100:00100000:2.0:1772306000.964077:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 229 00000100:00100000:3.0:1772306000.964081:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1261 00000100:00100000:2.0:1772306000.964088:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000016a92645 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2216:x1858396225427584:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1772306000.964094:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d831f9af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2215:x1858396225427520:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1772306000.964095:0:18149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1262 00000100:00100000:1.0:1772306000.964105:0:18149:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000006d21792 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2215:x1858396225427648:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1772306000.964110:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772306000.964130:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000016a92645 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2216:x1858396225427584:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 44us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306000.964136:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d831f9af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2215:x1858396225427520:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 45us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306000.964150:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 229 00000100:00100000:1.0:1772306000.964150:0:18149:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000006d21792 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2215:x1858396225427648:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 39us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306000.964162:0:18149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1262 00000100:00100000:1.0:1772306000.964184:0:18149:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225427712 00000100:00100000:3.0:1772306000.964205:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1261 00000100:00100000:2.0:1772306000.964217:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1263 00000100:00100000:2.0:1772306000.964224:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000454a81c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2216:x1858396225427712:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1772306000.964257:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000454a81c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2216:x1858396225427712:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 33us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306000.964264:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1263 00000040:00080000:2.0:1772306001.288840:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306001.288848:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306001.288944:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 8 00000040:00080000:2.0:1772306001.288952:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:0.0:1772306001.608798:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1772306001.958147:0:74595:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772306001.958154:0:74595:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772306001.958225:0:74595:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 8 00000040:00080000:0.0:1772306001.958232:0:74595:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:2.0:1772306002.312788:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306002.312794:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00100000:2.0:1772306002.312824:0:54732:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 46 in log [0xf:0x1:0x0] 00000040:00100000:2.0:1772306002.312955:0:54732:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 47 in log [0xf:0x1:0x0] 00000040:00100000:2.0:1772306002.312979:0:54732:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 48 in log [0xf:0x1:0x0] 00000040:00100000:2.0:1772306002.313006:0:54732:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 49 in log [0xf:0x1:0x0] 00000040:00100000:2.0:1772306002.313043:0:54732:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 50 in log [0xf:0x1:0x0] 00000040:00100000:2.0:1772306002.313081:0:54732:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 51 in log [0xf:0x1:0x0] 00000040:00080000:2.0:1772306002.313111:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 2 00000040:00080000:2.0:1772306002.313117:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:0.0:1772306002.632785:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1772306003.250587:0:74646:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772306003.250591:0:74646:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772306003.250619:0:74646:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 2 00000040:00080000:3.0:1772306003.250623:0:74646:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:2.0:1772306003.336768:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306003.336776:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306003.336822:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 2 00000040:00080000:2.0:1772306003.336829:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:2.0:1772306003.400820:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d410c5a7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216618176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1772306003.400833:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ee429faf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216618240:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1772306003.400914:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306003.400948:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772306003.400978:0:7591:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216618176 00000100:00100000:2.0:1772306003.401021:0:7591:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216618240 00000100:00100000:0.0:1772306003.401040:0:6310:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 487 00000100:00100000:2.0:1772306003.401048:0:7591:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 488 00000100:00100000:0.0:1772306003.401051:0:6310:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a26b6941 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216618176:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1772306003.401057:0:7591:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fcb0beee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216618240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1772306003.401097:0:7591:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 695140352 pending 0 free 3606052864 avail 3603955712 00000100:00100000:2.0:1772306003.401138:0:7591:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fcb0beee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216618240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (193us total) trans 0 rc 0/0 00002000:00000024:1.0:1772306003.401140:0:6310:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 742981632 pending 0 free 3828350976 avail 3826253824 00000100:00100000:2.0:1772306003.401156:0:7591:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 488 00000100:00100000:1.0:1772306003.401189:0:6310:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a26b6941 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216618176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306003.401197:0:6310:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 487 00000100:00100000:1.0:1772306003.401257:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d410c5a7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216618176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1772306003.401301:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ee429faf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216618240:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1772306003.656803:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1772306003.912824:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a9a770cc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:70aae467-c860-409f-ba1b-742f4d042da6:2994:1858396216618304:0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772306003.912832:0:2992:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1772306003.912842:0:2991:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1772306003.912862:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005254ed4a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:2992:1858396216618368:0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772306003.912865:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008806aae9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:2991:1858396216618432:0@lo:400:kworker/u8:4.0 00000100:00100000:0.0:1772306003.912910:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772306003.912925:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772306003.912954:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000038ede71c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:2993:1858396216618496:0@lo:400:kworker/u8:4.0 00000100:00100000:0.0:1772306003.912974:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216618304 00000100:00100000:2.0:1772306003.912981:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772306003.912986:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216618368 00000100:00100000:0.0:1772306003.913020:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1772306003.913022:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216618496 00000100:00100000:2.0:1772306003.913032:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306003.913032:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007468e6da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2994:x1858396216618304:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772306003.913037:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1772306003.913046:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e72c7c57 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:2992:x1858396216618368:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772306003.913061:0:71804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216618432 00000100:00100000:1.0:1772306003.913064:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1772306003.913070:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009e643511 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:2993:x1858396216618496:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772306003.913088:0:71804:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1772306003.913092:0:71804:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000049ea3c34 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:2991:x1858396216618432:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:0.0:1772306003.913175:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007468e6da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2994:x1858396216618304:12345-0@lo:400:kworker/u8:4.0 Request processed in 147us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306003.913183:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1772306003.913197:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e72c7c57 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:2992:x1858396216618368:12345-0@lo:400:kworker/u8:4.0 Request processed in 149us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306003.913197:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009e643511 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:2993:x1858396216618496:12345-0@lo:400:kworker/u8:4.0 Request processed in 124us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306003.913200:0:71804:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000049ea3c34 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:2991:x1858396216618432:12345-0@lo:400:kworker/u8:4.0 Request processed in 105us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306003.913213:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1772306003.913218:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1772306003.913224:0:71804:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1772306003.913234:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a9a770cc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:70aae467-c860-409f-ba1b-742f4d042da6:2994:1858396216618304:0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772306003.913275:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000038ede71c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:2993:1858396216618496:0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772306003.913278:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005254ed4a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:2992:1858396216618368:0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772306003.913314:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008806aae9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:2991:1858396216618432:0@lo:400:kworker/u8:4.0 00000040:00080000:2.0:1772306004.360776:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306004.360781:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306004.360814:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 2 00000040:00080000:2.0:1772306004.360819:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:1.0:1772306004.538461:0:74698:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306004.538468:0:74698:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306004.538509:0:74698:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 2 00000040:00080000:1.0:1772306004.538515:0:74698:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772306004.680780:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1772306005.384770:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306005.384776:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306005.384802:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 2 00000040:00080000:2.0:1772306005.384807:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:1.0:1772306005.705045:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1772306005.827102:0:74750:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772306005.827113:0:74750:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772306005.827188:0:74750:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 2 00000040:00080000:0.0:1772306005.827196:0:74750:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:2.0:1772306006.083873:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772306006.083918:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772306006.083962:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306006.084008:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225427904 00000100:00100000:2.0:1772306006.084008:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772306006.084016:0:54689:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225427776 00000100:00100000:1.0:1772306006.084022:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225428032 00000100:00100000:2.0:1772306006.084045:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306006.084064:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225428160 00000100:00100000:1.0:1772306006.084065:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225427840 00000100:00100000:2.0:1772306006.084098:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772306006.084124:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 233 00000100:00100000:1.0:1772306006.084139:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a965e4a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2217:x1858396225428032:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1772306006.084140:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225427968 00000100:00100000:0.0:1772306006.084156:0:54689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 178 00000100:00100000:0.0:1772306006.084169:0:54689:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000011e0bb8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2217:x1858396225427776:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1772306006.084174:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1264 00000100:00100000:3.0:1772306006.084192:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d410c5a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2217:x1858396225427904:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1772306006.084219:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772306006.084232:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a965e4a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2217:x1858396225428032:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 95us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306006.084235:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d410c5a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2217:x1858396225427904:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 47us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306006.084241:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 233 00000100:00100000:1.0:1772306006.084259:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 234 00000100:00100000:1.0:1772306006.084264:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000209acf4e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2217:x1858396225427840:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1772306006.084287:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1264 00000100:00100000:3.0:1772306006.084300:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225428096 00000100:00100000:3.0:1772306006.084319:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1265 00000100:00100000:3.0:1772306006.084323:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001b48db0d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2217:x1858396225428160:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1772306006.086110:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000209acf4e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2217:x1858396225427840:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 1843us (2065us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306006.086111:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001b48db0d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2217:x1858396225428160:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 1783us (2104us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306006.086119:0:54689:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000011e0bb8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2217:x1858396225427776:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 1950us (2250us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306006.086125:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1265 00000100:00100000:1.0:1772306006.086125:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 234 00000100:00100000:0.0:1772306006.086134:0:54689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 178 00000100:00100000:3.0:1772306006.086153:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1266 00000100:00100000:3.0:1772306006.086160:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007d0501e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2217:x1858396225427968:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1772306006.086167:0:18149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1267 00000100:00100000:1.0:1772306006.086172:0:18149:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005ad28dc1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2217:x1858396225428096:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1772306006.086194:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007d0501e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2217:x1858396225427968:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 34us (2098us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306006.086196:0:18149:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005ad28dc1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2217:x1858396225428096:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 24us (1980us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306006.086202:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1266 00000100:00100000:1.0:1772306006.086207:0:18149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1267 00000040:00080000:2.0:1772306006.408775:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306006.408781:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306006.408806:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 2 00000040:00080000:2.0:1772306006.408812:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:0.0:1772306006.728789:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1772306007.098139:0:74801:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772306007.098143:0:74801:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772306007.098179:0:74801:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 2 00000040:00080000:0.0:1772306007.098183:0:74801:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:2.0:1772306007.432770:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306007.432777:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306007.432802:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 2 00000040:00080000:2.0:1772306007.432808:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772306007.752919:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1772306008.390095:0:74852:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306008.390101:0:74852:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306008.390136:0:74852:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 53 count 2 00000040:00080000:2.0:1772306008.390141:0:74852:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:2.0:1772306008.456774:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306008.456781:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00100000:2.0:1772306008.456855:0:54732:0:(llog.c:235:llog_cancel_arr_rec()) Canceling 1 records, first 52 in log [0xf:0x1:0x0] 00000040:00080000:2.0:1772306008.456991:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 52 count 1 00000040:00080000:2.0:1772306008.456999:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:2.0:1772306008.520809:0:2993:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1772306008.520834:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fb724402 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216618624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1772306008.520840:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000226f5fc2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216618560:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1772306008.520902:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772306008.520942:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772306008.520992:0:7591:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216618560 00000100:00100000:0.0:1772306008.520992:0:6310:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216618624 00000100:00100000:0.0:1772306008.521048:0:6310:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 489 00000100:00100000:0.0:1772306008.521057:0:6310:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b74b7ed1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216618624:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1772306008.521058:0:55611:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 490 00000100:00100000:3.0:1772306008.521068:0:55611:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000becfd887 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216618560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1772306008.521088:0:6310:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 695140352 pending 0 free 3606052864 avail 3603955712 00002000:00000024:3.0:1772306008.521092:0:55611:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 742981632 pending 0 free 3828350976 avail 3826253824 00000100:00100000:0.0:1772306008.521138:0:6310:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b74b7ed1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216618624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306008.521145:0:55611:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000becfd887 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216618560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306008.521146:0:6310:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 489 00000100:00100000:3.0:1772306008.521154:0:55611:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 490 00000100:00100000:0.0:1772306008.521198:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fb724402 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216618624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1772306008.521203:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000226f5fc2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216618560:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1772306008.776777:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1772306009.032917:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fb724402 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:70aae467-c860-409f-ba1b-742f4d042da6:2992:1858396216618688:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306009.032958:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006b94893a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:2994:1858396216618816:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306009.032965:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000015856d86 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:2993:1858396216618752:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772306009.032980:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000862e2d15 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2991:1858396216618880:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306009.033023:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772306009.033028:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772306009.033061:0:71804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216618816 00000100:00100000:0.0:1772306009.033066:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772306009.033091:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772306009.033093:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216618880 00000100:00100000:2.0:1772306009.033123:0:71804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216618752 00000100:00100000:3.0:1772306009.033132:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1772306009.033141:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1772306009.033142:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004d20d3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:2994:x1858396216618816:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306009.033153:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1772306009.033153:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004b75309d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:2991:x1858396216618880:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306009.033162:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cbca2acb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:2993:x1858396216618752:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306009.033175:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216618688 00000100:00100000:3.0:1772306009.033211:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004d20d3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:2994:x1858396216618816:12345-0@lo:400:kworker/u8:1.0 Request processed in 73us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306009.033212:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1772306009.033216:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004b75309d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:2991:x1858396216618880:12345-0@lo:400:kworker/u8:1.0 Request processed in 66us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306009.033220:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003e7a15e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2992:x1858396216618688:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306009.033223:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cbca2acb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:2993:x1858396216618752:12345-0@lo:400:kworker/u8:1.0 Request processed in 60us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306009.033227:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1772306009.033235:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1772306009.033242:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1772306009.033284:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003e7a15e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2992:x1858396216618688:12345-0@lo:400:kworker/u8:1.0 Request processed in 64us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306009.033288:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000862e2d15 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2991:1858396216618880:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306009.033294:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000015856d86 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:2993:1858396216618752:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306009.033300:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1772306009.033328:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006b94893a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:2994:1858396216618816:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306009.033350:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fb724402 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:70aae467-c860-409f-ba1b-742f4d042da6:2992:1858396216618688:0@lo:400:kworker/u8:1.0 00000040:00080000:2.0:1772306009.480840:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306009.480846:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306009.481221:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306009.481230:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:3.0:1772306009.678181:0:74905:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772306009.678188:0:74905:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772306009.678689:0:74905:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:3.0:1772306009.678698:0:74905:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:1.0:1772306009.800762:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1772306010.504874:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306010.504883:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306010.505721:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306010.505735:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:0.0:1772306010.824925:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1772306010.976026:0:74956:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306010.976032:0:74956:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306010.976426:0:74956:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306010.976431:0:74956:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:0.0:1772306011.203888:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772306011.203928:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772306011.203951:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225428224 00000100:00100000:0.0:1772306011.203957:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772306011.203982:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772306011.204004:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 180 00000100:00100000:2.0:1772306011.204011:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000081b63ba0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2218:x1858396225428224:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1772306011.204011:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225428352 00000100:00100000:3.0:1772306011.204013:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225428480 00000100:00100000:0.0:1772306011.204020:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772306011.204045:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772306011.204056:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225428608 00000100:00100000:3.0:1772306011.204057:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225428288 00000100:00100000:2.0:1772306011.204082:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000081b63ba0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2218:x1858396225428224:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 70us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306011.204090:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 180 00000100:00100000:1.0:1772306011.204093:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225428416 00000100:00100000:3.0:1772306011.204100:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 238 00000100:00100000:3.0:1772306011.204106:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000044e87dbc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2218:x1858396225428480:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1772306011.204124:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1268 00000100:00100000:0.0:1772306011.204128:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772306011.204132:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000862e2d15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2218:x1858396225428352:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1772306011.204148:0:6308:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225428544 00000100:00100000:3.0:1772306011.204151:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000044e87dbc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2218:x1858396225428480:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 41us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306011.204163:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 238 00000100:00100000:1.0:1772306011.204172:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000862e2d15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2218:x1858396225428352:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 39us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306011.204178:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1268 00000100:00100000:2.0:1772306011.204189:0:6308:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1269 00000100:00100000:3.0:1772306011.204195:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 239 00000100:00100000:2.0:1772306011.204198:0:6308:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dad20ed7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2218:x1858396225428608:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1772306011.204204:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1270 00000100:00100000:3.0:1772306011.204209:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e05e1d9c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2218:x1858396225428288:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1772306011.204212:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000530131fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2218:x1858396225428416:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1772306011.204257:0:6308:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dad20ed7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2218:x1858396225428608:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 55us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306011.204258:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000530131fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2218:x1858396225428416:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 43us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306011.204273:0:48463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1271 00000100:00100000:1.0:1772306011.204281:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1270 00000100:00100000:0.0:1772306011.204285:0:48463:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000042fe330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2218:x1858396225428544:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1772306011.204294:0:6308:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1269 00000100:00100000:3.0:1772306011.204331:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e05e1d9c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2218:x1858396225428288:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 128us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306011.204340:0:48463:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000042fe330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2218:x1858396225428544:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 57us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306011.204346:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 239 00000100:00100000:0.0:1772306011.204356:0:48463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1271 00000040:00080000:2.0:1772306011.528857:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306011.528863:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306011.529246:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306011.529253:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772306011.848952:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1772306012.352459:0:75008:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306012.352464:0:75008:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306012.352956:0:75008:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306012.352965:0:75008:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:2.0:1772306012.552847:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306012.552855:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306012.553345:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306012.553355:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772306012.872876:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1772306013.576757:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306013.576761:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306013.577133:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306013.577139:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:2.0:1772306013.640874:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cb7be42b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216618944:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1772306013.640956:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008608acb2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216619008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1772306013.640986:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306013.641068:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772306013.641101:0:6309:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216618944 00000100:00100000:2.0:1772306013.641171:0:6309:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216619008 00000100:00100000:2.0:1772306013.641216:0:6309:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 491 00000100:00100000:2.0:1772306013.641224:0:6309:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006ade2649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216618944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1772306013.641266:0:6309:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 742981632 pending 0 free 3828350976 avail 3826253824 00000100:00100000:2.0:1772306013.641335:0:6309:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006ade2649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216618944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306013.641342:0:6309:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 491 00000100:00100000:3.0:1772306013.641355:0:55611:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 492 00000100:00100000:3.0:1772306013.641365:0:55611:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fb724402 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216619008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1772306013.641392:0:55611:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 695140352 pending 0 free 3606052864 avail 3603955712 00000100:00100000:2.0:1772306013.641419:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cb7be42b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216618944:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1772306013.641872:0:55611:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fb724402 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216619008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 483us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306013.641898:0:55611:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 492 00000100:00100000:2.0:1772306013.642133:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008608acb2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216619008:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1772306013.674740:0:75059:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772306013.674746:0:75059:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772306013.675168:0:75059:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:3.0:1772306013.675175:0:75059:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:1.0:1772306013.896919:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772306014.152988:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006b94893a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:70aae467-c860-409f-ba1b-742f4d042da6:2994:1858396216619072:0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772306014.153050:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000015856d86 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2991:1858396216619136:0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772306014.153062:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ee429faf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2992:1858396216619200:0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772306014.153126:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306014.153132:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008608acb2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216619264:0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772306014.153160:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772306014.153213:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005e2380e8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216619328:0@lo:400:kworker/u8:4.0 00000100:00100000:0.0:1772306014.153233:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772306014.153235:0:54689:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216619072 00000100:00100000:3.0:1772306014.153244:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000013a9ed66 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2991:1858396216619392:0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772306014.153291:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306014.153346:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216619264 00000100:00100000:3.0:1772306014.153362:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772306014.153363:0:54689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1772306014.153384:0:54689:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c236a9c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70aae467-c860-409f-ba1b-742f4d042da6+18:2994:x1858396216619072:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772306014.153397:0:48463:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216619328 00000100:00100000:0.0:1772306014.153441:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1272 00000100:00100000:3.0:1772306014.153445:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216619136 00000100:00100000:0.0:1772306014.153462:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fc01b397 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216619264:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772306014.153472:0:48463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1273 00000100:00100000:1.0:1772306014.153504:0:48463:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c51b6958 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216619328:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772306014.153524:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216619392 00000100:00100000:2.0:1772306014.153525:0:54689:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c236a9c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70aae467-c860-409f-ba1b-742f4d042da6+18:2994:x1858396216619072:12345-0@lo:400:kworker/u8:4.0 Request processed in 142us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306014.153538:0:54689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1772306014.153565:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1772306014.153576:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005254ed4a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:2991:x1858396216619136:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:0.0:1772306014.153578:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fc01b397 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216619264:12345-0@lo:400:kworker/u8:4.0 Request processed in 120us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306014.153597:0:48463:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c51b6958 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216619328:12345-0@lo:400:kworker/u8:4.0 Request processed in 88us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306014.153598:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1272 00000100:00100000:2.0:1772306014.153611:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1772306014.153615:0:48463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1273 00000100:00100000:2.0:1772306014.153626:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008806aae9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:2991:x1858396216619392:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772306014.153679:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005254ed4a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:2991:x1858396216619136:12345-0@lo:400:kworker/u8:4.0 Request processed in 103us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306014.153689:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1772306014.153734:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008608acb2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216619264:0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772306014.153740:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008806aae9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:2991:x1858396216619392:12345-0@lo:400:kworker/u8:4.0 Request processed in 112us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306014.153752:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1772306014.153755:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000013a9ed66 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2991:1858396216619392:0@lo:400:kworker/u8:4.0 00000100:00100000:0.0:1772306014.153765:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005e2380e8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216619328:0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772306014.153817:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000015856d86 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2991:1858396216619136:0@lo:400:kworker/u8:4.0 00000100:00100000:0.0:1772306014.153832:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006b94893a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:70aae467-c860-409f-ba1b-742f4d042da6:2994:1858396216619072:0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772306014.153844:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772306014.153944:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216619200 00000100:00100000:2.0:1772306014.153992:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1772306014.153997:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000085acb02d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:2992:x1858396216619200:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772306014.154055:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000085acb02d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:2992:x1858396216619200:12345-0@lo:400:kworker/u8:4.0 Request processed in 57us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306014.154063:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1772306014.154132:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ee429faf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2992:1858396216619200:0@lo:400:kworker/u8:4.0 00000040:00080000:2.0:1772306014.600898:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306014.600908:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306014.601824:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306014.601838:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:0.0:1772306014.920891:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1772306015.123594:0:75110:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772306015.123618:0:75110:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772306015.124236:0:75110:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:3.0:1772306015.124248:0:75110:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:2.0:1772306015.624963:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306015.624974:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306015.625437:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306015.625448:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772306015.944954:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1772306016.324270:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772306016.324346:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772306016.324376:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225428672 00000100:00100000:0.0:1772306016.324397:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772306016.324424:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225428736 00000100:00100000:0.0:1772306016.324489:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772306016.324503:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 182 00000100:00100000:3.0:1772306016.324519:0:48470:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225428800 00000100:00100000:2.0:1772306016.324523:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003571e040 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2217:x1858396225428672:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1772306016.324536:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 243 00000100:00100000:0.0:1772306016.324560:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772306016.324566:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005e2380e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2218:x1858396225428736:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:3.0:1772306016.324607:0:48470:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225428864 00000100:00100000:0.0:1772306016.324611:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306016.324716:0:48470:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225428992 00000100:00100000:2.0:1772306016.324780:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003571e040 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2217:x1858396225428672:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 233us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306016.324793:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005e2380e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2218:x1858396225428736:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 200us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306016.324813:0:48470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1274 00000100:00100000:0.0:1772306016.324829:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772306016.324853:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 182 00000100:00100000:3.0:1772306016.324854:0:48470:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f345825e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2217:x1858396225428800:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1772306016.324873:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 243 00000100:00100000:1.0:1772306016.324920:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225428928 00000100:00100000:3.0:1772306016.324964:0:48470:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f345825e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2217:x1858396225428800:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 121us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306016.324979:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 244 00000100:00100000:3.0:1772306016.324986:0:48470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1274 00000100:00100000:1.0:1772306016.324997:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009535b91f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2217:x1858396225428928:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:3.0:1772306016.325054:0:48470:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225429056 00000100:00100000:2.0:1772306016.325075:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1275 00000100:00100000:1.0:1772306016.325089:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009535b91f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2217:x1858396225428928:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 84us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306016.325112:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 244 00000100:00100000:2.0:1772306016.325113:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b26b7107 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2218:x1858396225428864:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:0.0:1772306016.325143:0:48463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1276 00000100:00100000:0.0:1772306016.325159:0:48463:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000071de3849 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2218:x1858396225428992:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1772306016.325204:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1277 00000100:00100000:1.0:1772306016.325215:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000068a71b8a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2217:x1858396225429056:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1772306016.325239:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b26b7107 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2218:x1858396225428864:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 135us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306016.325261:0:48463:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000071de3849 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2218:x1858396225428992:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 92us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306016.325287:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1275 00000100:00100000:1.0:1772306016.325289:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000068a71b8a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2217:x1858396225429056:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 57us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306016.325304:0:48463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1276 00000100:00100000:1.0:1772306016.325335:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1277 00000040:00080000:3.0:1772306016.563170:0:75161:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772306016.563179:0:75161:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772306016.563951:0:75161:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:3.0:1772306016.563963:0:75161:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:2.0:1772306016.648895:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306016.648904:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306016.649840:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306016.649860:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772306016.968921:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1772306017.672885:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306017.672893:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306017.673338:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306017.673345:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:1.0:1772306017.932889:0:75212:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306017.932894:0:75212:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306017.933433:0:75212:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306017.933443:0:75212:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:1.0:1772306017.992771:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1772306018.696935:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306018.696946:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306018.697787:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306018.697804:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:3.0:1772306018.760953:0:2991:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1772306018.760986:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a648c204 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216619456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1772306018.760998:0:2994:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1772306018.761022:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cb7be42b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216619520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1772306018.761094:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306018.761197:0:55611:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216619456 00000100:00100000:3.0:1772306018.761232:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306018.761326:0:55611:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216619520 00000100:00100000:3.0:1772306018.761350:0:6310:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 493 00000100:00100000:3.0:1772306018.761366:0:6310:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000038ede71c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216619456:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1772306018.761390:0:55611:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 494 00000100:00100000:0.0:1772306018.761402:0:55611:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a9a770cc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216619520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1772306018.761423:0:6310:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 695140352 pending 0 free 3606052864 avail 3603955712 00002000:00000024:0.0:1772306018.761444:0:55611:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 742981632 pending 0 free 3828350976 avail 3826253824 00000100:00100000:3.0:1772306018.761530:0:6310:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000038ede71c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216619456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 159us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306018.761538:0:55611:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a9a770cc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216619520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306018.761563:0:6310:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 493 00000100:00100000:0.0:1772306018.761583:0:55611:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 494 00000100:00100000:1.0:1772306018.761823:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a648c204 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216619456:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1772306018.761869:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cb7be42b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216619520:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1772306019.016926:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1772306019.273000:0:2993:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1772306019.273037:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007e97bd92 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2991:1858396216619648:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772306019.273038:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000db3403a9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:70aae467-c860-409f-ba1b-742f4d042da6:2993:1858396216619584:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306019.273085:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000012371d1b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2992:1858396216619712:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306019.273176:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306019.273177:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306019.273248:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004f59895e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216619776:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306019.273258:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000676f9e41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2991:1858396216619904:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306019.273288:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306019.273330:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772306019.273344:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306019.273392:0:2993:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1772306019.273412:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085c3cd20 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216619840:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306019.273425:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216619648 00000100:00100000:3.0:1772306019.273428:0:54689:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216619584 00000100:00100000:1.0:1772306019.273442:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216619712 00000100:00100000:0.0:1772306019.273457:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772306019.273523:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216619904 00000100:00100000:0.0:1772306019.273530:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216619776 00000100:00100000:1.0:1772306019.273541:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1772306019.273553:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ee429faf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:2991:x1858396216619648:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306019.273583:0:54689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1772306019.273600:0:54689:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f0e21dd3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70aae467-c860-409f-ba1b-742f4d042da6+18:2993:x1858396216619584:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772306019.273601:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216619840 00000100:00100000:2.0:1772306019.273609:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1772306019.273678:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cb7be42b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:2992:x1858396216619712:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772306019.273687:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1278 00000100:00100000:1.0:1772306019.273697:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ee429faf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:2991:x1858396216619648:12345-0@lo:400:kworker/u8:1.0 Request processed in 139us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306019.273707:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000299df28c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216619776:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306019.273717:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1772306019.273777:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1772306019.273787:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006b94893a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:2991:x1858396216619904:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306019.273809:0:54689:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f0e21dd3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70aae467-c860-409f-ba1b-742f4d042da6+18:2993:x1858396216619584:12345-0@lo:400:kworker/u8:1.0 Request processed in 205us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306019.273828:0:54689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1772306019.273845:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000299df28c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216619776:12345-0@lo:400:kworker/u8:1.0 Request processed in 138us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306019.273859:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cb7be42b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:2992:x1858396216619712:12345-0@lo:400:kworker/u8:1.0 Request processed in 225us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306019.273868:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1278 00000100:00100000:1.0:1772306019.273881:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006b94893a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:2991:x1858396216619904:12345-0@lo:400:kworker/u8:1.0 Request processed in 91us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306019.273893:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1772306019.273907:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1772306019.273909:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1279 00000100:00100000:0.0:1772306019.273922:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d0cbbfba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216619840:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772306019.273986:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d0cbbfba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216619840:12345-0@lo:400:kworker/u8:1.0 Request processed in 63us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306019.273998:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1279 00000100:00100000:2.0:1772306019.274027:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000012371d1b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2992:1858396216619712:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306019.274065:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000676f9e41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2991:1858396216619904:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306019.274104:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085c3cd20 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216619840:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306019.274109:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007e97bd92 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2991:1858396216619648:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306019.274146:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004f59895e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216619776:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306019.274174:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000db3403a9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:70aae467-c860-409f-ba1b-742f4d042da6:2993:1858396216619584:0@lo:400:kworker/u8:1.0 00000040:00080000:1.0:1772306019.386237:0:75264:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306019.386247:0:75264:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306019.387209:0:75264:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306019.387223:0:75264:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:2.0:1772306019.720935:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306019.720948:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306019.721837:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306019.721850:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772306020.040921:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1772306020.718129:0:75315:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306020.718138:0:75315:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306020.718512:0:75315:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306020.718520:0:75315:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:0.0:1772306020.744809:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772306020.744816:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772306020.745202:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:0.0:1772306020.745214:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772306021.064929:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1772306021.444051:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772306021.444094:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772306021.444140:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306021.444147:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225429120 00000100:00100000:0.0:1772306021.444173:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772306021.444199:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225429184 00000100:00100000:0.0:1772306021.444226:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306021.444236:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 184 00000100:00100000:3.0:1772306021.444247:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000c8fddbb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2215:x1858396225429120:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1772306021.444254:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225429376 00000100:00100000:2.0:1772306021.444261:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225429248 00000100:00100000:0.0:1772306021.444271:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772306021.444288:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 248 00000100:00100000:1.0:1772306021.444295:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000882d266a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2216:x1858396225429184:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:0.0:1772306021.444319:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306021.444346:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000c8fddbb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2215:x1858396225429120:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 98us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306021.444346:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000882d266a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2216:x1858396225429184:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 47us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306021.444356:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225429312 00000100:00100000:3.0:1772306021.444358:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 184 00000100:00100000:1.0:1772306021.444358:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 248 00000100:00100000:1.0:1772306021.444396:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 249 00000100:00100000:1.0:1772306021.444405:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bcaf406f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2215:x1858396225429376:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1772306021.444409:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225429440 00000100:00100000:3.0:1772306021.444427:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225429504 00000100:00100000:1.0:1772306021.444437:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bcaf406f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2215:x1858396225429376:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 33us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306021.444447:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 249 00000100:00100000:2.0:1772306021.444468:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1280 00000100:00100000:3.0:1772306021.444492:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1281 00000100:00100000:2.0:1772306021.444500:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000035fd0397 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2215:x1858396225429248:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:3.0:1772306021.444504:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000093f32b77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2216:x1858396225429312:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:0.0:1772306021.444521:0:48463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1282 00000100:00100000:0.0:1772306021.444532:0:48463:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000465b750e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2216:x1858396225429440:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1772306021.444537:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1283 00000100:00100000:1.0:1772306021.444562:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e5233900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2215:x1858396225429504:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:0.0:1772306021.444617:0:48463:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000465b750e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2216:x1858396225429440:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 89us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306021.444623:0:48463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1282 00000100:00100000:1.0:1772306021.444669:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e5233900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2215:x1858396225429504:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 105us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306021.444682:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000035fd0397 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2215:x1858396225429248:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 196us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306021.444696:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1283 00000100:00100000:3.0:1772306021.444703:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000093f32b77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2216:x1858396225429312:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 193us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306021.444714:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1280 00000100:00100000:3.0:1772306021.444820:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1281 00000040:00080000:0.0:1772306021.768877:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772306021.768887:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772306021.769383:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:0.0:1772306021.769393:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:1.0:1772306022.071474:0:75366:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306022.071479:0:75366:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306022.072121:0:75366:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306022.072129:0:75366:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:1.0:1772306022.088740:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1772306022.792849:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772306022.792859:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772306022.793226:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:0.0:1772306022.793233:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772306023.112828:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1772306023.369089:0:75417:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772306023.369095:0:75417:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772306023.369590:0:75417:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:3.0:1772306023.369599:0:75417:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:0.0:1772306023.816816:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772306023.816823:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772306023.817246:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:0.0:1772306023.817258:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:2.0:1772306023.880831:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000010235c68 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216619968:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1772306023.880899:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772306023.880906:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000db3403a9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216620032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1772306023.880995:0:6310:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216619968 00000100:00100000:3.0:1772306023.881002:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772306023.881077:0:6310:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216620032 00000100:00100000:3.0:1772306023.881098:0:6309:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 495 00000100:00100000:3.0:1772306023.881124:0:6309:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000082992e06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216619968:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1772306023.881166:0:6310:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 496 00000100:00100000:2.0:1772306023.881179:0:6310:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004f59895e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216620032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1772306023.881184:0:6309:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 742981632 pending 0 free 3828350976 avail 3826253824 00002000:00000024:2.0:1772306023.881225:0:6310:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 695140352 pending 0 free 3606052864 avail 3603955712 00000100:00100000:3.0:1772306023.881261:0:6309:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000082992e06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216619968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 148us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306023.881277:0:6309:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 495 00000100:00100000:2.0:1772306023.881320:0:6310:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004f59895e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216620032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 142us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306023.881330:0:6310:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 496 00000100:00100000:3.0:1772306023.881406:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000010235c68 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216619968:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1772306023.881430:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000db3403a9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216620032:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1772306024.136886:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772306024.392904:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ab80ba74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:70aae467-c860-409f-ba1b-742f4d042da6:2994:1858396216620096:0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772306024.392928:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000010235c68 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2991:1858396216620160:0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772306024.392952:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000013a9ed66 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216620288:0@lo:400:kworker/u8:4.0 00000100:00100000:0.0:1772306024.392981:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a648c204 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2992:1858396216620224:0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772306024.393023:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772306024.393031:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772306024.393031:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306024.393107:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216620288 00000100:00100000:3.0:1772306024.393128:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ac13a99c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2991:1858396216620416:0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772306024.393130:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c8db4b09 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216620352:0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772306024.393151:0:54689:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216620096 00000100:00100000:0.0:1772306024.393191:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1284 00000100:00100000:3.0:1772306024.393198:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772306024.393199:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306024.393205:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b830b726 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216620288:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772306024.393211:0:54689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1772306024.393222:0:54689:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008321c004 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70aae467-c860-409f-ba1b-742f4d042da6+18:2994:x1858396216620096:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772306024.393270:0:71804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216620160 00000100:00100000:1.0:1772306024.393276:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216620352 00000100:00100000:2.0:1772306024.393303:0:54689:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008321c004 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70aae467-c860-409f-ba1b-742f4d042da6+18:2994:x1858396216620096:12345-0@lo:400:kworker/u8:4.0 Request processed in 80us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306024.393314:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b830b726 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216620288:12345-0@lo:400:kworker/u8:4.0 Request processed in 110us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306024.393315:0:54689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1772306024.393333:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1285 00000100:00100000:3.0:1772306024.393338:0:71804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216620416 00000100:00100000:1.0:1772306024.393348:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000015856d86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216620352:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:0.0:1772306024.393355:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1284 00000100:00100000:3.0:1772306024.393380:0:71804:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1772306024.393390:0:71804:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000085c3cd20 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:2991:x1858396216620160:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772306024.393424:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c8db4b09 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216620352:0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772306024.393434:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000015856d86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216620352:12345-0@lo:400:kworker/u8:4.0 Request processed in 79us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306024.393448:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1285 00000100:00100000:2.0:1772306024.393452:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ab80ba74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:70aae467-c860-409f-ba1b-742f4d042da6:2994:1858396216620096:0@lo:400:kworker/u8:4.0 00000100:00100000:0.0:1772306024.393454:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1772306024.393470:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000fb2f2c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:2991:x1858396216620416:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772306024.393476:0:71804:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000085c3cd20 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:2991:x1858396216620160:12345-0@lo:400:kworker/u8:4.0 Request processed in 86us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306024.393497:0:71804:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1772306024.393532:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000013a9ed66 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216620288:0@lo:400:kworker/u8:4.0 00000100:00100000:0.0:1772306024.393548:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000fb2f2c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:2991:x1858396216620416:12345-0@lo:400:kworker/u8:4.0 Request processed in 79us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306024.393554:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306024.393562:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1772306024.393610:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216620224 00000100:00100000:3.0:1772306024.393616:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ac13a99c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2991:1858396216620416:0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772306024.393704:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000010235c68 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2991:1858396216620160:0@lo:400:kworker/u8:4.0 00000100:00100000:0.0:1772306024.393740:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1772306024.393775:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008608acb2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:2992:x1858396216620224:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:0.0:1772306024.393817:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008608acb2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:2992:x1858396216620224:12345-0@lo:400:kworker/u8:4.0 Request processed in 68us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306024.393825:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1772306024.393851:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a648c204 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2992:1858396216620224:0@lo:400:kworker/u8:4.0 00000040:00080000:0.0:1772306024.762562:0:75468:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772306024.762571:0:75468:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772306024.763390:0:75468:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:0.0:1772306024.763404:0:75468:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:0.0:1772306024.840893:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772306024.840901:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772306024.841734:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:0.0:1772306024.841750:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772306025.160845:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1772306025.865016:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772306025.865028:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772306025.866091:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:0.0:1772306025.866110:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:1.0:1772306026.184821:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1772306026.210681:0:75519:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772306026.210688:0:75519:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772306026.211315:0:75519:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:3.0:1772306026.211329:0:75519:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:3.0:1772306026.564124:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306026.564207:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306026.564252:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772306026.564256:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225429568 00000100:00100000:3.0:1772306026.564290:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772306026.564319:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225429696 00000100:00100000:0.0:1772306026.564326:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225429824 00000100:00100000:3.0:1772306026.564335:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772306026.564346:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 186 00000100:00100000:2.0:1772306026.564362:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003f190006 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2216:x1858396225429568:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:3.0:1772306026.564378:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772306026.564411:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225429952 00000100:00100000:0.0:1772306026.564413:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225429632 00000100:00100000:0.0:1772306026.564453:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 253 00000100:00100000:0.0:1772306026.564465:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000db3403a9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2216:x1858396225429824:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:3.0:1772306026.564490:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772306026.564495:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225429760 00000100:00100000:2.0:1772306026.564505:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003f190006 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2216:x1858396225429568:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 147us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306026.564517:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 186 00000100:00100000:1.0:1772306026.564548:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225429888 00000100:00100000:0.0:1772306026.564566:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000db3403a9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2216:x1858396225429824:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 99us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306026.564583:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 253 00000100:00100000:1.0:1772306026.564607:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1286 00000100:00100000:0.0:1772306026.564620:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 254 00000100:00100000:1.0:1772306026.564622:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000080e4cc77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2216:x1858396225429696:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1772306026.564655:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1287 00000100:00100000:0.0:1772306026.564678:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000676f9e41 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2216:x1858396225429632:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1772306026.564764:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007e97bd92 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2216:x1858396225429952:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:0.0:1772306026.564766:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000676f9e41 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2216:x1858396225429632:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 71us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306026.564787:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000080e4cc77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2216:x1858396225429696:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 156us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306026.564814:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1286 00000100:00100000:0.0:1772306026.564823:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 254 00000100:00100000:2.0:1772306026.564853:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007e97bd92 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2216:x1858396225429952:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 86us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306026.564866:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1288 00000100:00100000:1.0:1772306026.564876:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000012371d1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2216:x1858396225429760:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1772306026.564886:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1287 00000100:00100000:0.0:1772306026.564900:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1289 00000100:00100000:0.0:1772306026.564911:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006bac7351 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2216:x1858396225429888:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:0.0:1772306026.564963:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006bac7351 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2216:x1858396225429888:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 48us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306026.564965:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000012371d1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2216:x1858396225429760:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 78us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306026.564983:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1289 00000100:00100000:1.0:1772306026.564995:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1288 00000040:00080000:0.0:1772306026.888947:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772306026.888959:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772306026.889725:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:0.0:1772306026.889758:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772306027.208973:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1772306027.669979:0:75571:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772306027.669988:0:75571:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772306027.670777:0:75571:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:3.0:1772306027.670796:0:75571:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:0.0:1772306027.912956:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772306027.912967:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772306027.913791:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:0.0:1772306027.913808:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772306028.232808:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1772306028.936850:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306028.936856:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306028.937362:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306028.937371:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:3.0:1772306029.000849:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae945845 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216620480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1772306029.000849:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d6f2aba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216620544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1772306029.000963:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772306029.001110:0:7591:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216620544 00000100:00100000:1.0:1772306029.001203:0:7591:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 497 00000100:00100000:1.0:1772306029.001213:0:7591:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009ce141ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216620544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1772306029.001279:0:7591:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 695140352 pending 0 free 3606052864 avail 3603955712 00000100:00100000:1.0:1772306029.001343:0:7591:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009ce141ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216620544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306029.001354:0:7591:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 497 00000100:00100000:1.0:1772306029.001418:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d6f2aba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216620544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1772306029.001645:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306029.001772:0:7591:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216620480 00000100:00100000:0.0:1772306029.001815:0:7591:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 498 00000100:00100000:0.0:1772306029.001824:0:7591:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f12f604e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216620480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1772306029.001858:0:7591:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 742981632 pending 0 free 3828350976 avail 3826253824 00000100:00100000:0.0:1772306029.001954:0:7591:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f12f604e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216620480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306029.001966:0:7591:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 498 00000100:00100000:0.0:1772306029.002048:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae945845 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216620480:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1772306029.047070:0:75622:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772306029.047077:0:75622:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772306029.047541:0:75622:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:0.0:1772306029.047552:0:75622:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772306029.256846:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1772306029.512869:0:2993:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1772306029.512896:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d8dbdab2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216620800:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306029.512899:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000039584847 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2991:1858396216620672:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306029.512900:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e2fd14bd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2992:1858396216620736:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772306029.512993:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772306029.512997:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772306029.513012:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000700bb73d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216620864:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772306029.513032:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d6f2aba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:70aae467-c860-409f-ba1b-742f4d042da6:2993:1858396216620608:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306029.513047:0:2992:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1772306029.513052:0:48463:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216620800 00000100:00100000:3.0:1772306029.513059:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000091b2c0c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:2992:1858396216620928:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306029.513061:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306029.513074:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772306029.513103:0:48463:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216620864 00000100:00100000:3.0:1772306029.513115:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306029.513130:0:54689:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216620608 00000100:00100000:1.0:1772306029.513136:0:48463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1290 00000100:00100000:1.0:1772306029.513142:0:48463:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000d82e3c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216620800:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306029.513149:0:48470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1291 00000100:00100000:2.0:1772306029.513156:0:48470:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001460fd38 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216620864:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772306029.513178:0:54689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1772306029.513179:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216620736 00000100:00100000:0.0:1772306029.513186:0:54689:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009179893b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70aae467-c860-409f-ba1b-742f4d042da6+18:2993:x1858396216620608:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306029.513225:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216620928 00000100:00100000:1.0:1772306029.513226:0:48463:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000d82e3c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216620800:12345-0@lo:400:kworker/u8:1.0 Request processed in 83us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306029.513237:0:48470:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001460fd38 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216620864:12345-0@lo:400:kworker/u8:1.0 Request processed in 79us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306029.513239:0:48463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1290 00000100:00100000:0.0:1772306029.513243:0:54689:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009179893b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70aae467-c860-409f-ba1b-742f4d042da6+18:2993:x1858396216620608:12345-0@lo:400:kworker/u8:1.0 Request processed in 56us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306029.513253:0:48470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1291 00000100:00100000:0.0:1772306029.513256:0:54689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1772306029.513260:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1772306029.513267:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ae945845 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:2992:x1858396216620736:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772306029.513309:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1772306029.513314:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cbc88ded pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:2992:x1858396216620928:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306029.513318:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d8dbdab2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216620800:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306029.513319:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000700bb73d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216620864:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306029.513328:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ae945845 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:2992:x1858396216620736:12345-0@lo:400:kworker/u8:1.0 Request processed in 57us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306029.513339:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1772306029.513346:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d6f2aba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:70aae467-c860-409f-ba1b-742f4d042da6:2993:1858396216620608:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772306029.513356:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cbc88ded pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:2992:x1858396216620928:12345-0@lo:400:kworker/u8:1.0 Request processed in 41us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306029.513363:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306029.513368:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1772306029.513386:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216620672 00000100:00100000:3.0:1772306029.513425:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1772306029.513427:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000091b2c0c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:2992:1858396216620928:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306029.513435:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000075ede1e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:2991:x1858396216620672:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306029.513440:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e2fd14bd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2992:1858396216620736:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306029.513480:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000075ede1e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:2991:x1858396216620672:12345-0@lo:400:kworker/u8:1.0 Request processed in 46us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306029.513487:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000039584847 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2991:1858396216620672:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306029.513491:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000040:00080000:2.0:1772306029.960944:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306029.960953:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306029.961334:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306029.961342:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:1.0:1772306030.280799:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1772306030.347761:0:75673:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772306030.347767:0:75673:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772306030.348167:0:75673:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:0.0:1772306030.348174:0:75673:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:2.0:1772306030.984882:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306030.984890:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306030.985254:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306030.985260:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772306031.304858:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1772306031.655178:0:75724:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772306031.655185:0:75724:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772306031.655595:0:75724:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:0.0:1772306031.655602:0:75724:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:3.0:1772306031.683811:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306031.683864:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306031.683907:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772306031.683909:0:54689:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225430016 00000100:00100000:2.0:1772306031.683924:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225430144 00000100:00100000:3.0:1772306031.683940:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306031.683968:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772306031.684000:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225430400 00000100:00100000:3.0:1772306031.684002:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772306031.684011:0:54689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 188 00000100:00100000:0.0:1772306031.684025:0:54689:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000056897bb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2218:x1858396225430016:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1772306031.684028:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225430208 00000100:00100000:2.0:1772306031.684058:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1292 00000100:00100000:2.0:1772306031.684067:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e97202db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2218:x1858396225430144:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1772306031.684076:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306031.684110:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225430272 00000100:00100000:0.0:1772306031.684151:0:54689:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000056897bb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2218:x1858396225430016:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 127us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306031.684167:0:54689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 188 00000100:00100000:2.0:1772306031.684173:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e97202db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2218:x1858396225430144:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 100us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306031.684187:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1292 00000100:00100000:3.0:1772306031.684213:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225430080 00000100:00100000:2.0:1772306031.684213:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225430336 00000100:00100000:3.0:1772306031.684243:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 258 00000100:00100000:2.0:1772306031.684243:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1293 00000100:00100000:3.0:1772306031.684249:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000004f8c4bb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2218:x1858396225430272:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1772306031.684249:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000004a705af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2218:x1858396225430400:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1772306031.684285:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000004a705af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2218:x1858396225430400:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 35us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306031.684289:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000004f8c4bb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2218:x1858396225430272:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 40us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306031.684297:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 258 00000100:00100000:2.0:1772306031.684297:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1293 00000100:00100000:2.0:1772306031.684323:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1294 00000100:00100000:3.0:1772306031.684325:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 259 00000100:00100000:2.0:1772306031.684330:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000830ec897 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2218:x1858396225430208:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1772306031.684334:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000453faf57 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2218:x1858396225430080:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1772306031.684364:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000453faf57 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2218:x1858396225430080:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 32us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306031.684364:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000830ec897 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2218:x1858396225430208:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 33us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306031.684373:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 259 00000100:00100000:2.0:1772306031.684373:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1294 00000100:00100000:2.0:1772306031.684395:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1295 00000100:00100000:2.0:1772306031.684399:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007a587e26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2218:x1858396225430336:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1772306031.684456:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007a587e26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2218:x1858396225430336:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 54us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306031.684466:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1295 00000040:00080000:2.0:1772306032.008853:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306032.008861:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306032.009271:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306032.009277:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772306032.328856:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1772306032.966230:0:75775:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306032.966236:0:75775:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306032.966677:0:75775:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306032.966685:0:75775:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:0.0:1772306033.032889:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772306033.032898:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772306033.033324:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:0.0:1772306033.033332:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772306033.352803:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1772306034.057794:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306034.057800:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306034.058300:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306034.058308:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:3.0:1772306034.120783:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000216f6f28 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216620992:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1772306034.120804:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006b96b036 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216621056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1772306034.120892:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772306034.120970:0:55611:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216621056 00000100:00100000:1.0:1772306034.121026:0:55611:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 499 00000100:00100000:1.0:1772306034.121032:0:55611:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d8dbdab2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216621056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1772306034.121073:0:55611:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 695140352 pending 0 free 3606052864 avail 3603955712 00000100:00100000:1.0:1772306034.121134:0:55611:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d8dbdab2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216621056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306034.121145:0:55611:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 499 00000100:00100000:0.0:1772306034.121153:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772306034.121172:0:55611:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216620992 00000100:00100000:1.0:1772306034.121202:0:55611:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 500 00000100:00100000:1.0:1772306034.121207:0:55611:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006824eabf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216620992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1772306034.121228:0:55611:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 742981632 pending 0 free 3828350976 avail 3826253824 00000100:00100000:0.0:1772306034.121229:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006b96b036 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216621056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1772306034.121268:0:55611:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006824eabf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216620992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306034.121275:0:55611:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 500 00000100:00100000:0.0:1772306034.121282:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000216f6f28 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216620992:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1772306034.278147:0:75827:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306034.278152:0:75827:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306034.278582:0:75827:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306034.278591:0:75827:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:1.0:1772306034.376762:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772306034.632933:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006e7b3ee8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:2993:1858396216621312:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306034.632952:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001f9afe5d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2991:1858396216621184:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772306034.632961:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000890ea8c8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:70aae467-c860-409f-ba1b-742f4d042da6:2994:1858396216621120:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306034.633016:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306034.633021:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772306034.633057:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000af22ffe1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2992:1858396216621248:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306034.633090:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216621312 00000100:00100000:0.0:1772306034.633100:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216621120 00000100:00100000:3.0:1772306034.633110:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306034.633152:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1772306034.633158:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000060da9027 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2994:x1858396216621120:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306034.633178:0:71804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216621248 00000100:00100000:2.0:1772306034.633183:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1772306034.633191:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ee92c34a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:2993:x1858396216621312:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306034.633214:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306034.633225:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000060da9027 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2994:x1858396216621120:12345-0@lo:400:kworker/u8:1.0 Request processed in 67us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306034.633232:0:71804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216621184 00000100:00100000:0.0:1772306034.633233:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1772306034.633276:0:71804:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1772306034.633286:0:71804:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f842a169 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:2992:x1858396216621248:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306034.633290:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1772306034.633299:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ee92c34a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:2993:x1858396216621312:12345-0@lo:400:kworker/u8:1.0 Request processed in 102us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306034.633308:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d4d8044c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:2991:x1858396216621184:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306034.633310:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1772306034.633312:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000890ea8c8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:70aae467-c860-409f-ba1b-742f4d042da6:2994:1858396216621120:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306034.633364:0:71804:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f842a169 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:2992:x1858396216621248:12345-0@lo:400:kworker/u8:1.0 Request processed in 78us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306034.633376:0:71804:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1772306034.633397:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d4d8044c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:2991:x1858396216621184:12345-0@lo:400:kworker/u8:1.0 Request processed in 84us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306034.633411:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1772306034.633416:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006e7b3ee8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:2993:1858396216621312:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306034.633431:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001f9afe5d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2991:1858396216621184:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306034.633449:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000af22ffe1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2992:1858396216621248:0@lo:400:kworker/u8:1.0 00000040:00080000:2.0:1772306035.080835:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306035.080842:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306035.081242:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306035.081251:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772306035.400814:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1772306035.565741:0:75878:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306035.565747:0:75878:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306035.566136:0:75878:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306035.566143:0:75878:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:2.0:1772306036.104925:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306036.104935:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306036.105528:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306036.105540:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772306036.424778:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1772306036.803702:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772306036.803733:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772306036.803760:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772306036.803761:0:54689:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225430464 00000100:00100000:0.0:1772306036.803786:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772306036.803789:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225430592 00000100:00100000:0.0:1772306036.803808:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772306036.803818:0:54689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 190 00000100:00100000:2.0:1772306036.803836:0:54689:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002a056c68 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2217:x1858396225430464:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1772306036.803849:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225430848 00000100:00100000:0.0:1772306036.803855:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772306036.803882:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225430656 00000100:00100000:2.0:1772306036.803903:0:54689:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002a056c68 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2217:x1858396225430464:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 75us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306036.803920:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1296 00000100:00100000:0.0:1772306036.803920:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772306036.803922:0:54689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 190 00000100:00100000:1.0:1772306036.803933:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000097325d89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2217:x1858396225430592:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1772306036.803966:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225430784 00000100:00100000:1.0:1772306036.803981:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000097325d89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2217:x1858396225430592:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 49us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306036.803992:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1296 00000100:00100000:2.0:1772306036.804005:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1297 00000100:00100000:0.0:1772306036.804007:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225430720 00000100:00100000:1.0:1772306036.804018:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1298 00000100:00100000:2.0:1772306036.804022:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b4db4a55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2217:x1858396225430848:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1772306036.804030:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009f99046b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2217:x1858396225430656:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1772306036.804036:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225430528 00000100:00100000:0.0:1772306036.804058:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 263 00000100:00100000:0.0:1772306036.804064:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008908aaf6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2217:x1858396225430720:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1772306036.804080:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b4db4a55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2217:x1858396225430848:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 62us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306036.804081:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009f99046b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2217:x1858396225430656:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 50us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306036.804096:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008908aaf6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2217:x1858396225430720:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 31us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306036.804103:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1297 00000100:00100000:0.0:1772306036.804107:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 263 00000100:00100000:1.0:1772306036.804113:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1298 00000100:00100000:2.0:1772306036.804133:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1299 00000100:00100000:0.0:1772306036.804134:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 264 00000100:00100000:0.0:1772306036.804149:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c8d8b056 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2217:x1858396225430528:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1772306036.804151:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ff1d690e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2217:x1858396225430784:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1772306036.804170:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c8d8b056 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2217:x1858396225430528:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 27us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306036.804176:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 264 00000100:00100000:2.0:1772306036.804202:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ff1d690e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2217:x1858396225430784:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 57us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306036.804211:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1299 00000040:00080000:1.0:1772306036.852775:0:75929:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306036.852780:0:75929:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306036.853156:0:75929:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306036.853164:0:75929:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:2.0:1772306037.128790:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306037.128796:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306037.129191:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306037.129199:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772306037.448777:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1772306038.152760:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306038.152764:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306038.153135:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306038.153145:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:2.0:1772306038.164593:0:75980:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306038.164597:0:75980:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306038.164994:0:75980:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306038.165001:0:75980:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:1.0:1772306038.472749:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1772306039.176811:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306039.176818:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306039.177195:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306039.177202:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:0.0:1772306039.240761:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000af091ea6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216621376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1772306039.240775:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000065469dd5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216621440:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1772306039.240833:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772306039.240873:0:55611:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216621376 00000100:00100000:0.0:1772306039.240897:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772306039.240916:0:55611:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216621440 00000100:00100000:3.0:1772306039.240947:0:55611:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 501 00000100:00100000:3.0:1772306039.240953:0:55611:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e09ae93a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216621376:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1772306039.240958:0:7591:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 502 00000100:00100000:0.0:1772306039.240965:0:7591:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fc5ade3a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216621440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1772306039.240990:0:55611:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 742981632 pending 0 free 3828350976 avail 3826253824 00002000:00000024:0.0:1772306039.240991:0:7591:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 695140352 pending 0 free 3606052864 avail 3603955712 00000100:00100000:3.0:1772306039.241046:0:55611:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e09ae93a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216621376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306039.241051:0:7591:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fc5ade3a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216621440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306039.241057:0:55611:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 501 00000100:00100000:0.0:1772306039.241063:0:7591:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 502 00000100:00100000:0.0:1772306039.241119:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000065469dd5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216621440:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1772306039.241148:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000af091ea6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216621376:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1772306039.452305:0:76031:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772306039.452309:0:76031:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772306039.452711:0:76031:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:3.0:1772306039.452722:0:76031:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:2.0:1772306039.497703:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1772306039.752823:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000af22ffe1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:2993:1858396216621568:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306039.752823:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006e7b3ee8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:2994:1858396216621632:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306039.752823:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001f9afe5d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:70aae467-c860-409f-ba1b-742f4d042da6:2992:1858396216621504:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772306039.752823:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000890ea8c8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2991:1858396216621696:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306039.752948:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306039.752948:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772306039.752996:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772306039.753022:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216621504 00000100:00100000:1.0:1772306039.753036:0:71804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216621696 00000100:00100000:0.0:1772306039.753052:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216621568 00000100:00100000:2.0:1772306039.753077:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1772306039.753085:0:71804:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1772306039.753088:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000079efc383 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2992:x1858396216621504:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306039.753095:0:71804:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000065469dd5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:2991:x1858396216621696:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772306039.753107:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1772306039.753114:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306039.753124:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000af091ea6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:2993:x1858396216621568:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306039.753175:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000079efc383 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2992:x1858396216621504:12345-0@lo:400:kworker/u8:1.0 Request processed in 89us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306039.753183:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1772306039.753203:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216621632 00000100:00100000:0.0:1772306039.753208:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000af091ea6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:2993:x1858396216621568:12345-0@lo:400:kworker/u8:1.0 Request processed in 82us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306039.753211:0:71804:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000065469dd5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:2991:x1858396216621696:12345-0@lo:400:kworker/u8:1.0 Request processed in 116us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306039.753219:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1772306039.753226:0:71804:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1772306039.753251:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001f9afe5d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:70aae467-c860-409f-ba1b-742f4d042da6:2992:1858396216621504:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772306039.753257:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1772306039.753264:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000216f6f28 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:2994:x1858396216621632:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772306039.753323:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000216f6f28 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:2994:x1858396216621632:12345-0@lo:400:kworker/u8:1.0 Request processed in 58us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306039.753335:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1772306039.753337:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000af22ffe1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:2993:1858396216621568:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306039.753347:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000890ea8c8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2991:1858396216621696:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306039.753423:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006e7b3ee8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:2994:1858396216621632:0@lo:400:kworker/u8:1.0 00000040:00080000:2.0:1772306040.200870:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306040.200885:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306040.201744:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306040.201758:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772306040.520846:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1772306040.831693:0:76083:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306040.831698:0:76083:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306040.832058:0:76083:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306040.832063:0:76083:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:2.0:1772306041.224777:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306041.224785:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306041.225432:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306041.225442:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772306041.544850:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1772306041.923700:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772306041.923728:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306041.923733:0:54689:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225430912 00000100:00100000:0.0:1772306041.923752:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772306041.923787:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306041.923793:0:54689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 192 00000100:00100000:2.0:1772306041.923793:0:48463:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225431040 00000100:00100000:3.0:1772306041.923803:0:54689:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000296a1da5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2218:x1858396225430912:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1772306041.923805:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225431168 00000100:00100000:0.0:1772306041.923824:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772306041.923841:0:48463:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225431296 00000100:00100000:1.0:1772306041.923860:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225430976 00000100:00100000:0.0:1772306041.923866:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306041.923873:0:54689:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000296a1da5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2218:x1858396225430912:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 69us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306041.923880:0:54689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 192 00000100:00100000:2.0:1772306041.923880:0:48463:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225431104 00000100:00100000:1.0:1772306041.923903:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 268 00000100:00100000:1.0:1772306041.923912:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009f043825 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2218:x1858396225431168:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1772306041.923918:0:48463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1300 00000100:00100000:2.0:1772306041.923926:0:48463:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000257ed89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2218:x1858396225431040:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:3.0:1772306041.923938:0:48470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1301 00000100:00100000:3.0:1772306041.923943:0:48470:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005f7abb81 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2218:x1858396225431296:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1772306041.923981:0:48463:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000257ed89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2218:x1858396225431040:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 49us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306041.923982:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009f043825 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2218:x1858396225431168:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 64us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306041.923987:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772306041.924001:0:48463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1300 00000100:00100000:1.0:1772306041.924002:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 268 00000100:00100000:2.0:1772306041.924028:0:48463:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225431232 00000100:00100000:1.0:1772306041.924032:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 269 00000100:00100000:1.0:1772306041.924037:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001de570f7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2218:x1858396225430976:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:3.0:1772306041.924055:0:48470:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005f7abb81 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2218:x1858396225431296:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 110us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306041.924063:0:48470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1301 00000100:00100000:2.0:1772306041.924070:0:48463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1302 00000100:00100000:1.0:1772306041.924074:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001de570f7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2218:x1858396225430976:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 35us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306041.924080:0:48463:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000af4ced1c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2218:x1858396225431104:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1772306041.924091:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 269 00000100:00100000:3.0:1772306041.924092:0:48470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1303 00000100:00100000:3.0:1772306041.924102:0:48470:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d9b971a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2218:x1858396225431232:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1772306041.924113:0:48463:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000af4ced1c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2218:x1858396225431104:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 35us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306041.924131:0:48463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1302 00000100:00100000:3.0:1772306041.924246:0:48470:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d9b971a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2218:x1858396225431232:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 146us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306041.924251:0:48470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1303 00000040:00080000:3.0:1772306042.120200:0:76134:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772306042.120205:0:76134:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772306042.120565:0:76134:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:3.0:1772306042.120571:0:76134:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:2.0:1772306042.248779:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306042.248786:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306042.249158:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306042.249164:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:1.0:1772306042.568810:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1772306043.272819:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772306043.272825:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772306043.273295:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:0.0:1772306043.273303:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:1.0:1772306043.423285:0:76185:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306043.423289:0:76185:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306043.423697:0:76185:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306043.423704:0:76185:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:2.0:1772306043.592787:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1772306044.296821:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772306044.296829:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772306044.297366:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:0.0:1772306044.297377:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:2.0:1772306044.360853:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002ad7a53e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216621760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1772306044.360880:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000030acc74c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216621824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1772306044.360963:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306044.361056:0:6309:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216621760 00000100:00100000:2.0:1772306044.361080:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306044.361157:0:6309:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216621824 00000100:00100000:2.0:1772306044.361168:0:7591:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 503 00000100:00100000:2.0:1772306044.361185:0:7591:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001f9afe5d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216621760:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1772306044.361213:0:6309:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 504 00000100:00100000:0.0:1772306044.361225:0:6309:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006b96b036 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216621824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1772306044.361240:0:7591:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 695140352 pending 0 free 3606052864 avail 3603955712 00002000:00000024:0.0:1772306044.361276:0:6309:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 742981632 pending 0 free 3828350976 avail 3826253824 00000100:00100000:2.0:1772306044.361327:0:7591:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001f9afe5d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216621760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 142us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306044.361342:0:7591:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 503 00000100:00100000:0.0:1772306044.361361:0:6309:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006b96b036 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216621824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 136us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306044.361372:0:6309:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 504 00000100:00100000:0.0:1772306044.361456:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000030acc74c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216621824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1772306044.361461:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002ad7a53e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216621760:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1772306044.616811:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1772306044.847330:0:76236:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772306044.847338:0:76236:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772306044.848118:0:76236:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:0.0:1772306044.848136:0:76236:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:3.0:1772306044.873844:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000077c62deb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:70aae467-c860-409f-ba1b-742f4d042da6:2994:1858396216621888:0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772306044.873892:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002cd499a6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2991:1858396216621952:0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772306044.873954:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306044.873968:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b97a8f0f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2992:1858396216622016:0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772306044.873989:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772306044.874013:0:2994:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1772306044.874030:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b187ddcb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:2994:1858396216622080:0@lo:400:kworker/u8:4.0 00000100:00100000:0.0:1772306044.874068:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772306044.874107:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216621888 00000100:00100000:1.0:1772306044.874114:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216621952 00000100:00100000:1.0:1772306044.874194:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216622016 00000100:00100000:3.0:1772306044.874200:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1772306044.874210:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1772306044.874222:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fed43c45 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2994:x1858396216621888:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:0.0:1772306044.874233:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e854672f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:2991:x1858396216621952:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772306044.874246:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1772306044.874256:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002ad7a53e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:2992:x1858396216622016:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772306044.874347:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fed43c45 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2994:x1858396216621888:12345-0@lo:400:kworker/u8:4.0 Request processed in 126us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306044.874362:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1772306044.874371:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002ad7a53e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:2992:x1858396216622016:12345-0@lo:400:kworker/u8:4.0 Request processed in 110us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306044.874392:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1772306044.874395:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e854672f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:2991:x1858396216621952:12345-0@lo:400:kworker/u8:4.0 Request processed in 161us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306044.874419:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1772306044.874441:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772306044.874475:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216622080 00000100:00100000:3.0:1772306044.874504:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000077c62deb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:70aae467-c860-409f-ba1b-742f4d042da6:2994:1858396216621888:0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772306044.874532:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1772306044.874540:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002cd499a6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2991:1858396216621952:0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772306044.874549:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000df8abf0e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:2994:x1858396216622080:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:0.0:1772306044.874703:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b97a8f0f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2992:1858396216622016:0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772306044.874705:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000df8abf0e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:2994:x1858396216622080:12345-0@lo:400:kworker/u8:4.0 Request processed in 160us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306044.874726:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1772306044.874752:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b187ddcb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:2994:1858396216622080:0@lo:400:kworker/u8:4.0 00000040:00080000:0.0:1772306045.320835:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772306045.320845:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772306045.321725:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:0.0:1772306045.321743:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772306045.640817:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1772306046.019620:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772306046.019731:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225431360 00000100:00100000:1.0:1772306046.019812:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1256 00000100:00100000:1.0:1772306046.019820:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b97a8f0f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2217:x1858396225431360:12345-192.168.203.30@tcp:17:kworker/3:0.0 00000100:00100000:1.0:1772306046.019943:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b97a8f0f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2217:x1858396225431360:12345-192.168.203.30@tcp:17:kworker/3:0.0 Request processed in 124us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306046.019950:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1256 00000040:00080000:1.0:1772306046.156044:0:76287:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306046.156050:0:76287:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306046.156436:0:76287:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306046.156444:0:76287:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:0.0:1772306046.344877:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772306046.344887:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772306046.345414:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:0.0:1772306046.345426:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:1.0:1772306046.664804:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772306047.043922:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772306047.043972:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772306047.043997:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772306047.044007:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225431488 00000100:00100000:3.0:1772306047.044037:0:54689:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225431424 00000100:00100000:1.0:1772306047.044037:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772306047.044066:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306047.044105:0:54689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 194 00000100:00100000:0.0:1772306047.044105:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 273 00000100:00100000:1.0:1772306047.044110:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306047.044123:0:54689:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004f19bb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2215:x1858396225431424:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:0.0:1772306047.044123:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000082a20edb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2216:x1858396225431488:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1772306047.044138:0:48470:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225431616 00000100:00100000:1.0:1772306047.044148:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772306047.044180:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225431552 00000100:00100000:3.0:1772306047.044226:0:54689:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004f19bb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2215:x1858396225431424:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 106us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306047.044226:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000082a20edb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2216:x1858396225431488:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 107us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306047.044237:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225431808 00000100:00100000:3.0:1772306047.044238:0:54689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 194 00000100:00100000:2.0:1772306047.044238:0:48470:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225431744 00000100:00100000:0.0:1772306047.044239:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 273 00000100:00100000:0.0:1772306047.044288:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225431680 00000100:00100000:1.0:1772306047.044309:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1304 00000100:00100000:1.0:1772306047.044323:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000fd7c6d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2216:x1858396225431616:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:3.0:1772306047.044332:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 274 00000100:00100000:3.0:1772306047.044339:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000faca0d01 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2215:x1858396225431680:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1772306047.044362:0:48470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1305 00000100:00100000:1.0:1772306047.044369:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000fd7c6d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2216:x1858396225431616:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 46us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306047.044377:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1306 00000100:00100000:2.0:1772306047.044384:0:48470:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004d8ea70d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2215:x1858396225431552:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:3.0:1772306047.044388:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000faca0d01 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2215:x1858396225431680:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 45us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306047.044392:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d8f6a4e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2215:x1858396225431808:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1772306047.044397:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1304 00000100:00100000:3.0:1772306047.044426:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 274 00000100:00100000:1.0:1772306047.044445:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1307 00000100:00100000:1.0:1772306047.044453:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000004c96b79 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2216:x1858396225431744:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:0.0:1772306047.044460:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d8f6a4e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2215:x1858396225431808:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 70us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306047.044471:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1306 00000100:00100000:2.0:1772306047.044520:0:48470:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004d8ea70d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2215:x1858396225431552:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 122us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306047.044522:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000004c96b79 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2216:x1858396225431744:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 45us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306047.044672:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1307 00000100:00100000:2.0:1772306047.044739:0:48470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1305 00000040:00080000:0.0:1772306047.368990:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772306047.368999:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772306047.369888:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:0.0:1772306047.369900:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:0.0:1772306047.498093:0:76338:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772306047.498100:0:76338:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772306047.498564:0:76338:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:0.0:1772306047.498571:0:76338:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:2.0:1772306047.688820:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1772306048.392868:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772306048.392877:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772306048.393782:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:0.0:1772306048.393797:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:1.0:1772306048.713743:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1772306048.897134:0:76390:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772306048.897141:0:76390:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772306048.898016:0:76390:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:0.0:1772306048.898028:0:76390:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:0.0:1772306049.416917:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772306049.416927:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772306049.417926:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:0.0:1772306049.417940:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:3.0:1772306049.480920:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002cd499a6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216622144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1772306049.481006:0:2992:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1772306049.481034:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ac13a99c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216622208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1772306049.481050:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306049.481130:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772306049.481203:0:55611:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216622144 00000100:00100000:0.0:1772306049.481226:0:6309:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216622208 00000100:00100000:1.0:1772306049.481292:0:55611:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 505 00000100:00100000:1.0:1772306049.481309:0:55611:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a7de87ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216622144:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1772306049.481316:0:6309:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 506 00000100:00100000:0.0:1772306049.481332:0:6309:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c8db4b09 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216622208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1772306049.481377:0:6309:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 695140352 pending 0 free 3606052864 avail 3603955712 00002000:00000024:1.0:1772306049.481379:0:55611:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 742981632 pending 0 free 3828350976 avail 3826253824 00000100:00100000:0.0:1772306049.481460:0:6309:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c8db4b09 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216622208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306049.481476:0:6309:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 506 00000100:00100000:1.0:1772306049.481482:0:55611:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a7de87ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216622144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 170us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306049.481495:0:55611:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 505 00000100:00100000:0.0:1772306049.481600:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ac13a99c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216622208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1772306049.481832:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002cd499a6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216622144:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1772306049.736913:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1772306049.992930:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000022640fb5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:70aae467-c860-409f-ba1b-742f4d042da6:2992:1858396216622272:0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772306049.992942:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008f3ff7b7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:2993:1858396216622336:0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772306049.992943:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008a3f3626 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2991:1858396216622464:0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772306049.993061:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306049.993092:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772306049.993115:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b7ea6417 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:2994:1858396216622400:0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772306049.993167:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216622336 00000100:00100000:2.0:1772306049.993198:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306049.993215:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216622272 00000100:00100000:3.0:1772306049.993264:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216622400 00000100:00100000:2.0:1772306049.993302:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1772306049.993321:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1772306049.993344:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b04e3f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:2993:x1858396216622336:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:0.0:1772306049.993363:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001655ed78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2992:x1858396216622272:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772306049.993377:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1772306049.993389:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000226f5fc2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:2994:x1858396216622400:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772306049.993415:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b04e3f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:2993:x1858396216622336:12345-0@lo:400:kworker/u8:4.0 Request processed in 101us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306049.993443:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1772306049.993488:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001655ed78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2992:x1858396216622272:12345-0@lo:400:kworker/u8:4.0 Request processed in 124us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306049.993502:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000226f5fc2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:2994:x1858396216622400:12345-0@lo:400:kworker/u8:4.0 Request processed in 109us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306049.993525:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1772306049.993552:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1772306049.993570:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b7ea6417 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:2994:1858396216622400:0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772306049.993726:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306049.993743:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000022640fb5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:70aae467-c860-409f-ba1b-742f4d042da6:2992:1858396216622272:0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772306049.993770:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008f3ff7b7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:2993:1858396216622336:0@lo:400:kworker/u8:4.0 00000100:00100000:0.0:1772306049.993858:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216622464 00000100:00100000:0.0:1772306049.993943:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1772306049.993952:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006e7b3ee8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:2991:x1858396216622464:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:0.0:1772306049.994041:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006e7b3ee8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:2991:x1858396216622464:12345-0@lo:400:kworker/u8:4.0 Request processed in 87us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306049.994056:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1772306049.994116:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008a3f3626 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2991:1858396216622464:0@lo:400:kworker/u8:4.0 00000040:00080000:0.0:1772306050.349979:0:76441:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772306050.349987:0:76441:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772306050.350584:0:76441:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:0.0:1772306050.350595:0:76441:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:0.0:1772306050.440803:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772306050.440810:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772306050.441182:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:0.0:1772306050.441200:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:1.0:1772306050.760831:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1772306051.464791:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772306051.464797:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772306051.465158:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:0.0:1772306051.465163:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:1.0:1772306051.647621:0:76492:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306051.647647:0:76492:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306051.648072:0:76492:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306051.648082:0:76492:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:2.0:1772306051.784731:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1772306052.164001:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772306052.164042:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772306052.164068:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306052.164074:0:54689:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225431872 00000100:00100000:0.0:1772306052.164093:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772306052.164118:0:48470:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225432000 00000100:00100000:0.0:1772306052.164125:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772306052.164129:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225432128 00000100:00100000:3.0:1772306052.164143:0:54689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 196 00000100:00100000:3.0:1772306052.164153:0:54689:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000088bb74d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2216:x1858396225431872:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1772306052.164160:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772306052.164166:0:48470:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225432256 00000100:00100000:1.0:1772306052.164169:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225431936 00000100:00100000:0.0:1772306052.164197:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772306052.164214:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 278 00000100:00100000:1.0:1772306052.164219:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002cd499a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2216:x1858396225432128:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1772306052.164220:0:48470:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225432064 00000100:00100000:3.0:1772306052.164254:0:54689:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000088bb74d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2216:x1858396225431872:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 101us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306052.164257:0:48470:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225432192 00000100:00100000:1.0:1772306052.164262:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002cd499a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2216:x1858396225432128:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 38us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306052.164271:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1308 00000100:00100000:3.0:1772306052.164276:0:54689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 196 00000100:00100000:0.0:1772306052.164282:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ac13a99c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2216:x1858396225432000:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1772306052.164285:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 278 00000100:00100000:2.0:1772306052.164307:0:48470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1309 00000100:00100000:1.0:1772306052.164308:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 279 00000100:00100000:1.0:1772306052.164321:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b187ddcb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2216:x1858396225431936:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1772306052.164329:0:48470:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d52dc14a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2216:x1858396225432256:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1772306052.164329:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ac13a99c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2216:x1858396225432000:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 40us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306052.164354:0:6308:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1310 00000100:00100000:1.0:1772306052.164367:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b187ddcb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2216:x1858396225431936:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 48us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306052.164372:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1308 00000100:00100000:3.0:1772306052.164373:0:6308:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000077c62deb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2216:x1858396225432064:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1772306052.164381:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 279 00000100:00100000:2.0:1772306052.164388:0:48470:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d52dc14a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2216:x1858396225432256:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 65us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306052.164396:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1311 00000100:00100000:2.0:1772306052.164407:0:48470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1309 00000100:00100000:0.0:1772306052.164408:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bf4fc678 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2216:x1858396225432192:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1772306052.164417:0:6308:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000077c62deb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2216:x1858396225432064:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 52us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306052.164427:0:6308:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1310 00000100:00100000:0.0:1772306052.164437:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bf4fc678 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2216:x1858396225432192:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 34us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306052.164443:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1311 00000040:00080000:0.0:1772306052.488811:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772306052.488818:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772306052.489191:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:0.0:1772306052.489199:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:1.0:1772306052.808729:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1772306052.940471:0:76543:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772306052.940476:0:76543:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772306052.940895:0:76543:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:3.0:1772306052.940904:0:76543:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:0.0:1772306053.512798:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772306053.512807:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772306053.513503:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:0.0:1772306053.513561:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772306053.832844:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1772306054.324959:0:76594:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772306054.324964:0:76594:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772306054.325537:0:76594:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:3.0:1772306054.325546:0:76594:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:0.0:1772306054.536861:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772306054.536873:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772306054.537350:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:0.0:1772306054.537358:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:2.0:1772306054.600853:0:2994:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1772306054.600862:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008f3ff7b7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216622528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1772306054.600879:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000fd7c6d4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216622592:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1772306054.600968:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772306054.601029:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772306054.601103:0:6309:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216622592 00000100:00100000:0.0:1772306054.601106:0:55611:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216622528 00000100:00100000:2.0:1772306054.601158:0:6309:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 507 00000100:00100000:2.0:1772306054.601165:0:6309:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001b48db0d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216622592:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1772306054.601187:0:55611:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 508 00000100:00100000:0.0:1772306054.601195:0:55611:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003dc81c52 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216622528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1772306054.601205:0:6309:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 742981632 pending 0 free 3828350976 avail 3826253824 00002000:00000024:0.0:1772306054.601239:0:55611:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 695140352 pending 0 free 3606052864 avail 3603955712 00000100:00100000:2.0:1772306054.601272:0:6309:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001b48db0d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216622592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306054.601285:0:6309:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 507 00000100:00100000:0.0:1772306054.601316:0:55611:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003dc81c52 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216622528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306054.601324:0:55611:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 508 00000100:00100000:0.0:1772306054.601399:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008f3ff7b7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216622528:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1772306054.601420:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000fd7c6d4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216622592:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1772306054.856818:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772306055.112908:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000095455a54 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216622848:0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772306055.112919:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005df41499 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2991:1858396216622720:0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772306055.113014:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772306055.113020:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000046e97166 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:70aae467-c860-409f-ba1b-742f4d042da6:2994:1858396216622656:0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772306055.113021:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772306055.113074:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085b92210 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2991:1858396216622976:0@lo:400:kworker/u8:4.0 00000100:00100000:0.0:1772306055.113076:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fa281c23 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2992:1858396216622784:0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772306055.113093:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772306055.113106:0:48470:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216622848 00000100:00100000:3.0:1772306055.113135:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772306055.113138:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f95d20e7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216622912:0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772306055.113186:0:48470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1312 00000100:00100000:2.0:1772306055.113198:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772306055.113198:0:48470:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d8f6a4e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216622848:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:0.0:1772306055.113287:0:6308:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216622912 00000100:00100000:3.0:1772306055.113315:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772306055.113320:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216622656 00000100:00100000:1.0:1772306055.113331:0:48470:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d8f6a4e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216622848:12345-0@lo:400:kworker/u8:4.0 Request processed in 133us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306055.113342:0:6308:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1313 00000100:00100000:0.0:1772306055.113354:0:6308:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007d0501e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216622912:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772306055.113358:0:48470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1312 00000100:00100000:2.0:1772306055.113394:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1772306055.113406:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001f908314 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2994:x1858396216622656:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772306055.113410:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216622720 00000100:00100000:0.0:1772306055.113413:0:6308:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007d0501e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216622912:12345-0@lo:400:kworker/u8:4.0 Request processed in 62us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306055.113420:0:6308:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1313 00000100:00100000:1.0:1772306055.113455:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216622976 00000100:00100000:2.0:1772306055.113466:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001f908314 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2994:x1858396216622656:12345-0@lo:400:kworker/u8:4.0 Request processed in 57us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306055.113471:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f95d20e7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216622912:0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772306055.113476:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216622784 00000100:00100000:0.0:1772306055.113519:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000046e97166 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:70aae467-c860-409f-ba1b-742f4d042da6:2994:1858396216622656:0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772306055.113520:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1772306055.113549:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ebc3b500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:2991:x1858396216622720:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772306055.113567:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1772306055.113602:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1772306055.113606:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ebc3b500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:2991:x1858396216622720:12345-0@lo:400:kworker/u8:4.0 Request processed in 75us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306055.113617:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1772306055.113659:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1772306055.113665:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ecb2dceb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:2992:x1858396216622784:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772306055.113703:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005b0c5d35 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:2991:x1858396216622976:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772306055.113710:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ecb2dceb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:2992:x1858396216622784:12345-0@lo:400:kworker/u8:4.0 Request processed in 45us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306055.113712:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000095455a54 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216622848:0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772306055.113726:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1772306055.113784:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005b0c5d35 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:2991:x1858396216622976:12345-0@lo:400:kworker/u8:4.0 Request processed in 162us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306055.113797:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1772306055.113808:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085b92210 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2991:1858396216622976:0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772306055.113834:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005df41499 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2991:1858396216622720:0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772306055.113876:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fa281c23 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2992:1858396216622784:0@lo:400:kworker/u8:4.0 00000040:00080000:0.0:1772306055.560823:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772306055.560833:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772306055.561432:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:0.0:1772306055.561444:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:3.0:1772306055.679958:0:76646:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772306055.679963:0:76646:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772306055.680323:0:76646:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:3.0:1772306055.680330:0:76646:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:2.0:1772306055.880868:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1772306056.584829:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772306056.584838:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772306056.585212:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:0.0:1772306056.585218:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:1.0:1772306056.904749:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1772306056.988004:0:76697:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306056.988010:0:76697:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306056.988382:0:76697:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306056.988387:0:76697:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:0.0:1772306057.284056:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772306057.284103:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772306057.284116:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225432320 00000100:00100000:0.0:1772306057.284129:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306057.284152:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225432384 00000100:00100000:0.0:1772306057.284157:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772306057.284167:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 198 00000100:00100000:2.0:1772306057.284175:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a974db7c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2215:x1858396225432320:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1772306057.284193:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306057.284199:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 283 00000100:00100000:3.0:1772306057.284210:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000046e97166 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2216:x1858396225432384:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1772306057.284231:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225432448 00000100:00100000:0.0:1772306057.284243:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772306057.284245:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a974db7c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2215:x1858396225432320:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 69us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306057.284253:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000046e97166 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2216:x1858396225432384:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 42us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306057.284261:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 198 00000100:00100000:3.0:1772306057.284268:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 283 00000100:00100000:3.0:1772306057.284289:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225432576 00000100:00100000:1.0:1772306057.284310:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225432512 00000100:00100000:3.0:1772306057.284318:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 284 00000100:00100000:3.0:1772306057.284324:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000029164250 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2215:x1858396225432576:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1772306057.284341:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306057.284360:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000029164250 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2215:x1858396225432576:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 31us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306057.284362:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225432640 00000100:00100000:3.0:1772306057.284368:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 284 00000100:00100000:2.0:1772306057.284373:0:6308:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225432704 00000100:00100000:1.0:1772306057.284419:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1314 00000100:00100000:2.0:1772306057.284444:0:6308:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1315 00000100:00100000:1.0:1772306057.284444:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f95d20e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2215:x1858396225432448:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1772306057.284457:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1316 00000100:00100000:2.0:1772306057.284458:0:6308:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a43237bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2216:x1858396225432512:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1772306057.284470:0:18149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1317 00000100:00100000:3.0:1772306057.284471:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006392f955 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2216:x1858396225432640:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1772306057.284479:0:18149:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fe03945a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2215:x1858396225432704:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1772306057.284516:0:6308:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a43237bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2216:x1858396225432512:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 62us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306057.284522:0:6308:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1315 00000100:00100000:1.0:1772306057.284555:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f95d20e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2215:x1858396225432448:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 108us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306057.284555:0:18149:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fe03945a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2215:x1858396225432704:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 62us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306057.284579:0:18149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1317 00000100:00100000:1.0:1772306057.284588:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1314 00000100:00100000:3.0:1772306057.284624:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006392f955 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2216:x1858396225432640:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 145us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306057.284722:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1316 00000040:00080000:0.0:1772306057.608820:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772306057.608828:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772306057.609417:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:0.0:1772306057.609426:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772306057.928817:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1772306058.372985:0:76749:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306058.372991:0:76749:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306058.373437:0:76749:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306058.373443:0:76749:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:0.0:1772306058.632827:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772306058.632855:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772306058.633597:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:0.0:1772306058.633608:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:1.0:1772306058.952890:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1772306059.656836:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306059.656843:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306059.657205:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306059.657211:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:0.0:1772306059.710461:0:76800:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772306059.710483:0:76800:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772306059.711045:0:76800:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:0.0:1772306059.711055:0:76800:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:3.0:1772306059.720803:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000036f569f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216623040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1772306059.720868:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306059.720940:0:6310:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216623040 00000100:00100000:0.0:1772306059.721012:0:6310:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 509 00000100:00100000:0.0:1772306059.721024:0:6310:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d538581f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216623040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1772306059.721076:0:6310:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 695140352 pending 0 free 3606052864 avail 3603955712 00000100:00100000:0.0:1772306059.721177:0:6310:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d538581f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216623040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 151us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306059.721188:0:6310:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 509 00000100:00100000:3.0:1772306059.721221:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000036f569f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216623040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1772306059.721750:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f50ff6e2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216623104:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1772306059.721787:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772306059.721847:0:6310:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216623104 00000100:00100000:3.0:1772306059.721900:0:6310:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 510 00000100:00100000:3.0:1772306059.721906:0:6310:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000037f02e11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216623104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1772306059.721945:0:6310:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 742981632 pending 0 free 3828350976 avail 3826253824 00000100:00100000:3.0:1772306059.721993:0:6310:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000037f02e11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216623104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306059.722006:0:6310:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 510 00000100:00100000:3.0:1772306059.722077:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f50ff6e2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216623104:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1772306059.976765:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1772306060.232834:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f50ff6e2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:70aae467-c860-409f-ba1b-742f4d042da6:2994:1858396216623168:0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772306060.232847:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008f3ff7b7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2992:1858396216623296:0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772306060.232885:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008a3f3626 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216623360:0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772306060.232925:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003e43a9e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2991:1858396216623232:0@lo:400:kworker/u8:4.0 00000100:00100000:0.0:1772306060.232941:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772306060.232956:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772306060.232957:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306060.233000:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000022640fb5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216623424:0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772306060.233016:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306060.233046:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772306060.233063:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b7ea6417 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2991:1858396216623488:0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772306060.233070:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216623360 00000100:00100000:2.0:1772306060.233079:0:71804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216623296 00000100:00100000:1.0:1772306060.233108:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306060.233128:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216623232 00000100:00100000:3.0:1772306060.233140:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216623424 00000100:00100000:2.0:1772306060.233158:0:71804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216623488 00000100:00100000:0.0:1772306060.233192:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1772306060.233202:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005ad28dc1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:2992:x1858396216623296:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772306060.233217:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1318 00000100:00100000:2.0:1772306060.233219:0:71804:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1772306060.233227:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1319 00000100:00100000:2.0:1772306060.233234:0:71804:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000004c96b79 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:2991:x1858396216623232:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772306060.233235:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000030acc74c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216623360:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772306060.233236:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000597692b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216623424:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:0.0:1772306060.233264:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005ad28dc1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:2992:x1858396216623296:12345-0@lo:400:kworker/u8:4.0 Request processed in 59us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306060.233275:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1772306060.233310:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1772306060.233311:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000597692b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216623424:12345-0@lo:400:kworker/u8:4.0 Request processed in 77us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306060.233328:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1319 00000100:00100000:0.0:1772306060.233329:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004d8ea70d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:2991:x1858396216623488:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772306060.233357:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000030acc74c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216623360:12345-0@lo:400:kworker/u8:4.0 Request processed in 126us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306060.233364:0:71804:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000004c96b79 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:2991:x1858396216623232:12345-0@lo:400:kworker/u8:4.0 Request processed in 130us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306060.233373:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1318 00000100:00100000:2.0:1772306060.233380:0:71804:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1772306060.233396:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003e43a9e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2991:1858396216623232:0@lo:400:kworker/u8:4.0 00000100:00100000:0.0:1772306060.233408:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004d8ea70d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:2991:x1858396216623488:12345-0@lo:400:kworker/u8:4.0 Request processed in 82us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306060.233422:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1772306060.233436:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b7ea6417 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2991:1858396216623488:0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772306060.233483:0:54689:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216623168 00000100:00100000:3.0:1772306060.233498:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008a3f3626 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216623360:0@lo:400:kworker/u8:4.0 00000100:00100000:0.0:1772306060.233542:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000022640fb5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216623424:0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772306060.233553:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008f3ff7b7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2992:1858396216623296:0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772306060.233560:0:54689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1772306060.233576:0:54689:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d998c0bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70aae467-c860-409f-ba1b-742f4d042da6+18:2994:x1858396216623168:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772306060.233684:0:54689:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d998c0bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70aae467-c860-409f-ba1b-742f4d042da6+18:2994:x1858396216623168:12345-0@lo:400:kworker/u8:4.0 Request processed in 112us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306060.233691:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f50ff6e2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:70aae467-c860-409f-ba1b-742f4d042da6:2994:1858396216623168:0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772306060.233697:0:54689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000040:00080000:1.0:1772306060.680902:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306060.680911:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306060.681494:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306060.681503:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:1.0:1772306060.998393:0:76851:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306060.998397:0:76851:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306060.998810:0:76851:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306060.998817:0:76851:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772306061.001748:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1772306061.704780:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306061.704787:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306061.705318:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306061.705326:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772306062.024821:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1772306062.286250:0:76903:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306062.286257:0:76903:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306062.286698:0:76903:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306062.286705:0:76903:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:3.0:1772306062.403830:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306062.403893:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306062.403936:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306062.403966:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306062.404013:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772306062.404020:0:54689:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225432768 00000100:00100000:2.0:1772306062.404022:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225432832 00000100:00100000:1.0:1772306062.404029:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225432960 00000100:00100000:3.0:1772306062.404039:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772306062.404075:0:54689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 200 00000100:00100000:1.0:1772306062.404077:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225432896 00000100:00100000:3.0:1772306062.404078:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772306062.404085:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225433024 00000100:00100000:0.0:1772306062.404086:0:54689:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a60d6f48 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2218:x1858396225432768:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1772306062.404102:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225433088 00000100:00100000:3.0:1772306062.404106:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225433152 00000100:00100000:2.0:1772306062.404119:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 288 00000100:00100000:2.0:1772306062.404125:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008a3f3626 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2217:x1858396225432832:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1772306062.404136:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1320 00000100:00100000:3.0:1772306062.404142:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1321 00000100:00100000:1.0:1772306062.404144:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f50ff6e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2217:x1858396225432960:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1772306062.404147:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008f3ff7b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2218:x1858396225432896:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1772306062.404155:0:54689:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a60d6f48 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2218:x1858396225432768:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 69us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306062.404163:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008a3f3626 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2217:x1858396225432832:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 36us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306062.404169:0:54689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 200 00000100:00100000:2.0:1772306062.404174:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 288 00000100:00100000:1.0:1772306062.404184:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f50ff6e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2217:x1858396225432960:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 39us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306062.404186:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008f3ff7b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2218:x1858396225432896:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 38us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306062.404198:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1321 00000100:00100000:2.0:1772306062.404199:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 289 00000100:00100000:2.0:1772306062.404208:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b7ea6417 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2218:x1858396225433024:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1772306062.404208:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1320 00000100:00100000:0.0:1772306062.404222:0:48463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1322 00000100:00100000:3.0:1772306062.404230:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1323 00000100:00100000:0.0:1772306062.404231:0:48463:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000022640fb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2217:x1858396225433088:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1772306062.404238:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b7ea6417 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2218:x1858396225433024:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 29us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306062.404242:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003e43a9e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2218:x1858396225433152:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1772306062.404251:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 289 00000100:00100000:0.0:1772306062.404267:0:48463:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000022640fb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2217:x1858396225433088:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 38us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306062.404275:0:48463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1322 00000100:00100000:3.0:1772306062.404284:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003e43a9e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2218:x1858396225433152:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 44us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306062.404293:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1323 00000040:00080000:1.0:1772306062.728838:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306062.728846:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306062.729384:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306062.729391:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:1.0:1772306063.048793:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1772306063.681169:0:76954:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772306063.681175:0:76954:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772306063.681694:0:76954:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:3.0:1772306063.681704:0:76954:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:1.0:1772306063.752727:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306063.752733:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306063.753146:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306063.753153:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:2.0:1772306064.072777:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1772306064.776851:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772306064.776858:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772306064.777547:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:0.0:1772306064.777556:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:1.0:1772306064.840805:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e2fd14bd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216623552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1772306064.840852:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b830b726 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216623616:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1772306064.840888:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772306064.840927:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772306064.840993:0:6310:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216623552 00000100:00100000:1.0:1772306064.841048:0:55611:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216623616 00000100:00100000:2.0:1772306064.841060:0:6310:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 511 00000100:00100000:2.0:1772306064.841066:0:6310:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000091b2c0c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216623552:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1772306064.841093:0:55611:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 512 00000100:00100000:1.0:1772306064.841101:0:55611:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001460fd38 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216623616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1772306064.841135:0:55611:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 695140352 pending 0 free 3606052864 avail 3603955712 00002000:00000024:3.0:1772306064.841154:0:6310:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 742981632 pending 0 free 3828350976 avail 3826253824 00000100:00100000:1.0:1772306064.841194:0:55611:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001460fd38 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216623616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306064.841204:0:55611:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 512 00000100:00100000:2.0:1772306064.841258:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b830b726 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216623616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1772306064.841376:0:6310:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000091b2c0c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216623552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 308us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306064.841383:0:6310:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 511 00000100:00100000:2.0:1772306064.841405:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e2fd14bd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216623552:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1772306064.997668:0:77005:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306064.997675:0:77005:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306064.998154:0:77005:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306064.998163:0:77005:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772306065.096782:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772306065.352876:0:2993:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1772306065.352901:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000036f569f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2991:1858396216623744:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306065.352906:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005df41499 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216623872:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306065.352923:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085b92210 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216623936:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772306065.352937:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fa281c23 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2992:1858396216623808:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306065.353015:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772306065.353020:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772306065.353071:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000004563a97 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:70aae467-c860-409f-ba1b-742f4d042da6:2993:1858396216623680:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306065.353081:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000095455a54 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2991:1858396216624000:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306065.353081:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306065.353093:0:18149:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216623872 00000100:00100000:1.0:1772306065.353112:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772306065.353136:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306065.353170:0:18149:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216623936 00000100:00100000:1.0:1772306065.353210:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216623680 00000100:00100000:3.0:1772306065.353226:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216623744 00000100:00100000:0.0:1772306065.353227:0:18149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1324 00000100:00100000:2.0:1772306065.353242:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1325 00000100:00100000:0.0:1772306065.353243:0:18149:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000700bb73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216623872:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306065.353257:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b830b726 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216623936:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306065.353289:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216624000 00000100:00100000:1.0:1772306065.353292:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1772306065.353304:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002745ebe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2993:x1858396216623680:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772306065.353332:0:18149:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000700bb73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216623872:12345-0@lo:400:kworker/u8:1.0 Request processed in 95us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306065.353339:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b830b726 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216623936:12345-0@lo:400:kworker/u8:1.0 Request processed in 83us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306065.353347:0:18149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1324 00000100:00100000:3.0:1772306065.353348:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1772306065.353356:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1325 00000100:00100000:3.0:1772306065.353361:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006396c411 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:2991:x1858396216623744:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306065.353366:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002745ebe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2993:x1858396216623680:12345-0@lo:400:kworker/u8:1.0 Request processed in 62us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306065.353375:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1772306065.353409:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1772306065.353419:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000de99bf0b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:2991:x1858396216624000:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306065.353456:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306065.353477:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005df41499 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216623872:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306065.353492:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006396c411 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:2991:x1858396216623744:12345-0@lo:400:kworker/u8:1.0 Request processed in 128us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306065.353509:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1772306065.353517:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000de99bf0b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:2991:x1858396216624000:12345-0@lo:400:kworker/u8:1.0 Request processed in 89us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306065.353521:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000004563a97 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:70aae467-c860-409f-ba1b-742f4d042da6:2993:1858396216623680:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306065.353529:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1772306065.353546:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216623808 00000100:00100000:2.0:1772306065.353595:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1772306065.353605:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e2fd14bd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:2992:x1858396216623808:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306065.353709:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000095455a54 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2991:1858396216624000:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306065.353709:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e2fd14bd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:2992:x1858396216623808:12345-0@lo:400:kworker/u8:1.0 Request processed in 102us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306065.353730:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1772306065.353735:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fa281c23 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2992:1858396216623808:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306065.353754:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000036f569f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2991:1858396216623744:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306065.353791:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085b92210 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216623936:0@lo:400:kworker/u8:1.0 00000040:00080000:0.0:1772306065.800876:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772306065.800882:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772306065.801252:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:0.0:1772306065.801259:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772306066.120784:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1772306066.328730:0:77056:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772306066.328738:0:77056:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772306066.329608:0:77056:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:0.0:1772306066.329619:0:77056:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:0.0:1772306066.824793:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772306066.824800:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772306066.825188:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:0.0:1772306066.825207:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:1.0:1772306067.144925:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1772306067.523841:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306067.523884:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306067.523922:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772306067.523922:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225433280 00000100:00100000:0.0:1772306067.523948:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225433216 00000100:00100000:3.0:1772306067.523954:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306067.523982:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772306067.524039:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 293 00000100:00100000:3.0:1772306067.524040:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772306067.524040:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 202 00000100:00100000:1.0:1772306067.524078:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000afa5cf5e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2218:x1858396225433280:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1772306067.524078:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000051027bea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2217:x1858396225433216:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1772306067.524083:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306067.524115:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225433408 00000100:00100000:3.0:1772306067.524159:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225433344 00000100:00100000:0.0:1772306067.524168:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000051027bea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2217:x1858396225433216:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 114us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306067.524176:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000afa5cf5e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2218:x1858396225433280:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 120us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306067.524182:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 202 00000100:00100000:3.0:1772306067.524183:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225433536 00000100:00100000:1.0:1772306067.524199:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 293 00000100:00100000:3.0:1772306067.524217:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225433600 00000100:00100000:1.0:1772306067.524252:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225433472 00000100:00100000:0.0:1772306067.524262:0:48470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1326 00000100:00100000:3.0:1772306067.524278:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1327 00000100:00100000:0.0:1772306067.524278:0:48470:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e9981b7b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2218:x1858396225433408:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1772306067.524293:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 294 00000100:00100000:3.0:1772306067.524301:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f5cccb82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2217:x1858396225433344:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1772306067.524336:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000470e7e85 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2217:x1858396225433472:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1772306067.524336:0:48470:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e9981b7b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2218:x1858396225433408:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 54us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306067.524357:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f5cccb82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2217:x1858396225433344:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 64us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306067.524364:0:48470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1326 00000100:00100000:3.0:1772306067.524371:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1327 00000100:00100000:0.0:1772306067.524387:0:48470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1328 00000100:00100000:0.0:1772306067.524397:0:48470:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ed1d7a7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2218:x1858396225433536:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1772306067.524409:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000470e7e85 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2217:x1858396225433472:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 70us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306067.524410:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1329 00000100:00100000:3.0:1772306067.524449:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000053f40a87 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2217:x1858396225433600:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1772306067.524463:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 294 00000100:00100000:0.0:1772306067.524471:0:48470:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ed1d7a7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2218:x1858396225433536:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 73us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306067.524489:0:48470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1328 00000100:00100000:3.0:1772306067.524494:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000053f40a87 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2217:x1858396225433600:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 43us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306067.524501:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1329 00000040:00080000:2.0:1772306067.634700:0:77107:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306067.634708:0:77107:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306067.635138:0:77107:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306067.635146:0:77107:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:0.0:1772306067.848860:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772306067.848877:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772306067.849353:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:0.0:1772306067.849363:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:2.0:1772306068.168773:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1772306068.872767:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772306068.872774:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772306068.873277:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:0.0:1772306068.873286:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:1.0:1772306068.974452:0:77158:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306068.974458:0:77158:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306068.974905:0:77158:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306068.974915:0:77158:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772306069.192878:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1772306069.896904:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772306069.896914:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772306069.897764:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:0.0:1772306069.897783:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:3.0:1772306069.960946:0:2991:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1772306069.960985:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000004563a97 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216624064:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1772306069.961021:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000af22ffe1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216624128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1772306069.961096:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772306069.961173:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772306069.961221:0:6310:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216624064 00000100:00100000:2.0:1772306069.961311:0:6309:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216624128 00000100:00100000:1.0:1772306069.961356:0:6310:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 513 00000100:00100000:1.0:1772306069.961374:0:6310:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000035b59d41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216624064:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1772306069.961436:0:6309:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 514 00000100:00100000:2.0:1772306069.961451:0:6309:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000890ea8c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216624128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1772306069.961484:0:6310:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 742981632 pending 0 free 3828350976 avail 3826253824 00002000:00000024:2.0:1772306069.961518:0:6309:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 695140352 pending 0 free 3606052864 avail 3603955712 00000100:00100000:1.0:1772306069.961715:0:6310:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000035b59d41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216624064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 253us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306069.961734:0:6310:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 513 00000100:00100000:2.0:1772306069.961748:0:6309:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000890ea8c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216624128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 289us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306069.961779:0:6309:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 514 00000100:00100000:0.0:1772306069.961900:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000004563a97 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216624064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1772306069.961954:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000af22ffe1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216624128:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1772306070.217745:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1772306070.405288:0:77210:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306070.405296:0:77210:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306070.406129:0:77210:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306070.406144:0:77210:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:2.0:1772306070.472785:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000fd7c6d4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:70aae467-c860-409f-ba1b-742f4d042da6:2994:1858396216624192:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772306070.472806:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009692b1d6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2991:1858396216624256:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306070.472813:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002e5d5c7c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216624384:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306070.472826:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000002171660 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2992:1858396216624320:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306070.472858:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306070.472872:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772306070.472873:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772306070.472885:0:54689:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216624192 00000100:00100000:2.0:1772306070.472893:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000184f2b0a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216624448:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772306070.472918:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004486c7f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2991:1858396216624512:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306070.472929:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772306070.472935:0:54689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1772306070.472943:0:54689:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dd074cb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70aae467-c860-409f-ba1b-742f4d042da6+18:2994:x1858396216624192:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772306070.472950:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772306070.472951:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216624384 00000100:00100000:3.0:1772306070.472994:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216624448 00000100:00100000:2.0:1772306070.472999:0:6308:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1330 00000100:00100000:0.0:1772306070.473001:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216624256 00000100:00100000:1.0:1772306070.473006:0:54689:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dd074cb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70aae467-c860-409f-ba1b-742f4d042da6+18:2994:x1858396216624192:12345-0@lo:400:kworker/u8:1.0 Request processed in 62us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306070.473010:0:6308:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000008d2aeef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216624384:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306070.473020:0:54689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1772306070.473024:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1331 00000100:00100000:3.0:1772306070.473031:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000af22ffe1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216624448:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772306070.473040:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216624512 00000100:00100000:2.0:1772306070.473064:0:6308:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000008d2aeef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216624384:12345-0@lo:400:kworker/u8:1.0 Request processed in 56us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306070.473072:0:6308:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1330 00000100:00100000:0.0:1772306070.473075:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1772306070.473081:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000af22ffe1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216624448:12345-0@lo:400:kworker/u8:1.0 Request processed in 49us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306070.473086:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1772306070.473086:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000004563a97 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:2991:x1858396216624256:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306070.473095:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005df41499 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:2991:x1858396216624512:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306070.473101:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1331 00000100:00100000:2.0:1772306070.473140:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002e5d5c7c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216624384:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772306070.473158:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000004563a97 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:2991:x1858396216624256:12345-0@lo:400:kworker/u8:1.0 Request processed in 74us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306070.473163:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005df41499 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:2991:x1858396216624512:12345-0@lo:400:kworker/u8:1.0 Request processed in 65us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306070.473168:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000184f2b0a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216624448:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772306070.473173:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1772306070.473181:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1772306070.473190:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000fd7c6d4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:70aae467-c860-409f-ba1b-742f4d042da6:2994:1858396216624192:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306070.473216:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306070.473219:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004486c7f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2991:1858396216624512:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772306070.473240:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009692b1d6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2991:1858396216624256:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306070.473269:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216624320 00000100:00100000:2.0:1772306070.473298:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1772306070.473301:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000039584847 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:2992:x1858396216624320:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306070.473334:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000039584847 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:2992:x1858396216624320:12345-0@lo:400:kworker/u8:1.0 Request processed in 32us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306070.473339:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1772306070.473364:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000002171660 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2992:1858396216624320:0@lo:400:kworker/u8:1.0 00000040:00080000:0.0:1772306070.920831:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772306070.920840:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772306070.921380:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:0.0:1772306070.921407:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:1.0:1772306071.240805:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1772306071.763974:0:77261:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772306071.763980:0:77261:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772306071.764451:0:77261:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:0.0:1772306071.764461:0:77261:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:0.0:1772306071.944880:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772306071.944886:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772306071.945489:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:0.0:1772306071.945498:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:2.0:1772306072.264770:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1772306072.644519:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772306072.644576:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772306072.644669:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306072.644686:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225433664 00000100:00100000:1.0:1772306072.644702:0:48463:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225433792 00000100:00100000:0.0:1772306072.644707:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772306072.644738:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772306072.644789:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772306072.644804:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225433920 00000100:00100000:1.0:1772306072.644853:0:48463:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225434048 00000100:00100000:3.0:1772306072.644864:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 204 00000100:00100000:0.0:1772306072.644871:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306072.644884:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000690faca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2218:x1858396225433664:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1772306072.644885:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225433728 00000100:00100000:1.0:1772306072.644933:0:48463:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225433856 00000100:00100000:2.0:1772306072.644952:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 298 00000100:00100000:0.0:1772306072.644969:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 299 00000100:00100000:2.0:1772306072.644972:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000036f569f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2218:x1858396225433920:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:0.0:1772306072.644985:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fa281c23 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2218:x1858396225433728:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1772306072.645003:0:48463:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225433984 00000100:00100000:3.0:1772306072.645004:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000690faca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2218:x1858396225433664:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 123us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306072.645019:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 204 00000100:00100000:2.0:1772306072.645052:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000036f569f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2218:x1858396225433920:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 86us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306072.645069:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fa281c23 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2218:x1858396225433728:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 77us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306072.645070:0:48463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1332 00000100:00100000:2.0:1772306072.645081:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 298 00000100:00100000:1.0:1772306072.645090:0:48463:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000085b92210 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2218:x1858396225433792:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:0.0:1772306072.645106:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 299 00000100:00100000:3.0:1772306072.645109:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1333 00000100:00100000:3.0:1772306072.645127:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000095455a54 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2218:x1858396225434048:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:0.0:1772306072.645168:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1334 00000100:00100000:2.0:1772306072.645195:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1335 00000100:00100000:0.0:1772306072.645196:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000556f98b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2218:x1858396225433856:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1772306072.645197:0:48463:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000085b92210 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2218:x1858396225433792:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 93us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306072.645217:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000095455a54 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2218:x1858396225434048:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 80us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306072.645221:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009811a663 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2218:x1858396225433984:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1772306072.645244:0:48463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1332 00000100:00100000:0.0:1772306072.645257:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000556f98b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2218:x1858396225433856:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 73us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306072.645271:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1333 00000100:00100000:0.0:1772306072.645285:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1334 00000100:00100000:2.0:1772306072.645310:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009811a663 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2218:x1858396225433984:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 92us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306072.645330:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1335 00000040:00080000:0.0:1772306072.968764:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772306072.968769:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772306072.969303:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:0.0:1772306072.969314:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:0.0:1772306073.126494:0:77312:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772306073.126501:0:77312:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772306073.127006:0:77312:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:0.0:1772306073.127015:0:77312:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772306073.288911:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1772306073.992834:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772306073.992843:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772306073.993603:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:0.0:1772306073.993614:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772306074.312818:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1772306074.548945:0:77363:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772306074.548954:0:77363:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772306074.550129:0:77363:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:3.0:1772306074.550144:0:77363:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:0.0:1772306075.016837:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772306075.016845:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772306075.017310:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:0.0:1772306075.017320:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:1.0:1772306075.080845:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000eb97fd71 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216624576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1772306075.080893:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000039c4cb43 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216624640:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1772306075.080912:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772306075.080944:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772306075.080974:0:7591:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216624576 00000100:00100000:1.0:1772306075.081017:0:7591:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216624640 00000100:00100000:2.0:1772306075.081023:0:6309:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 515 00000100:00100000:2.0:1772306075.081031:0:6309:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000002171660 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216624576:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1772306075.081047:0:7591:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 516 00000100:00100000:1.0:1772306075.081052:0:7591:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000d7fa04a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216624640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1772306075.081065:0:6309:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 742981632 pending 0 free 3828350976 avail 3826253824 00002000:00000024:1.0:1772306075.081072:0:7591:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 695140352 pending 0 free 3606052864 avail 3603955712 00000100:00100000:2.0:1772306075.081133:0:6309:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000002171660 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216624576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306075.081138:0:7591:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000d7fa04a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216624640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306075.081144:0:6309:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 515 00000100:00100000:1.0:1772306075.081150:0:7591:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 516 00000100:00100000:1.0:1772306075.081210:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000eb97fd71 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216624576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1772306075.081326:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000039c4cb43 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216624640:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1772306075.336873:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772306075.592964:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000804c4ec1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2991:1858396216624768:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772306075.592972:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cb5c186d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2992:1858396216624832:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306075.592995:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aeb0f39b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216624896:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306075.592996:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000018f22afe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:70aae467-c860-409f-ba1b-742f4d042da6:2994:1858396216624704:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306075.593099:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772306075.593109:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772306075.593125:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772306075.593171:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009965df7c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216624960:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772306075.593174:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216624768 00000100:00100000:1.0:1772306075.593189:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a584233c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2991:1858396216625024:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306075.593238:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772306075.593252:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306075.593257:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1772306075.593263:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216624896 00000100:00100000:0.0:1772306075.593271:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006d6f2aba pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:2991:x1858396216624768:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306075.593322:0:54689:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216624704 00000100:00100000:1.0:1772306075.593335:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772306075.593353:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216624960 00000100:00100000:0.0:1772306075.593415:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006d6f2aba pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:2991:x1858396216624768:12345-0@lo:400:kworker/u8:1.0 Request processed in 142us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306075.593439:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1772306075.593440:0:54689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1772306075.593457:0:54689:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ce5f32e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70aae467-c860-409f-ba1b-742f4d042da6+18:2994:x1858396216624704:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306075.593470:0:48470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1336 00000100:00100000:1.0:1772306075.593483:0:48470:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000028a3b7a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216624896:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306075.593492:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1337 00000100:00100000:0.0:1772306075.593497:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216625024 00000100:00100000:3.0:1772306075.593509:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000039c4cb43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216624960:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306075.593524:0:54689:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ce5f32e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70aae467-c860-409f-ba1b-742f4d042da6+18:2994:x1858396216624704:12345-0@lo:400:kworker/u8:1.0 Request processed in 68us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306075.593549:0:54689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1772306075.593558:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216624832 00000100:00100000:1.0:1772306075.593569:0:48470:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000028a3b7a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216624896:12345-0@lo:400:kworker/u8:1.0 Request processed in 85us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306075.593582:0:48470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1336 00000100:00100000:0.0:1772306075.593623:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1772306075.593693:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000039c4cb43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216624960:12345-0@lo:400:kworker/u8:1.0 Request processed in 184us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306075.593703:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1772306075.593704:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009692b1d6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:2991:x1858396216625024:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306075.593724:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004486c7f8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:2992:x1858396216624832:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306075.593745:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1337 00000100:00100000:1.0:1772306075.593755:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000804c4ec1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2991:1858396216624768:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772306075.593790:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009692b1d6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:2991:x1858396216625024:12345-0@lo:400:kworker/u8:1.0 Request processed in 89us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306075.593791:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a584233c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2991:1858396216625024:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306075.593815:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004486c7f8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:2992:x1858396216624832:12345-0@lo:400:kworker/u8:1.0 Request processed in 93us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306075.593817:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1772306075.593842:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1772306075.593872:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aeb0f39b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216624896:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306075.593920:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000018f22afe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:70aae467-c860-409f-ba1b-742f4d042da6:2994:1858396216624704:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306075.593945:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009965df7c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216624960:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306075.593978:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cb5c186d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2992:1858396216624832:0@lo:400:kworker/u8:1.0 00000040:00080000:3.0:1772306075.991410:0:77414:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772306075.991417:0:77414:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772306075.992116:0:77414:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:3.0:1772306075.992126:0:77414:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:2.0:1772306076.040900:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306076.040908:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306076.041618:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306076.041659:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:2.0:1772306076.360786:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1772306077.064789:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306077.064795:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306077.065265:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306077.065295:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:3.0:1772306077.295059:0:77466:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772306077.295065:0:77466:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772306077.295537:0:77466:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:3.0:1772306077.295545:0:77466:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772306077.384748:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1772306077.763858:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772306077.763891:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306077.763912:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225434112 00000100:00100000:2.0:1772306077.763949:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225434240 00000100:00100000:3.0:1772306077.763966:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 206 00000100:00100000:0.0:1772306077.763969:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306077.763976:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009a65e7bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2217:x1858396225434112:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1772306077.763990:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1338 00000100:00100000:2.0:1772306077.763999:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008d45073f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2217:x1858396225434240:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1772306077.764001:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772306077.764025:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225434176 00000100:00100000:3.0:1772306077.764046:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009a65e7bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2217:x1858396225434112:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 68us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306077.764051:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008d45073f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2217:x1858396225434240:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 50us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306077.764062:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225434368 00000100:00100000:0.0:1772306077.764064:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306077.764067:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 206 00000100:00100000:2.0:1772306077.764068:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1338 00000100:00100000:1.0:1772306077.764090:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 303 00000100:00100000:2.0:1772306077.764092:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225434304 00000100:00100000:1.0:1772306077.764097:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cc2949c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2218:x1858396225434176:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1772306077.764126:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1339 00000100:00100000:3.0:1772306077.764133:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000026617907 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2218:x1858396225434304:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1772306077.764139:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cc2949c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2218:x1858396225434176:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 40us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306077.764146:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 303 00000100:00100000:2.0:1772306077.764159:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 304 00000100:00100000:0.0:1772306077.764160:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306077.764165:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000026617907 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2218:x1858396225434304:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 31us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306077.764170:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fbb012e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2217:x1858396225434368:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1772306077.764176:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1339 00000100:00100000:3.0:1772306077.764201:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225434496 00000100:00100000:2.0:1772306077.764205:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fbb012e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2217:x1858396225434368:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 38us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306077.764213:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 304 00000100:00100000:3.0:1772306077.764236:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1340 00000100:00100000:3.0:1772306077.764242:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c60a4162 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2217:x1858396225434496:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1772306077.764270:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c60a4162 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2217:x1858396225434496:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 27us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306077.764282:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1340 00000100:00100000:0.0:1772306077.764283:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306077.764304:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225434432 00000100:00100000:3.0:1772306077.764329:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1341 00000100:00100000:3.0:1772306077.764333:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000027e204b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2218:x1858396225434432:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1772306077.764380:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000027e204b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2218:x1858396225434432:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 46us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306077.764386:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1341 00000040:00080000:2.0:1772306078.088814:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306078.088821:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306078.089556:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306078.089564:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772306078.408835:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1772306078.587575:0:77517:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772306078.587579:0:77517:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772306078.587959:0:77517:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:3.0:1772306078.587965:0:77517:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:2.0:1772306079.112873:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306079.112882:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306079.113511:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306079.113521:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:1.0:1772306079.432906:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1772306079.889932:0:77568:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306079.889939:0:77568:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306079.890351:0:77568:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306079.890360:0:77568:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:2.0:1772306080.136772:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306080.136778:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306080.137205:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306080.137214:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:1.0:1772306080.200808:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000098196c2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216625088:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1772306080.200811:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000023b046ef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216625152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1772306080.200882:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772306080.200936:0:6309:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216625152 00000100:00100000:3.0:1772306080.201020:0:6309:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 517 00000100:00100000:3.0:1772306080.201028:0:6309:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f086b207 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216625152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1772306080.201061:0:6309:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 742981632 pending 0 free 3828350976 avail 3826253824 00000100:00100000:0.0:1772306080.201078:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772306080.201124:0:6309:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f086b207 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216625152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306080.201134:0:6309:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 517 00000100:00100000:3.0:1772306080.201174:0:6309:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216625088 00000100:00100000:3.0:1772306080.201206:0:6309:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 518 00000100:00100000:3.0:1772306080.201211:0:6309:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cb5c186d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216625088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1772306080.201233:0:6309:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 695140352 pending 0 free 3606052864 avail 3603955712 00000100:00100000:2.0:1772306080.201261:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000023b046ef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216625152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1772306080.201276:0:6309:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cb5c186d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216625088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306080.201285:0:6309:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 518 00000100:00100000:0.0:1772306080.201311:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000098196c2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216625088:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1772306080.456786:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1772306080.712808:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c527bff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:70aae467-c860-409f-ba1b-742f4d042da6:2994:1858396216625216:0@lo:400:kworker/u8:4.0 00000100:00100000:0.0:1772306080.712808:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006121cd31 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:2993:1858396216625408:0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772306080.712809:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ccddc55d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2991:1858396216625280:0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772306080.712823:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b250dcf6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2992:1858396216625344:0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772306080.712894:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772306080.712895:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306080.712937:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772306080.712943:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216625280 00000100:00100000:1.0:1772306080.712958:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772306080.712975:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216625216 00000100:00100000:3.0:1772306080.712992:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216625408 00000100:00100000:0.0:1772306080.712993:0:71804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216625344 00000100:00100000:1.0:1772306080.713005:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1772306080.713012:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000184f2b0a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:2991:x1858396216625280:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772306080.713018:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1772306080.713021:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1772306080.713027:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d086db0d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2994:x1858396216625216:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772306080.713030:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009965df7c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:2993:x1858396216625408:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:0.0:1772306080.713035:0:71804:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1772306080.713044:0:71804:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002e5d5c7c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:2992:x1858396216625344:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772306080.713062:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000184f2b0a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:2991:x1858396216625280:12345-0@lo:400:kworker/u8:4.0 Request processed in 49us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306080.713068:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1772306080.713090:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d086db0d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2994:x1858396216625216:12345-0@lo:400:kworker/u8:4.0 Request processed in 63us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306080.713099:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1772306080.713103:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009965df7c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:2993:x1858396216625408:12345-0@lo:400:kworker/u8:4.0 Request processed in 72us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306080.713104:0:71804:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002e5d5c7c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:2992:x1858396216625344:12345-0@lo:400:kworker/u8:4.0 Request processed in 59us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306080.713121:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1772306080.713123:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ccddc55d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2991:1858396216625280:0@lo:400:kworker/u8:4.0 00000100:00100000:0.0:1772306080.713129:0:71804:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1772306080.713150:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c527bff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:70aae467-c860-409f-ba1b-742f4d042da6:2994:1858396216625216:0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772306080.713170:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b250dcf6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2992:1858396216625344:0@lo:400:kworker/u8:4.0 00000100:00100000:0.0:1772306080.713188:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006121cd31 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:2993:1858396216625408:0@lo:400:kworker/u8:4.0 00000040:00080000:2.0:1772306081.161753:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306081.161760:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306081.162142:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306081.162149:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:0.0:1772306081.175566:0:77619:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772306081.175569:0:77619:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772306081.176028:0:77619:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:0.0:1772306081.176035:0:77619:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772306081.480867:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1772306082.184840:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306082.184851:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306082.185562:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306082.185570:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772306082.505809:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1772306082.582215:0:77670:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306082.582225:0:77670:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306082.583104:0:77670:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306082.583119:0:77670:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:2.0:1772306082.884379:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772306082.884467:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772306082.884510:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225434560 00000100:00100000:2.0:1772306082.884512:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772306082.884578:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306082.884586:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225434624 00000100:00100000:0.0:1772306082.884614:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 208 00000100:00100000:0.0:1772306082.884671:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000389a8545 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2218:x1858396225434560:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1772306082.884680:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772306082.884708:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225434688 00000100:00100000:2.0:1772306082.884738:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306082.884757:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225434816 00000100:00100000:0.0:1772306082.884795:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000389a8545 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2218:x1858396225434560:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 165us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306082.884796:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225434752 00000100:00100000:0.0:1772306082.884812:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 208 00000100:00100000:2.0:1772306082.884823:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306082.884830:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 308 00000100:00100000:3.0:1772306082.884840:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000451e9247 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2217:x1858396225434624:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1772306082.884867:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225434944 00000100:00100000:0.0:1772306082.884889:0:71804:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 309 00000100:00100000:0.0:1772306082.884902:0:71804:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000098196c2d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2218:x1858396225434816:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1772306082.884915:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000451e9247 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2217:x1858396225434624:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 71us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306082.884928:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 308 00000100:00100000:1.0:1772306082.884931:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225434880 00000100:00100000:0.0:1772306082.884961:0:71804:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000098196c2d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2218:x1858396225434816:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 57us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306082.884981:0:71804:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 309 00000100:00100000:1.0:1772306082.884997:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1342 00000100:00100000:1.0:1772306082.885010:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000006d21792 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2218:x1858396225434688:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1772306082.885023:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1343 00000100:00100000:3.0:1772306082.885037:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d831f9af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2217:x1858396225434752:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1772306082.885058:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1344 00000100:00100000:0.0:1772306082.885072:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e9e81c30 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2218:x1858396225434944:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1772306082.885089:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000006d21792 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2218:x1858396225434688:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 77us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306082.885101:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d831f9af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2217:x1858396225434752:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 64us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306082.885111:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1342 00000100:00100000:3.0:1772306082.885126:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1343 00000100:00100000:0.0:1772306082.885143:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e9e81c30 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2218:x1858396225434944:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 69us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306082.885174:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1344 00000100:00100000:1.0:1772306082.885185:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1345 00000100:00100000:1.0:1772306082.885200:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fd7b4ff5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2217:x1858396225434880:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1772306082.885256:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fd7b4ff5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2217:x1858396225434880:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 58us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306082.885269:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1345 00000040:00080000:2.0:1772306083.208869:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306083.208879:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306083.209655:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306083.209666:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:1.0:1772306083.528842:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1772306083.962966:0:77722:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306083.962971:0:77722:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306083.963630:0:77722:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306083.963645:0:77722:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:2.0:1772306084.232770:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306084.232777:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306084.233283:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306084.233292:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:2.0:1772306084.552824:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1772306085.257829:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306085.257838:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306085.258709:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306085.258721:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:2.0:1772306085.320870:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009531bf01 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216625472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1772306085.320978:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306085.321063:0:6309:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216625472 00000100:00100000:0.0:1772306085.321171:0:6309:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 519 00000100:00100000:0.0:1772306085.321184:0:6309:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b7808eb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216625472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1772306085.321246:0:6309:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 742981632 pending 0 free 3828350976 avail 3826253824 00000100:00100000:0.0:1772306085.321359:0:6309:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b7808eb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216625472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 177us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306085.321375:0:6309:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 519 00000100:00100000:2.0:1772306085.321436:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009531bf01 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216625472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1772306085.321922:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006f4c803f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216625536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1772306085.321995:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772306085.322089:0:6309:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216625536 00000100:00100000:3.0:1772306085.322144:0:6309:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 520 00000100:00100000:3.0:1772306085.322154:0:6309:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000601911f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216625536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1772306085.322203:0:6309:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 695140352 pending 0 free 3606052864 avail 3603955712 00000100:00100000:3.0:1772306085.322267:0:6309:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000601911f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216625536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306085.322280:0:6309:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 520 00000100:00100000:3.0:1772306085.322390:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006f4c803f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216625536:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1772306085.391410:0:77773:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772306085.391420:0:77773:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772306085.392226:0:77773:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:3.0:1772306085.392240:0:77773:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772306085.576823:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1772306085.832927:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b250dcf6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2991:1858396216625792:0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772306085.832929:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000ad6883e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:2993:1858396216625664:0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772306085.832945:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006121cd31 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:2994:1858396216625728:0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772306085.833037:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306085.833108:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000018743e89 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:70aae467-c860-409f-ba1b-742f4d042da6:2992:1858396216625600:0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772306085.833150:0:71804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216625728 00000100:00100000:1.0:1772306085.833154:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306085.833199:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772306085.833241:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772306085.833243:0:71804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216625664 00000100:00100000:3.0:1772306085.833253:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1772306085.833265:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002982a7a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:2994:x1858396216625728:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772306085.833315:0:71804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216625792 00000100:00100000:0.0:1772306085.833329:0:54689:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216625600 00000100:00100000:1.0:1772306085.833373:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1772306085.833388:0:71804:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1772306085.833388:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000100f06cf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:2993:x1858396216625664:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772306085.833423:0:71804:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000029210a42 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:2991:x1858396216625792:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:0.0:1772306085.833439:0:54689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1772306085.833453:0:54689:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dcbe432d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70aae467-c860-409f-ba1b-742f4d042da6+18:2992:x1858396216625600:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772306085.833523:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000100f06cf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:2993:x1858396216625664:12345-0@lo:400:kworker/u8:4.0 Request processed in 136us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306085.833544:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1772306085.833552:0:71804:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000029210a42 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:2991:x1858396216625792:12345-0@lo:400:kworker/u8:4.0 Request processed in 128us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306085.833573:0:71804:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1772306085.833589:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002982a7a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:2994:x1858396216625728:12345-0@lo:400:kworker/u8:4.0 Request processed in 318us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306085.833601:0:54689:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dcbe432d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70aae467-c860-409f-ba1b-742f4d042da6+18:2992:x1858396216625600:12345-0@lo:400:kworker/u8:4.0 Request processed in 142us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306085.833614:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1772306085.833635:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000ad6883e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:2993:1858396216625664:0@lo:400:kworker/u8:4.0 00000100:00100000:0.0:1772306085.833672:0:54689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1772306085.833733:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006121cd31 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:2994:1858396216625728:0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772306085.833747:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b250dcf6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2991:1858396216625792:0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772306085.833778:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000018743e89 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:70aae467-c860-409f-ba1b-742f4d042da6:2992:1858396216625600:0@lo:400:kworker/u8:4.0 00000040:00080000:2.0:1772306086.280876:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306086.280888:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306086.281608:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306086.281659:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:0.0:1772306086.601976:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1772306086.796806:0:77824:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306086.796811:0:77824:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306086.797456:0:77824:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306086.797466:0:77824:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:2.0:1772306087.304906:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306087.304916:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306087.305781:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306087.305795:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:1.0:1772306087.624857:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1772306088.004310:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772306088.004381:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306088.004427:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225435072 00000100:00100000:2.0:1772306088.004446:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772306088.004492:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225435008 00000100:00100000:2.0:1772306088.004508:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306088.004538:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 313 00000100:00100000:3.0:1772306088.004558:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008e341f60 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2218:x1858396225435072:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:0.0:1772306088.004578:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 210 00000100:00100000:2.0:1772306088.004586:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772306088.004598:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c5abcfd8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2217:x1858396225435008:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:0.0:1772306088.004761:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c5abcfd8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2217:x1858396225435008:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 165us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306088.004772:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772306088.004797:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 210 00000100:00100000:3.0:1772306088.004827:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008e341f60 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2218:x1858396225435072:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 270us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306088.004841:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 313 00000100:00100000:3.0:1772306088.004874:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225435264 00000100:00100000:2.0:1772306088.004903:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306088.004922:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 314 00000100:00100000:0.0:1772306088.004930:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225435136 00000100:00100000:3.0:1772306088.004931:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006f4c803f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2217:x1858396225435264:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1772306088.004974:0:48463:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225435200 00000100:00100000:3.0:1772306088.004975:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006f4c803f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2217:x1858396225435264:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 44us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306088.004987:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 314 00000100:00100000:0.0:1772306088.004997:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225435392 00000100:00100000:2.0:1772306088.005089:0:48463:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225435328 00000100:00100000:3.0:1772306088.005106:0:6308:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1346 00000100:00100000:0.0:1772306088.005123:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1347 00000100:00100000:1.0:1772306088.005148:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1348 00000100:00100000:0.0:1772306088.005148:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d410c5a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2218:x1858396225435200:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1772306088.005167:0:48463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1349 00000100:00100000:1.0:1772306088.005167:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004d649baa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2217:x1858396225435392:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1772306088.005180:0:48463:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009ce1fe1c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2218:x1858396225435328:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:0.0:1772306088.005225:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d410c5a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2218:x1858396225435200:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 88us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306088.005239:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1347 00000100:00100000:2.0:1772306088.005248:0:48463:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009ce1fe1c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2218:x1858396225435328:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 65us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306088.005250:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004d649baa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2217:x1858396225435392:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 85us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306088.005270:0:48463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1349 00000100:00100000:3.0:1772306088.005318:0:6308:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009adfd4b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2217:x1858396225435136:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1772306088.005330:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1348 00000100:00100000:3.0:1772306088.005526:0:6308:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009adfd4b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2217:x1858396225435136:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 280us (958us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306088.005541:0:6308:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1346 00000040:00080000:1.0:1772306088.242934:0:77875:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306088.242940:0:77875:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306088.243679:0:77875:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306088.243691:0:77875:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:2.0:1772306088.328746:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306088.328752:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306088.329330:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306088.329340:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:2.0:1772306088.648798:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1772306089.352794:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306089.352801:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306089.353200:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306089.353207:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:2.0:1772306089.530007:0:77926:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306089.530012:0:77926:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306089.530401:0:77926:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306089.530409:0:77926:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772306089.672792:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1772306090.376771:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306090.376778:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306090.377145:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306090.377152:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:1.0:1772306090.440828:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000911e7fcc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216625856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1772306090.440838:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000018f22afe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216625920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1772306090.440905:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772306090.440947:0:6309:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216625920 00000100:00100000:0.0:1772306090.440977:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772306090.440998:0:6309:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216625856 00000100:00100000:0.0:1772306090.441034:0:7591:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 521 00000100:00100000:0.0:1772306090.441040:0:7591:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000aeb0f39b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216625920:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1772306090.441046:0:6309:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 522 00000100:00100000:1.0:1772306090.441057:0:6309:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a584233c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216625856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1772306090.441075:0:7591:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 695140352 pending 0 free 3606052864 avail 3603955712 00000100:00100000:0.0:1772306090.441116:0:7591:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000aeb0f39b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216625920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306090.441122:0:7591:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 521 00000100:00100000:0.0:1772306090.441168:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000018f22afe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216625920:0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1772306090.441207:0:6309:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 742981632 pending 0 free 3828350976 avail 3826253824 00000100:00100000:0.0:1772306090.441240:0:6309:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a584233c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216625856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 186us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306090.441245:0:6309:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 522 00000100:00100000:2.0:1772306090.441297:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000911e7fcc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216625856:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1772306090.696945:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1772306090.819696:0:77977:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772306090.819701:0:77977:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772306090.820097:0:77977:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:3.0:1772306090.820105:0:77977:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:0.0:1772306090.952845:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000052c29410 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:70aae467-c860-409f-ba1b-742f4d042da6:2994:1858396216625984:0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772306090.952871:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000714df8e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2991:1858396216626048:0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772306090.952874:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aa7d33bd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2992:1858396216626112:0@lo:400:kworker/u8:4.0 00000100:00100000:0.0:1772306090.952915:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772306090.952928:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772306090.952934:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000af42919f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:2993:1858396216626176:0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772306090.952965:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216626048 00000100:00100000:0.0:1772306090.952965:0:54689:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216625984 00000100:00100000:3.0:1772306090.952977:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306090.953009:0:54689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1772306090.953016:0:54689:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007cf34914 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70aae467-c860-409f-ba1b-742f4d042da6+18:2994:x1858396216625984:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772306090.953042:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216626176 00000100:00100000:1.0:1772306090.953052:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1772306090.953061:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000001fee6a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:2991:x1858396216626048:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:0.0:1772306090.953068:0:54689:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007cf34914 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70aae467-c860-409f-ba1b-742f4d042da6+18:2994:x1858396216625984:12345-0@lo:400:kworker/u8:4.0 Request processed in 51us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306090.953076:0:54689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1772306090.953087:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1772306090.953094:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006121cd31 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:2993:x1858396216626176:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772306090.953124:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000001fee6a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:2991:x1858396216626048:12345-0@lo:400:kworker/u8:4.0 Request processed in 63us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306090.953131:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1772306090.953137:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000052c29410 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:70aae467-c860-409f-ba1b-742f4d042da6:2994:1858396216625984:0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772306090.953149:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006121cd31 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:2993:x1858396216626176:12345-0@lo:400:kworker/u8:4.0 Request processed in 53us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306090.953157:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1772306090.953164:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772306090.953175:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000af42919f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:2993:1858396216626176:0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772306090.953212:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000714df8e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2991:1858396216626048:0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772306090.953237:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216626112 00000100:00100000:3.0:1772306090.953282:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1772306090.953288:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003847e69c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:2992:x1858396216626112:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772306090.953368:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003847e69c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:2992:x1858396216626112:12345-0@lo:400:kworker/u8:4.0 Request processed in 81us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306090.953373:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1772306090.953414:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aa7d33bd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2992:1858396216626112:0@lo:400:kworker/u8:4.0 00000040:00080000:2.0:1772306091.400822:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306091.400829:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306091.401212:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306091.401220:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:1.0:1772306091.720814:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1772306092.114233:0:78029:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306092.114238:0:78029:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306092.114613:0:78029:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306092.114621:0:78029:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:2.0:1772306092.424803:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306092.424811:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306092.425216:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306092.425225:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:2.0:1772306092.744759:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772306093.123677:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772306093.123745:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772306093.123760:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225435456 00000100:00100000:1.0:1772306093.123792:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306093.123809:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225435520 00000100:00100000:0.0:1772306093.123826:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 212 00000100:00100000:0.0:1772306093.123836:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000952ce909 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2216:x1858396225435456:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:3.0:1772306093.123860:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 318 00000100:00100000:3.0:1772306093.123867:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000aa7d33bd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2215:x1858396225435520:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1772306093.123892:0:6308:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225435584 00000100:00100000:0.0:1772306093.123915:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000952ce909 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2216:x1858396225435456:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 77us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306093.123916:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000aa7d33bd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2215:x1858396225435520:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 46us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306093.123931:0:6308:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1350 00000100:00100000:0.0:1772306093.123931:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 212 00000100:00100000:3.0:1772306093.123935:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 318 00000100:00100000:1.0:1772306093.123937:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772306093.123941:0:6308:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000714df8e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2216:x1858396225435584:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1772306093.123976:0:6308:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000714df8e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2216:x1858396225435584:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 35us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306093.123982:0:6308:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1350 00000100:00100000:3.0:1772306093.123992:0:48470:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225435648 00000100:00100000:3.0:1772306093.124023:0:48470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1351 00000100:00100000:3.0:1772306093.124028:0:48470:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004ca72e12 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2215:x1858396225435648:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:3.0:1772306093.124056:0:48470:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004ca72e12 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2215:x1858396225435648:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 28us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306093.124062:0:48470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1351 00000100:00100000:0.0:1772306093.124101:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772306093.124132:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772306093.124167:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772306093.124187:0:48470:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225435776 00000100:00100000:2.0:1772306093.124208:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225435840 00000100:00100000:3.0:1772306093.124213:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225435712 00000100:00100000:1.0:1772306093.124222:0:48470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1352 00000100:00100000:1.0:1772306093.124228:0:48470:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000804c4ec1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2215:x1858396225435776:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1772306093.124259:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1353 00000100:00100000:3.0:1772306093.124263:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 319 00000100:00100000:2.0:1772306093.124268:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000eb97fd71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2216:x1858396225435840:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:3.0:1772306093.124273:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000018f22afe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2216:x1858396225435712:12345-192.168.203.30@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1772306093.124279:0:48470:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000804c4ec1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2215:x1858396225435776:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 49us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306093.124285:0:48470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1352 00000100:00100000:2.0:1772306093.124303:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000eb97fd71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2216:x1858396225435840:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 35us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306093.124310:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1353 00000100:00100000:3.0:1772306093.124367:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000018f22afe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2216:x1858396225435712:12345-192.168.203.30@tcp:400:kworker/u8:3.0 Request processed in 95us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306093.124380:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 319 00000040:00080000:0.0:1772306093.389823:0:78080:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772306093.389829:0:78080:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772306093.390257:0:78080:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:0.0:1772306093.390291:0:78080:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:2.0:1772306093.449747:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306093.449752:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306093.450155:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306093.450162:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772306093.768764:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1772306094.472806:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306094.472812:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306094.473275:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306094.473282:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:1.0:1772306094.757043:0:78131:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306094.757048:0:78131:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306094.757543:0:78131:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306094.757550:0:78131:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:0.0:1772306094.792742:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1772306095.496848:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306095.496858:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306095.497274:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306095.497284:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:1.0:1772306095.560883:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004ca53634 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216626304:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1772306095.560978:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772306095.560985:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a0e5d27a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216626240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1772306095.561066:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772306095.561087:0:6309:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216626304 00000100:00100000:3.0:1772306095.561167:0:6310:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216626240 00000100:00100000:1.0:1772306095.561171:0:6309:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 523 00000100:00100000:1.0:1772306095.561181:0:6309:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008066f4bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216626304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1772306095.561245:0:6309:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 742981632 pending 0 free 3828350976 avail 3826253824 00000100:00100000:3.0:1772306095.561250:0:6310:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 524 00000100:00100000:3.0:1772306095.561260:0:6310:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009c527bff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216626240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1772306095.561303:0:6310:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 695140352 pending 0 free 3606052864 avail 3603955712 00000100:00100000:3.0:1772306095.561353:0:6310:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009c527bff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216626240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306095.561360:0:6310:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 524 00000100:00100000:3.0:1772306095.561425:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a0e5d27a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216626240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1772306095.561429:0:6309:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008066f4bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216626304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 241us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306095.561441:0:6309:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 523 00000100:00100000:3.0:1772306095.561495:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004ca53634 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216626304:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1772306095.816922:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772306096.072908:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006049a92e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:70aae467-c860-409f-ba1b-742f4d042da6:2992:1858396216626368:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772306096.072931:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cc7871e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:2993:1858396216626432:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306096.072936:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000957f52ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2991:1858396216626560:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306096.072954:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003fc0ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:2994:1858396216626496:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306096.073022:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772306096.073039:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772306096.073098:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306096.073098:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216626368 00000100:00100000:1.0:1772306096.073195:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216626560 00000100:00100000:0.0:1772306096.073201:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1772306096.073208:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216626496 00000100:00100000:0.0:1772306096.073214:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008147e34f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2992:x1858396216626368:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306096.073270:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772306096.073307:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216626432 00000100:00100000:3.0:1772306096.073320:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1772306096.073333:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ccddc55d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:2991:x1858396216626560:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772306096.073358:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008147e34f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2992:x1858396216626368:12345-0@lo:400:kworker/u8:1.0 Request processed in 139us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306096.073373:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1772306096.073401:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1772306096.073417:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000049a6801b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:2994:x1858396216626496:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306096.073424:0:71804:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1772306096.073447:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ccddc55d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:2991:x1858396216626560:12345-0@lo:400:kworker/u8:1.0 Request processed in 109us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306096.073450:0:71804:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000025278777 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:2993:x1858396216626432:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772306096.073475:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006049a92e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:70aae467-c860-409f-ba1b-742f4d042da6:2992:1858396216626368:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306096.073486:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1772306096.073522:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000049a6801b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:2994:x1858396216626496:12345-0@lo:400:kworker/u8:1.0 Request processed in 104us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306096.073536:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1772306096.073569:0:71804:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000025278777 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:2993:x1858396216626432:12345-0@lo:400:kworker/u8:1.0 Request processed in 123us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306096.073588:0:71804:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1772306096.073615:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000957f52ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2991:1858396216626560:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306096.073704:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cc7871e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:2993:1858396216626432:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306096.073772:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003fc0ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:2994:1858396216626496:0@lo:400:kworker/u8:1.0 00000040:00080000:2.0:1772306096.186485:0:78182:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306096.186495:0:78182:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306096.187146:0:78182:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306096.187156:0:78182:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:2.0:1772306096.520836:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306096.520844:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306096.521287:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306096.521296:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:2.0:1772306096.840857:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1772306097.502286:0:78233:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306097.502291:0:78233:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306097.502689:0:78233:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306097.502698:0:78233:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:2.0:1772306097.544838:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306097.544847:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306097.545462:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306097.545474:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772306097.864866:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772306098.244273:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772306098.244308:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772306098.244328:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772306098.244347:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772306098.244363:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772306098.244412:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306098.244413:0:6308:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225436096 00000100:00100000:1.0:1772306098.244487:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772306098.244492:0:71804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225435968 00000100:00100000:0.0:1772306098.244493:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225435904 00000100:00100000:3.0:1772306098.244520:0:6308:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225436032 00000100:00100000:1.0:1772306098.244548:0:48470:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225436224 00000100:00100000:3.0:1772306098.244625:0:6308:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225436288 00000100:00100000:2.0:1772306098.244759:0:71804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225436160 00000100:00100000:1.0:1772306098.244781:0:48470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1354 00000100:00100000:0.0:1772306098.244782:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 214 00000100:00100000:3.0:1772306098.244824:0:6308:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1355 00000100:00100000:0.0:1772306098.244843:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002ae2fbd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2218:x1858396225435904:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1772306098.244857:0:48470:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004ca53634 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2217:x1858396225436096:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1772306098.244867:0:71804:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 323 00000100:00100000:3.0:1772306098.244869:0:6308:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000af42919f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2218:x1858396225436032:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1772306098.244895:0:71804:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f9492fe6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2217:x1858396225435968:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1772306098.245003:0:48470:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004ca53634 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2217:x1858396225436096:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 191us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306098.245017:0:48470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1354 00000100:00100000:0.0:1772306098.245031:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002ae2fbd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2218:x1858396225435904:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 211us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306098.245033:0:6308:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000af42919f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2218:x1858396225436032:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 187us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306098.245055:0:71804:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f9492fe6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2217:x1858396225435968:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 145us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306098.245098:0:48470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1356 00000100:00100000:0.0:1772306098.245104:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 214 00000100:00100000:2.0:1772306098.245114:0:71804:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 323 00000100:00100000:3.0:1772306098.245125:0:6308:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1355 00000100:00100000:1.0:1772306098.245126:0:48470:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000052c29410 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2217:x1858396225436224:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1772306098.245178:0:71804:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 324 00000100:00100000:2.0:1772306098.245195:0:71804:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000911e7fcc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2218:x1858396225436160:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1772306098.245236:0:6308:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1357 00000100:00100000:1.0:1772306098.245237:0:48470:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000052c29410 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2217:x1858396225436224:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 120us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306098.245255:0:48470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1356 00000100:00100000:3.0:1772306098.245264:0:6308:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009531bf01 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2218:x1858396225436288:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1772306098.245283:0:71804:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000911e7fcc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2218:x1858396225436160:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 87us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306098.245298:0:71804:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 324 00000100:00100000:3.0:1772306098.245361:0:6308:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009531bf01 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2218:x1858396225436288:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 97us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306098.245389:0:6308:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1357 00000040:00080000:1.0:1772306098.569128:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306098.569140:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306098.570179:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306098.570197:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:1.0:1772306098.889826:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1772306098.914981:0:78285:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306098.914991:0:78285:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306098.915789:0:78285:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306098.915806:0:78285:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:1.0:1772306099.592824:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306099.592834:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306099.593592:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306099.593603:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:1.0:1772306099.912760:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1772306100.265526:0:78336:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772306100.265532:0:78336:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772306100.266156:0:78336:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:3.0:1772306100.266168:0:78336:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:1.0:1772306100.616774:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306100.616780:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306100.617306:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306100.617314:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:0.0:1772306100.680943:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a3ed84e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216626688:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1772306100.681089:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306100.681155:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cc7871e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216626624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1772306100.681222:0:55611:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216626688 00000100:00100000:0.0:1772306100.681261:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772306100.681321:0:55611:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216626624 00000100:00100000:0.0:1772306100.681327:0:6309:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 525 00000100:00100000:0.0:1772306100.681340:0:6309:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000339dc28b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216626688:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1772306100.681369:0:55611:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 526 00000100:00100000:2.0:1772306100.681376:0:55611:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c7eaf1a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216626624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1772306100.681387:0:6309:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 742981632 pending 0 free 3828350976 avail 3826253824 00002000:00000024:2.0:1772306100.681402:0:55611:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 695140352 pending 0 free 3606052864 avail 3603955712 00000100:00100000:2.0:1772306100.681481:0:55611:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c7eaf1a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216626624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306100.681495:0:55611:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 526 00000100:00100000:1.0:1772306100.681659:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cc7871e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216626624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1772306100.681752:0:6309:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000339dc28b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216626688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 414us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306100.681762:0:6309:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 525 00000100:00100000:3.0:1772306100.681835:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a3ed84e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216626688:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1772306100.936722:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1772306101.192876:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000276761c7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:70aae467-c860-409f-ba1b-742f4d042da6:2993:1858396216626752:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306101.192914:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007de8ec07 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:2994:1858396216626816:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772306101.192919:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000040ceeec7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:2991:1858396216626880:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306101.192929:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002294ffc2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216626944:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306101.192945:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772306101.192980:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772306101.192985:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772306101.192995:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000282b51c2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216627008:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772306101.193004:0:54689:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216626752 00000100:00100000:3.0:1772306101.193024:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007af842fc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:2994:1858396216627072:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306101.193034:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306101.193051:0:54689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1772306101.193058:0:54689:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b5d26536 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70aae467-c860-409f-ba1b-742f4d042da6+18:2993:x1858396216626752:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306101.193065:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772306101.193068:0:18149:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216626944 00000100:00100000:2.0:1772306101.193091:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216626816 00000100:00100000:1.0:1772306101.193110:0:18149:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216627008 00000100:00100000:0.0:1772306101.193119:0:54689:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b5d26536 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70aae467-c860-409f-ba1b-742f4d042da6+18:2993:x1858396216626752:12345-0@lo:400:kworker/u8:1.0 Request processed in 60us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306101.193126:0:6308:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1358 00000100:00100000:0.0:1772306101.193128:0:54689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1772306101.193129:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216627072 00000100:00100000:3.0:1772306101.193140:0:6308:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000028e6916d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216626944:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306101.193152:0:18149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1359 00000100:00100000:1.0:1772306101.193158:0:18149:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e53cfa76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216627008:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306101.193164:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1772306101.193171:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000023b046ef pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:2994:x1858396216626816:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772306101.193174:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1772306101.193181:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000018743e89 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:2994:x1858396216627072:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306101.193217:0:6308:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000028e6916d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216626944:12345-0@lo:400:kworker/u8:1.0 Request processed in 79us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306101.193221:0:18149:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e53cfa76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216627008:12345-0@lo:400:kworker/u8:1.0 Request processed in 61us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306101.193243:0:6308:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1358 00000100:00100000:2.0:1772306101.193254:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000023b046ef pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:2994:x1858396216626816:12345-0@lo:400:kworker/u8:1.0 Request processed in 82us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306101.193255:0:18149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1359 00000100:00100000:0.0:1772306101.193265:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000018743e89 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:2994:x1858396216627072:12345-0@lo:400:kworker/u8:1.0 Request processed in 81us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306101.193266:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1772306101.193276:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1772306101.193282:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772306101.193308:0:71804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216626880 00000100:00100000:1.0:1772306101.193317:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002294ffc2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216626944:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772306101.193343:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000282b51c2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216627008:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306101.193344:0:71804:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1772306101.193353:0:71804:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b250dcf6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:2991:x1858396216626880:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772306101.193363:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000276761c7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:70aae467-c860-409f-ba1b-742f4d042da6:2993:1858396216626752:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306101.193387:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007de8ec07 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:2994:1858396216626816:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306101.193403:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007af842fc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:2994:1858396216627072:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306101.193407:0:71804:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b250dcf6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:2991:x1858396216626880:12345-0@lo:400:kworker/u8:1.0 Request processed in 53us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306101.193413:0:71804:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1772306101.193431:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000040ceeec7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:2991:1858396216626880:0@lo:400:kworker/u8:1.0 00000040:00080000:2.0:1772306101.601072:0:78387:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306101.601077:0:78387:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306101.601804:0:78387:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306101.601819:0:78387:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:1.0:1772306101.640790:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306101.640796:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306101.641383:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306101.641393:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772306101.960835:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1772306102.664844:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306102.664853:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306102.665596:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306102.665607:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:1.0:1772306102.985746:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1772306103.016190:0:78438:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306103.016197:0:78438:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306103.016786:0:78438:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306103.016796:0:78438:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:0.0:1772306103.364451:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772306103.364511:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772306103.364552:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772306103.364588:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772306103.364623:0:54689:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225436352 00000100:00100000:3.0:1772306103.364677:0:71804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225436416 00000100:00100000:0.0:1772306103.364694:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772306103.364700:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225436480 00000100:00100000:0.0:1772306103.364754:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306103.364784:0:71804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225436608 00000100:00100000:2.0:1772306103.364785:0:54689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 216 00000100:00100000:1.0:1772306103.364788:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225436544 00000100:00100000:2.0:1772306103.364803:0:54689:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000005fbd592 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2215:x1858396225436352:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1772306103.364833:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772306103.364858:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225436672 00000100:00100000:3.0:1772306103.364872:0:71804:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 328 00000100:00100000:3.0:1772306103.364887:0:71804:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000035a72dc1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2216:x1858396225436416:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1772306103.364913:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225436736 00000100:00100000:2.0:1772306103.364919:0:54689:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000005fbd592 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2215:x1858396225436352:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 115us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306103.364921:0:48463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1360 00000100:00100000:0.0:1772306103.364947:0:48463:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000031e649b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2215:x1858396225436480:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1772306103.364953:0:54689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 216 00000100:00100000:1.0:1772306103.364979:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1361 00000100:00100000:3.0:1772306103.364991:0:71804:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000035a72dc1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2216:x1858396225436416:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 100us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306103.364994:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005f1fba5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2216:x1858396225436544:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1772306103.365030:0:71804:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 328 00000100:00100000:0.0:1772306103.365031:0:48463:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000031e649b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2215:x1858396225436480:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 78us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306103.365042:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1362 00000100:00100000:0.0:1772306103.365065:0:48463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1360 00000100:00100000:2.0:1772306103.365066:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000815b9e7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2216:x1858396225436672:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1772306103.365091:0:71804:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 329 00000100:00100000:1.0:1772306103.365091:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005f1fba5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2216:x1858396225436544:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 91us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306103.365113:0:48463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1363 00000100:00100000:3.0:1772306103.365118:0:71804:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000161e896c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2215:x1858396225436608:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1772306103.365131:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000815b9e7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2216:x1858396225436672:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 65us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306103.365138:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1361 00000100:00100000:0.0:1772306103.365140:0:48463:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a3ed84e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2215:x1858396225436736:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1772306103.365208:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1362 00000100:00100000:3.0:1772306103.365247:0:71804:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000161e896c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2215:x1858396225436608:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 136us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306103.365256:0:48463:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a3ed84e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2215:x1858396225436736:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 123us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306103.365274:0:71804:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 329 00000100:00100000:0.0:1772306103.365276:0:48463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1363 00000040:00080000:1.0:1772306103.688857:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306103.688867:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306103.689551:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306103.689561:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:1.0:1772306104.008902:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1772306104.458479:0:78489:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306104.458487:0:78489:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306104.459704:0:78489:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306104.459722:0:78489:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:1.0:1772306104.712864:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306104.712873:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306104.713670:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306104.713683:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:2.0:1772306105.032819:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1772306105.736785:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306105.736791:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306105.737520:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306105.737531:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:3.0:1772306105.800906:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000ad6883e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216627136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1772306105.800995:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772306105.801443:0:6309:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216627136 00000100:00100000:3.0:1772306105.801513:0:6309:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 527 00000100:00100000:3.0:1772306105.801522:0:6309:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000fd7c6d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216627136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1772306105.801563:0:6309:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 742981632 pending 0 free 3828350976 avail 3826253824 00000100:00100000:3.0:1772306105.801775:0:6309:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000fd7c6d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216627136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 253us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306105.801784:0:6309:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 527 00000100:00100000:3.0:1772306105.801846:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000ad6883e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216627136:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1772306105.801997:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b2259494 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216627200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1772306105.802064:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772306105.802193:0:6309:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216627200 00000100:00100000:3.0:1772306105.802249:0:6309:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 528 00000100:00100000:3.0:1772306105.802258:0:6309:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007d9dabf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216627200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1772306105.802393:0:6309:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 695140352 pending 0 free 3606052864 avail 3603955712 00000100:00100000:3.0:1772306105.802438:0:6309:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007d9dabf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216627200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 182us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306105.802453:0:6309:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 528 00000100:00100000:0.0:1772306105.802486:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b2259494 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216627200:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1772306105.859980:0:78541:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772306105.859987:0:78541:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772306105.860514:0:78541:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:0.0:1772306105.860522:0:78541:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772306106.056917:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1772306106.312963:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002aca8cc4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:70aae467-c860-409f-ba1b-742f4d042da6:2993:1858396216627264:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306106.313008:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000094ce544a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216627456:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306106.313021:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000769fc9a5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:2994:1858396216627328:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306106.313055:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e47bd691 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:2991:1858396216627392:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772306106.313095:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772306106.313107:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772306106.313123:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306106.313206:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000054388a3a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216627520:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306106.313235:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216627264 00000100:00100000:2.0:1772306106.313238:0:48463:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216627456 00000100:00100000:1.0:1772306106.313256:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cc7871e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:2994:1858396216627584:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772306106.313270:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772306106.313324:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772306106.313332:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1772306106.313345:0:48463:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216627520 00000100:00100000:3.0:1772306106.313346:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009c22b6fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2993:x1858396216627264:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772306106.313374:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1364 00000100:00100000:0.0:1772306106.313383:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003fc0ed40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216627456:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306106.313411:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216627328 00000100:00100000:2.0:1772306106.313433:0:48463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1365 00000100:00100000:3.0:1772306106.313457:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009c22b6fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2993:x1858396216627264:12345-0@lo:400:kworker/u8:1.0 Request processed in 103us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306106.313459:0:48463:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b2259494 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216627520:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306106.313484:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216627584 00000100:00100000:3.0:1772306106.313487:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1772306106.313488:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003fc0ed40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216627456:12345-0@lo:400:kworker/u8:1.0 Request processed in 94us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306106.313507:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1364 00000100:00100000:1.0:1772306106.313531:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1772306106.313543:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007af842fc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:2994:x1858396216627328:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306106.313558:0:48463:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b2259494 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216627520:12345-0@lo:400:kworker/u8:1.0 Request processed in 109us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306106.313572:0:48463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1365 00000100:00100000:0.0:1772306106.313601:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000054388a3a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216627520:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306106.313675:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007af842fc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:2994:x1858396216627328:12345-0@lo:400:kworker/u8:1.0 Request processed in 85us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306106.313680:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002aca8cc4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:70aae467-c860-409f-ba1b-742f4d042da6:2993:1858396216627264:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306106.313703:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1772306106.313726:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000094ce544a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216627456:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306106.313734:0:71804:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1772306106.313749:0:71804:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007de8ec07 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:2994:x1858396216627584:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306106.313823:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000769fc9a5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:2994:1858396216627328:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306106.313824:0:71804:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007de8ec07 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:2994:x1858396216627584:12345-0@lo:400:kworker/u8:1.0 Request processed in 74us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306106.313827:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772306106.313855:0:71804:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1772306106.313883:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cc7871e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:2994:1858396216627584:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306106.313894:0:71804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216627392 00000100:00100000:3.0:1772306106.313954:0:71804:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1772306106.313961:0:71804:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005e7bbe3c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:2991:x1858396216627392:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306106.314004:0:71804:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005e7bbe3c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:2991:x1858396216627392:12345-0@lo:400:kworker/u8:1.0 Request processed in 43us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306106.314013:0:71804:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1772306106.314065:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e47bd691 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:2991:1858396216627392:0@lo:400:kworker/u8:1.0 00000040:00080000:1.0:1772306106.760820:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306106.760827:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306106.761374:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306106.761384:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:1.0:1772306107.080756:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1772306107.245308:0:78592:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772306107.245318:0:78592:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772306107.246183:0:78592:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:0.0:1772306107.246197:0:78592:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:1.0:1772306107.784871:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306107.784879:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306107.785540:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306107.785550:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:1.0:1772306108.104905:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1772306108.484062:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306108.484160:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772306108.484174:0:54689:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225436800 00000100:00100000:3.0:1772306108.484228:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772306108.484268:0:54689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 218 00000100:00100000:1.0:1772306108.484281:0:48463:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225436928 00000100:00100000:2.0:1772306108.484292:0:54689:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d640d5a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2216:x1858396225436800:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1772306108.484296:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306108.484350:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772306108.484362:0:48463:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225437184 00000100:00100000:2.0:1772306108.484402:0:54689:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d640d5a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2216:x1858396225436800:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 118us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306108.484418:0:48463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1366 00000100:00100000:1.0:1772306108.484429:0:48463:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000ad6883e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2216:x1858396225436928:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1772306108.484440:0:54689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 218 00000100:00100000:3.0:1772306108.484533:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772306108.484535:0:48463:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000ad6883e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2216:x1858396225436928:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 99us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306108.484549:0:48463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1366 00000100:00100000:1.0:1772306108.484590:0:48463:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225436992 00000100:00100000:1.0:1772306108.484672:0:48463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1367 00000100:00100000:1.0:1772306108.484684:0:48463:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002d3be4cb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2216:x1858396225437184:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1772306108.484695:0:6308:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1368 00000100:00100000:2.0:1772306108.484716:0:6308:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000068687bb0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2216:x1858396225436992:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1772306108.484825:0:48463:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002d3be4cb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2216:x1858396225437184:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 137us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306108.484837:0:6308:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000068687bb0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2216:x1858396225436992:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 112us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306108.484856:0:48463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1367 00000100:00100000:2.0:1772306108.484874:0:6308:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1368 00000100:00100000:2.0:1772306108.484966:0:71804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225437056 00000100:00100000:0.0:1772306108.484971:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225436864 00000100:00100000:3.0:1772306108.485039:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772306108.485045:0:71804:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 333 00000100:00100000:2.0:1772306108.485057:0:71804:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000084e1bde0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2216:x1858396225437056:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1772306108.485067:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 334 00000100:00100000:1.0:1772306108.485081:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008d141ae1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2216:x1858396225436864:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1772306108.485109:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225437120 00000100:00100000:2.0:1772306108.485160:0:71804:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000084e1bde0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2216:x1858396225437056:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 71us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306108.485173:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008d141ae1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2216:x1858396225436864:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 93us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306108.485177:0:71804:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 333 00000100:00100000:0.0:1772306108.485191:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1369 00000100:00100000:1.0:1772306108.485206:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 334 00000100:00100000:0.0:1772306108.485211:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d12426c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2216:x1858396225437120:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1772306108.485509:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d12426c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2216:x1858396225437120:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 304us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306108.485524:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1369 00000040:00080000:1.0:1772306108.684998:0:78643:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306108.685006:0:78643:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306108.685792:0:78643:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306108.685807:0:78643:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:1.0:1772306108.808829:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306108.808837:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306108.809578:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306108.809588:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:2.0:1772306109.128840:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1772306109.832868:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306109.832876:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306109.833536:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306109.833547:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:0.0:1772306110.123991:0:78694:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772306110.123998:0:78694:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772306110.124808:0:78694:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:0.0:1772306110.124820:0:78694:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:0.0:1772306110.152801:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1772306110.856829:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306110.856839:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306110.857572:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306110.857584:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:1.0:1772306110.920877:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003132ee1a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216627648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1772306110.920971:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000094ce544a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216627712:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1772306110.920985:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772306110.921076:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772306110.921175:0:6309:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216627648 00000100:00100000:2.0:1772306110.921220:0:6310:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216627712 00000100:00100000:1.0:1772306110.921268:0:6309:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 529 00000100:00100000:1.0:1772306110.921298:0:6309:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002294ffc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216627648:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1772306110.921304:0:6310:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 530 00000100:00100000:2.0:1772306110.921318:0:6310:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000957f52ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216627712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1772306110.921352:0:6309:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 695140352 pending 0 free 3606052864 avail 3603955712 00002000:00000024:2.0:1772306110.921364:0:6310:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 742981632 pending 0 free 3828350976 avail 3826253824 00000100:00100000:1.0:1772306110.921441:0:6309:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002294ffc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216627648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 145us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306110.921453:0:6309:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 529 00000100:00100000:2.0:1772306110.921480:0:6310:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000957f52ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216627712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 158us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306110.921501:0:6310:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 530 00000100:00100000:1.0:1772306110.921535:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003132ee1a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216627648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1772306110.921614:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000094ce544a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216627712:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1772306111.176902:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1772306111.432897:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b4a2cd7a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:2991:1858396216627904:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772306111.432897:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d6661384 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:70aae467-c860-409f-ba1b-742f4d042da6:2993:1858396216627776:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306111.432914:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000918e2663 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216627968:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306111.432923:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003397d536 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:2994:1858396216627840:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306111.433043:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306111.433062:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772306111.433069:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772306111.433108:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306111.433164:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006483edc6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216628032:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306111.433185:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216627904 00000100:00100000:1.0:1772306111.433199:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000091689862 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:2994:1858396216628096:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306111.433205:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216627968 00000100:00100000:0.0:1772306111.433217:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772306111.433277:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216627840 00000100:00100000:1.0:1772306111.433279:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306111.433301:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216627776 00000100:00100000:3.0:1772306111.433306:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216628032 00000100:00100000:2.0:1772306111.433344:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216628096 00000100:00100000:0.0:1772306111.433380:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1772306111.433387:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1370 00000100:00100000:2.0:1772306111.433399:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1772306111.433411:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000094f3bd7e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216627968:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772306111.433412:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000085166dbd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2993:x1858396216627776:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306111.433413:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000094ce544a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:2991:x1858396216627904:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306111.433421:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1772306111.433442:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000009b41aad pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:2994:x1858396216627840:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306111.433545:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000094f3bd7e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216627968:12345-0@lo:400:kworker/u8:1.0 Request processed in 145us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306111.433555:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000094ce544a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:2991:x1858396216627904:12345-0@lo:400:kworker/u8:1.0 Request processed in 140us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306111.433564:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1370 00000100:00100000:0.0:1772306111.433574:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000085166dbd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2993:x1858396216627776:12345-0@lo:400:kworker/u8:1.0 Request processed in 170us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306111.433577:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000009b41aad pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:2994:x1858396216627840:12345-0@lo:400:kworker/u8:1.0 Request processed in 135us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306111.433584:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1772306111.433599:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1371 00000100:00100000:0.0:1772306111.433605:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1772306111.433617:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1772306111.433618:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003132ee1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216628032:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306111.433675:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1772306111.433691:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b0099b15 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:2994:x1858396216628096:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306111.433724:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003132ee1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216628032:12345-0@lo:400:kworker/u8:1.0 Request processed in 113us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306111.433735:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1371 00000100:00100000:0.0:1772306111.433750:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d6661384 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:70aae467-c860-409f-ba1b-742f4d042da6:2993:1858396216627776:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306111.433791:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003397d536 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:2994:1858396216627840:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772306111.433791:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006483edc6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216628032:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306111.433800:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b0099b15 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:2994:x1858396216628096:12345-0@lo:400:kworker/u8:1.0 Request processed in 106us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306111.433822:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000918e2663 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216627968:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306111.433824:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1772306111.433849:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000091689862 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:2994:1858396216628096:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306111.433912:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b4a2cd7a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:2991:1858396216627904:0@lo:400:kworker/u8:1.0 00000040:00080000:1.0:1772306111.540140:0:78745:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306111.540148:0:78745:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306111.540746:0:78745:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306111.540757:0:78745:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:1.0:1772306111.880819:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306111.880826:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306111.881514:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306111.881526:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:1.0:1772306112.200828:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1772306112.886591:0:78797:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772306112.886596:0:78797:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772306112.887027:0:78797:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:3.0:1772306112.887035:0:78797:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:1.0:1772306112.905781:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306112.905786:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306112.906191:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306112.906200:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:2.0:1772306113.224726:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1772306113.604269:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772306113.604328:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772306113.604339:0:54689:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225437248 00000100:00100000:2.0:1772306113.604361:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306113.604392:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225437312 00000100:00100000:0.0:1772306113.604401:0:54689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 220 00000100:00100000:0.0:1772306113.604420:0:54689:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000061054f35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2215:x1858396225437248:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1772306113.604430:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306113.604447:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 338 00000100:00100000:1.0:1772306113.604453:0:48470:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225437440 00000100:00100000:3.0:1772306113.604455:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006049a92e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2216:x1858396225437312:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1772306113.604499:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772306113.604522:0:54689:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000061054f35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2215:x1858396225437248:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 108us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306113.604524:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006049a92e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2216:x1858396225437312:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 64us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306113.604525:0:48470:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225437376 00000100:00100000:3.0:1772306113.604541:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 338 00000100:00100000:0.0:1772306113.604546:0:54689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 220 00000100:00100000:1.0:1772306113.604574:0:48470:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225437568 00000100:00100000:2.0:1772306113.604600:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306113.604602:0:6308:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1372 00000100:00100000:3.0:1772306113.604608:0:6308:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a0e5d27a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2216:x1858396225437440:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1772306113.604682:0:6308:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a0e5d27a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2216:x1858396225437440:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 64us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306113.604682:0:48470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1373 00000100:00100000:0.0:1772306113.604701:0:48463:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1374 00000100:00100000:1.0:1772306113.604702:0:48470:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e47bd691 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2215:x1858396225437376:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1772306113.604713:0:6308:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1372 00000100:00100000:0.0:1772306113.604717:0:48463:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cc7871e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2216:x1858396225437568:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1772306113.604744:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772306113.604763:0:48463:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cc7871e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2216:x1858396225437568:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 53us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306113.604773:0:48463:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1374 00000100:00100000:1.0:1772306113.604781:0:48470:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e47bd691 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2215:x1858396225437376:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 83us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306113.604796:0:48463:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225437632 00000100:00100000:1.0:1772306113.604809:0:48470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1373 00000100:00100000:2.0:1772306113.604824:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1375 00000100:00100000:2.0:1772306113.604833:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002aca8cc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2216:x1858396225437632:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1772306113.604876:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002aca8cc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2216:x1858396225437632:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 42us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306113.604886:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1375 00000100:00100000:2.0:1772306113.604946:0:71804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225437504 00000100:00100000:2.0:1772306113.605005:0:71804:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 339 00000100:00100000:2.0:1772306113.605013:0:71804:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000769fc9a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2215:x1858396225437504:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1772306113.605061:0:71804:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000769fc9a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2215:x1858396225437504:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 47us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306113.605072:0:71804:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 339 00000040:00080000:1.0:1772306113.928845:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306113.928854:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306113.929550:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306113.929564:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:0.0:1772306114.249778:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1772306114.294802:0:78848:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306114.294808:0:78848:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306114.295333:0:78848:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306114.295359:0:78848:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:1.0:1772306114.952910:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306114.952923:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306114.953710:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306114.953722:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:1.0:1772306115.272775:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1772306115.648129:0:78899:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772306115.648136:0:78899:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772306115.648882:0:78899:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:3.0:1772306115.648895:0:78899:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:1.0:1772306115.976762:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306115.976768:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306115.977155:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306115.977161:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:3.0:1772306116.040823:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b4a2cd7a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216628224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1772306116.040828:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000918e2663 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216628160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1772306116.040899:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306116.040966:0:7591:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216628160 00000100:00100000:0.0:1772306116.041017:0:7591:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 531 00000100:00100000:0.0:1772306116.041023:0:7591:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000011976c6e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216628160:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1772306116.041032:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1772306116.041055:0:7591:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 742981632 pending 0 free 3828350976 avail 3826253824 00000100:00100000:2.0:1772306116.041072:0:6310:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216628224 00000100:00100000:2.0:1772306116.041120:0:6310:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 532 00000100:00100000:2.0:1772306116.041127:0:6310:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000054388a3a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216628224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1772306116.041149:0:6310:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 695140352 pending 0 free 3606052864 avail 3603955712 00000100:00100000:2.0:1772306116.041200:0:6310:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000054388a3a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216628224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306116.041209:0:6310:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 532 00000100:00100000:2.0:1772306116.041258:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b4a2cd7a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216628224:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1772306116.041274:0:7591:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000011976c6e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216628160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 247us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306116.041284:0:7591:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 531 00000100:00100000:3.0:1772306116.041316:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000918e2663 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216628160:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1772306116.296813:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772306116.552992:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000e418178 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:2994:1858396216628352:0@lo:400:kworker/u8:4.0 00000100:00100000:0.0:1772306116.552995:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000918e2663 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:70aae467-c860-409f-ba1b-742f4d042da6:2993:1858396216628288:0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772306116.553007:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000873b4f3c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:2991:1858396216628416:0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772306116.553020:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003b46920d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216628480:0@lo:400:kworker/u8:4.0 00000100:00100000:0.0:1772306116.553191:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772306116.553202:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772306116.553205:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306116.553253:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000091689862 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216628544:0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772306116.553272:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216628288 00000100:00100000:0.0:1772306116.553333:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772306116.553334:0:71804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216628416 00000100:00100000:3.0:1772306116.553335:0:6308:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216628480 00000100:00100000:1.0:1772306116.553353:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1772306116.553366:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000056f79513 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2993:x1858396216628288:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772306116.553417:0:6308:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216628544 00000100:00100000:2.0:1772306116.553426:0:71804:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1772306116.553437:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1376 00000100:00100000:2.0:1772306116.553443:0:71804:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bcab9de3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:2991:x1858396216628416:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:0.0:1772306116.553454:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000924e9251 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216628480:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772306116.553483:0:6308:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1377 00000100:00100000:1.0:1772306116.553493:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000056f79513 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2993:x1858396216628288:12345-0@lo:400:kworker/u8:4.0 Request processed in 125us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306116.553499:0:6308:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003397d536 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216628544:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:1.0:1772306116.553526:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1772306116.553546:0:71804:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bcab9de3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:2991:x1858396216628416:12345-0@lo:400:kworker/u8:4.0 Request processed in 105us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306116.553563:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000924e9251 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216628480:12345-0@lo:400:kworker/u8:4.0 Request processed in 106us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306116.553564:0:71804:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1772306116.553585:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1376 00000100:00100000:3.0:1772306116.553593:0:6308:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003397d536 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216628544:12345-0@lo:400:kworker/u8:4.0 Request processed in 95us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306116.553607:0:6308:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1377 00000100:00100000:2.0:1772306116.553668:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306116.553715:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000918e2663 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:70aae467-c860-409f-ba1b-742f4d042da6:2993:1858396216628288:0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772306116.553724:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006483edc6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:2994:1858396216628608:0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772306116.553745:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003b46920d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216628480:0@lo:400:kworker/u8:4.0 00000100:00100000:0.0:1772306116.553757:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000091689862 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216628544:0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772306116.553777:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772306116.553780:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216628352 00000100:00100000:1.0:1772306116.553854:0:54698:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216628608 00000100:00100000:2.0:1772306116.553863:0:71804:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1772306116.553868:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000873b4f3c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:2991:1858396216628416:0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772306116.553881:0:71804:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d42b6713 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:2994:x1858396216628352:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:0.0:1772306116.553897:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1772306116.553908:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000019916a7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:2994:x1858396216628608:12345-0@lo:400:kworker/u8:4.0 00000100:00100000:2.0:1772306116.553955:0:71804:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d42b6713 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:2994:x1858396216628352:12345-0@lo:400:kworker/u8:4.0 Request processed in 78us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306116.553970:0:71804:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1772306116.553984:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000019916a7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:2994:x1858396216628608:12345-0@lo:400:kworker/u8:4.0 Request processed in 73us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306116.553996:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1772306116.554007:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000e418178 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:2994:1858396216628352:0@lo:400:kworker/u8:4.0 00000100:00100000:3.0:1772306116.554030:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006483edc6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:2994:1858396216628608:0@lo:400:kworker/u8:4.0 00000040:00080000:1.0:1772306117.000838:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306117.000846:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306117.001588:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306117.001599:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:1.0:1772306117.051732:0:78950:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306117.051738:0:78950:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306117.052548:0:78950:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306117.052561:0:78950:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:2.0:1772306117.320786:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1772306118.024856:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306118.024866:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306118.025615:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306118.025626:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:2.0:1772306118.345764:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1772306118.492475:0:79001:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306118.492481:0:79001:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306118.493147:0:79001:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306118.493156:0:79001:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:2.0:1772306118.724400:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772306118.724463:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772306118.724513:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772306118.724536:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225437696 00000100:00100000:2.0:1772306118.724563:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772306118.724613:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772306118.724717:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 222 00000100:00100000:1.0:1772306118.724719:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225437952 00000100:00100000:2.0:1772306118.724735:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772306118.724738:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000037758792 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2216:x1858396225437696:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1772306118.724756:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225437824 00000100:00100000:1.0:1772306118.724792:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225437760 00000100:00100000:3.0:1772306118.724837:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225438080 00000100:00100000:0.0:1772306118.724851:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000037758792 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2216:x1858396225437696:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 112us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306118.724867:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772306118.724879:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 343 00000100:00100000:0.0:1772306118.724880:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 222 00000100:00100000:1.0:1772306118.724900:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000018cf3b39 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2216:x1858396225437952:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:0.0:1772306118.724988:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 344 00000100:00100000:1.0:1772306118.724989:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000018cf3b39 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2216:x1858396225437952:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 87us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306118.725005:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225437888 00000100:00100000:0.0:1772306118.725017:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cb35ac6f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2216:x1858396225437760:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:1.0:1772306118.725022:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 343 00000100:00100000:2.0:1772306118.725134:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225438016 00000100:00100000:1.0:1772306118.725137:0:48470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1378 00000100:00100000:1.0:1772306118.725149:0:48470:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009cd4a181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2216:x1858396225437824:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:0.0:1772306118.725164:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cb35ac6f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2216:x1858396225437760:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 155us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306118.725185:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 344 00000100:00100000:1.0:1772306118.725204:0:48470:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009cd4a181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2216:x1858396225437824:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 50us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306118.725218:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1379 00000100:00100000:1.0:1772306118.725238:0:48470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1378 00000100:00100000:2.0:1772306118.725240:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000021de7235 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2216:x1858396225438080:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1772306118.725282:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1380 00000100:00100000:3.0:1772306118.725296:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000de20b528 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2216:x1858396225437888:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1772306118.725314:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000021de7235 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2216:x1858396225438080:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 77us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306118.725330:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1379 00000100:00100000:2.0:1772306118.725377:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1381 00000100:00100000:2.0:1772306118.725386:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000099e4fbd0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2216:x1858396225438016:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1772306118.725891:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000de20b528 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2216:x1858396225437888:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 573us (1141us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306118.725909:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000099e4fbd0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2216:x1858396225438016:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 521us (1063us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306118.725922:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1380 00000100:00100000:2.0:1772306118.725935:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1381 00000040:00080000:1.0:1772306119.048891:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306119.048901:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306119.049701:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306119.049712:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:1.0:1772306119.368896:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1772306119.828950:0:79053:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306119.828954:0:79053:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306119.829387:0:79053:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306119.829394:0:79053:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:1.0:1772306120.072845:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306120.072853:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306120.073729:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306120.073742:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:1.0:1772306120.392824:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1772306121.097018:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306121.097029:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306121.097974:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306121.097991:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:3.0:1772306121.160827:0:2992:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1772306121.160855:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000952d665f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216628672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1772306121.160903:0:2991:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1772306121.160927:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d6661384 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216628736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1772306121.160956:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772306121.161003:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306121.161065:0:7591:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216628672 00000100:00100000:3.0:1772306121.161104:0:6310:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216628736 00000100:00100000:0.0:1772306121.161153:0:7591:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 533 00000100:00100000:3.0:1772306121.161166:0:6310:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 534 00000100:00100000:0.0:1772306121.161167:0:7591:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008d0e9397 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216628672:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1772306121.161180:0:6310:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000028e6916d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216628736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1772306121.161224:0:6310:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 695140352 pending 0 free 3606052864 avail 3603955712 00002000:00000024:0.0:1772306121.161226:0:7591:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 742981632 pending 0 free 3828350976 avail 3826253824 00000100:00100000:3.0:1772306121.161315:0:6310:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000028e6916d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216628736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 134us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306121.161332:0:7591:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008d0e9397 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216628672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 164us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306121.161341:0:6310:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 534 00000100:00100000:0.0:1772306121.161355:0:7591:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 533 00000100:00100000:1.0:1772306121.161358:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d6661384 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216628736:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1772306121.161443:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000952d665f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216628672:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1772306121.235500:0:79104:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772306121.235507:0:79104:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772306121.236157:0:79104:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:0.0:1772306121.236166:0:79104:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:2.0:1772306121.416838:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1772306121.672813:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002d74ee2c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:70aae467-c860-409f-ba1b-742f4d042da6:2993:1858396216628800:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306121.672840:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000eeae7eda pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:2992:1858396216628992:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306121.672840:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008b3e380d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:2994:1858396216628864:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306121.672885:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ecbbf8d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:2991:1858396216628928:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772306121.672897:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772306121.672921:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772306121.672961:0:71804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216628992 00000100:00100000:2.0:1772306121.672962:0:54689:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216628800 00000100:00100000:0.0:1772306121.672977:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772306121.673031:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216628928 00000100:00100000:1.0:1772306121.673042:0:71804:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1772306121.673059:0:54689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1772306121.673069:0:54689:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000020694155 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70aae467-c860-409f-ba1b-742f4d042da6+18:2993:x1858396216628800:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306121.673099:0:71804:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d72a5614 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:2992:x1858396216628992:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772306121.673112:0:54698:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1772306121.673124:0:54698:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d6661384 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:2991:x1858396216628928:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306121.673150:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772306121.673234:0:54689:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000020694155 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70aae467-c860-409f-ba1b-742f4d042da6+18:2993:x1858396216628800:12345-0@lo:400:kworker/u8:1.0 Request processed in 157us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306121.673250:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216628864 00000100:00100000:2.0:1772306121.673257:0:54689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1772306121.673265:0:54698:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d6661384 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:2991:x1858396216628928:12345-0@lo:400:kworker/u8:1.0 Request processed in 137us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306121.673272:0:71804:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d72a5614 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:2992:x1858396216628992:12345-0@lo:400:kworker/u8:1.0 Request processed in 187us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306121.673292:0:54698:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1772306121.673304:0:71804:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1772306121.673319:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1772306121.673331:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fd983d06 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:2994:x1858396216628864:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772306121.673389:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ecbbf8d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:2991:1858396216628928:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306121.673391:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002d74ee2c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:70aae467-c860-409f-ba1b-742f4d042da6:2993:1858396216628800:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306121.673406:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000eeae7eda pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:2992:1858396216628992:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306121.673426:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fd983d06 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:2994:x1858396216628864:12345-0@lo:400:kworker/u8:1.0 Request processed in 93us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306121.673440:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1772306121.673516:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008b3e380d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:2994:1858396216628864:0@lo:400:kworker/u8:1.0 00000040:00080000:1.0:1772306122.120871:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306122.120881:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306122.121669:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306122.121680:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:0.0:1772306122.441797:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1772306122.636167:0:79155:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306122.636174:0:79155:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306122.636898:0:79155:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306122.636912:0:79155:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:1.0:1772306123.144776:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306123.144783:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306123.145201:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306123.145208:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:1.0:1772306123.464930:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1772306123.843935:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772306123.843982:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225438208 00000100:00100000:3.0:1772306123.843988:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306123.844025:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772306123.844047:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225438144 00000100:00100000:1.0:1772306123.844053:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 348 00000100:00100000:1.0:1772306123.844073:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003bb94cec pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2216:x1858396225438208:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1772306123.844084:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772306123.844110:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 224 00000100:00100000:0.0:1772306123.844111:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225438272 00000100:00100000:3.0:1772306123.844123:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772306123.844123:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000084fb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2215:x1858396225438144:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1772306123.844142:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225438336 00000100:00100000:1.0:1772306123.844151:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003bb94cec pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2216:x1858396225438208:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 88us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306123.844161:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000084fb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2215:x1858396225438144:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 41us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306123.844162:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772306123.844171:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1382 00000100:00100000:2.0:1772306123.844181:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 224 00000100:00100000:1.0:1772306123.844181:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 348 00000100:00100000:0.0:1772306123.844181:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d6935757 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2215:x1858396225438272:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1772306123.844209:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225438400 00000100:00100000:0.0:1772306123.844220:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d6935757 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2215:x1858396225438272:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 42us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306123.844227:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1382 00000100:00100000:1.0:1772306123.844243:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 349 00000100:00100000:0.0:1772306123.844244:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225438464 00000100:00100000:1.0:1772306123.844252:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004db6797f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2215:x1858396225438400:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1772306123.844270:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1383 00000100:00100000:3.0:1772306123.844271:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772306123.844276:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000133430f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2216:x1858396225438336:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1772306123.844294:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004db6797f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2215:x1858396225438400:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 42us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306123.844303:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 349 00000100:00100000:0.0:1772306123.844307:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000133430f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2216:x1858396225438336:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 28us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306123.844313:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1383 00000100:00100000:0.0:1772306123.844328:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225438528 00000100:00100000:1.0:1772306123.844339:0:18149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1384 00000100:00100000:1.0:1772306123.844346:0:18149:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d225f1a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2216:x1858396225438464:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1772306123.844357:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1385 00000100:00100000:0.0:1772306123.844362:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c8b2fa89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2215:x1858396225438528:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1772306123.844381:0:18149:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d225f1a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2216:x1858396225438464:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 33us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306123.844389:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c8b2fa89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2215:x1858396225438528:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 25us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306123.844394:0:18149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1384 00000100:00100000:0.0:1772306123.844401:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1385 00000040:00080000:2.0:1772306123.945498:0:79206:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306123.945502:0:79206:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306123.945882:0:79206:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306123.945888:0:79206:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:1.0:1772306124.168786:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306124.168794:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306124.169357:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306124.169367:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:1.0:1772306124.488858:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1772306125.192795:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306125.192801:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306125.193362:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306125.193370:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:3.0:1772306125.313206:0:79257:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772306125.313211:0:79257:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772306125.313680:0:79257:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:3.0:1772306125.313688:0:79257:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:2.0:1772306125.512762:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1772306126.216856:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306126.216865:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306126.217380:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306126.217390:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:2.0:1772306126.280846:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000239dd968 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216629120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1772306126.280847:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002d3be4cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216629056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1772306126.280927:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772306126.281003:0:7591:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216629056 00000100:00100000:0.0:1772306126.281091:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772306126.281114:0:7591:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216629120 00000100:00100000:2.0:1772306126.281168:0:7591:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 535 00000100:00100000:0.0:1772306126.281176:0:6309:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 536 00000100:00100000:2.0:1772306126.281179:0:7591:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000068687bb0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216629056:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1772306126.281188:0:6309:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d12426c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216629120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1772306126.281222:0:6309:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 742981632 pending 0 free 3828350976 avail 3826253824 00002000:00000024:2.0:1772306126.281226:0:7591:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 695140352 pending 0 free 3606052864 avail 3603955712 00000100:00100000:2.0:1772306126.281279:0:7591:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000068687bb0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216629056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306126.281285:0:7591:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 535 00000100:00100000:1.0:1772306126.281352:0:6309:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d12426c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216629120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 165us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306126.281364:0:6309:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 536 00000100:00100000:2.0:1772306126.281385:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000239dd968 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216629120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1772306126.281424:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002d3be4cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216629056:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1772306126.536766:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1772306126.630381:0:79308:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306126.630387:0:79308:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306126.630939:0:79308:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306126.630950:0:79308:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:0.0:1772306126.792805:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008b3e380d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:70aae467-c860-409f-ba1b-742f4d042da6:2991:1858396216629184:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306126.792834:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002d74ee2c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:2993:1858396216629312:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306126.792836:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000eeae7eda pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:2992:1858396216629248:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306126.792916:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ecbbf8d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:2994:1858396216629376:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772306126.792917:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772306126.792922:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772306126.792965:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306126.792994:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216629312 00000100:00100000:2.0:1772306126.793028:0:54697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216629376 00000100:00100000:1.0:1772306126.793038:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306126.793069:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216629248 00000100:00100000:3.0:1772306126.793082:0:54689:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216629184 00000100:00100000:2.0:1772306126.793088:0:54697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1772306126.793094:0:54697:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000952d665f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:2993:x1858396216629312:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772306126.793118:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1772306126.793119:0:54689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1772306126.793128:0:71804:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1772306126.793133:0:54689:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002b8558a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70aae467-c860-409f-ba1b-742f4d042da6+18:2991:x1858396216629184:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772306126.793134:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000239dd968 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:2994:x1858396216629376:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306126.793142:0:71804:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000040ceeec7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:2992:x1858396216629248:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306126.793145:0:54697:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000952d665f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:2993:x1858396216629312:12345-0@lo:400:kworker/u8:1.0 Request processed in 48us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306126.793154:0:54697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1772306126.793196:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000239dd968 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:2994:x1858396216629376:12345-0@lo:400:kworker/u8:1.0 Request processed in 67us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306126.793207:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1772306126.793215:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ecbbf8d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:2994:1858396216629376:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306126.793217:0:71804:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000040ceeec7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:2992:x1858396216629248:12345-0@lo:400:kworker/u8:1.0 Request processed in 75us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306126.793228:0:71804:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1772306126.793250:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002d74ee2c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:2993:1858396216629312:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306126.793281:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000eeae7eda pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:2992:1858396216629248:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306126.793292:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008b3e380d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:70aae467-c860-409f-ba1b-742f4d042da6:2991:1858396216629184:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306126.793320:0:54689:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002b8558a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70aae467-c860-409f-ba1b-742f4d042da6+18:2991:x1858396216629184:12345-0@lo:400:kworker/u8:1.0 Request processed in 193us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306126.793328:0:54689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000040:00080000:1.0:1772306127.240811:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306127.240819:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306127.241299:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306127.241306:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:1.0:1772306127.560801:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1772306128.072461:0:79360:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772306128.072468:0:79360:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772306128.073176:0:79360:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:3.0:1772306128.073186:0:79360:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:1.0:1772306128.264855:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306128.264867:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306128.265708:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306128.265719:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:1.0:1772306128.584754:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1772306128.963890:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772306128.963930:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306128.963947:0:54689:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225438592 00000100:00100000:0.0:1772306128.963960:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772306128.963984:0:71804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225438656 00000100:00100000:0.0:1772306128.964013:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306128.964014:0:54689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 226 00000100:00100000:3.0:1772306128.964022:0:54689:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008ba675a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2216:x1858396225438592:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1772306128.964037:0:71804:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 353 00000100:00100000:1.0:1772306128.964043:0:71804:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003397d536 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2215:x1858396225438656:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1772306128.964047:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225438784 00000100:00100000:0.0:1772306128.964055:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772306128.964082:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225438720 00000100:00100000:3.0:1772306128.964099:0:54689:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008ba675a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2216:x1858396225438592:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 74us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306128.964099:0:71804:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003397d536 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2215:x1858396225438656:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 53us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306128.964102:0:21400:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225438912 00000100:00100000:1.0:1772306128.964113:0:71804:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 353 00000100:00100000:3.0:1772306128.964118:0:54689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 226 00000100:00100000:2.0:1772306128.964125:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1386 00000100:00100000:2.0:1772306128.964132:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b4a2cd7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2215:x1858396225438784:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1772306128.964151:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1387 00000100:00100000:0.0:1772306128.964158:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772306128.964163:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002d3be4cb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2216:x1858396225438720:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1772306128.964169:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b4a2cd7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2215:x1858396225438784:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 35us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306128.964177:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1386 00000100:00100000:2.0:1772306128.964194:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1388 00000100:00100000:2.0:1772306128.964198:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000042087043 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2215:x1858396225438912:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1772306128.964206:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002d3be4cb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2216:x1858396225438720:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 44us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306128.964216:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225438848 00000100:00100000:1.0:1772306128.964217:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1387 00000100:00100000:2.0:1772306128.964224:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000042087043 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2215:x1858396225438912:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 23us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306128.964230:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1388 00000100:00100000:0.0:1772306128.964255:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 354 00000100:00100000:0.0:1772306128.964262:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000084abacb2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2216:x1858396225438848:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1772306128.964292:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772306128.964302:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000084abacb2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2216:x1858396225438848:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 38us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306128.964310:0:6308:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225438976 00000100:00100000:0.0:1772306128.964312:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 354 00000100:00100000:1.0:1772306128.964350:0:6308:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1389 00000100:00100000:1.0:1772306128.964357:0:6308:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b4d59b97 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2215:x1858396225438976:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1772306128.964398:0:6308:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b4d59b97 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2215:x1858396225438976:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 40us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306128.964406:0:6308:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1389 00000040:00080000:3.0:1772306129.288905:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772306129.288915:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772306129.289817:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:3.0:1772306129.289832:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:3.0:1772306129.444145:0:79412:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772306129.444150:0:79412:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772306129.444511:0:79412:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:3.0:1772306129.444517:0:79412:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:2.0:1772306129.608803:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1772306130.312879:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772306130.312891:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772306130.313699:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:3.0:1772306130.313713:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:0.0:1772306130.636670:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1772306130.760727:0:79463:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772306130.760732:0:79463:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772306130.761275:0:79463:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:3.0:1772306130.761283:0:79463:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:3.0:1772306131.336889:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772306131.336901:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772306131.337603:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:3.0:1772306131.337616:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:0.0:1772306131.400943:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000004473942 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216629504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1772306131.400944:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000924e9251 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216629440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1772306131.401074:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306131.401119:0:6309:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216629440 00000100:00100000:3.0:1772306131.401152:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306131.401196:0:6309:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216629504 00000100:00100000:0.0:1772306131.401246:0:6309:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 537 00000100:00100000:0.0:1772306131.401255:0:6309:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008b3e380d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216629440:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1772306131.401261:0:6310:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 538 00000100:00100000:3.0:1772306131.401270:0:6310:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000eeae7eda pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216629504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1772306131.401292:0:6309:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 742981632 pending 0 free 3828350976 avail 3826253824 00002000:00000024:3.0:1772306131.401305:0:6310:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 695140352 pending 0 free 3606052864 avail 3603955712 00000100:00100000:0.0:1772306131.401358:0:6309:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008b3e380d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216629440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306131.401367:0:6309:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 537 00000100:00100000:3.0:1772306131.401381:0:6310:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000eeae7eda pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216629504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306131.401393:0:6310:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 538 00000100:00100000:3.0:1772306131.401465:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000004473942 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216629504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1772306131.401525:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000924e9251 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216629440:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1772306131.656859:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1772306131.912766:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002d74ee2c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:2994:1858396216629632:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772306131.912770:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000924e9251 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:70aae467-c860-409f-ba1b-742f4d042da6:2993:1858396216629568:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306131.912802:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000094f3bd7e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:2992:1858396216629760:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772306131.912876:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772306131.912878:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ecbbf8d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:2991:1858396216629696:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306131.912894:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772306131.912940:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306131.912961:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216629568 00000100:00100000:1.0:1772306131.912970:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216629632 00000100:00100000:3.0:1772306131.912996:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216629696 00000100:00100000:0.0:1772306131.913023:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1772306131.913029:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1772306131.913032:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000073ab1f7b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2993:x1858396216629568:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306131.913039:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000276761c7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:2994:x1858396216629632:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306131.913040:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1772306131.913051:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006483edc6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:2991:x1858396216629696:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772306131.913087:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000073ab1f7b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2993:x1858396216629568:12345-0@lo:400:kworker/u8:1.0 Request processed in 56us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306131.913094:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1772306131.913101:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000276761c7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:2994:x1858396216629632:12345-0@lo:400:kworker/u8:1.0 Request processed in 64us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306131.913109:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1772306131.913117:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006483edc6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:2991:x1858396216629696:12345-0@lo:400:kworker/u8:1.0 Request processed in 66us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306131.913124:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1772306131.913160:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306131.913162:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000924e9251 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:70aae467-c860-409f-ba1b-742f4d042da6:2993:1858396216629568:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306131.913163:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002d74ee2c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:2994:1858396216629632:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306131.913203:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216629760 00000100:00100000:3.0:1772306131.913243:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1772306131.913246:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000e418178 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:2992:x1858396216629760:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306131.913290:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000e418178 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:2992:x1858396216629760:12345-0@lo:400:kworker/u8:1.0 Request processed in 40us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306131.913298:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1772306131.913304:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000094f3bd7e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:2992:1858396216629760:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306131.913338:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ecbbf8d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:2991:1858396216629696:0@lo:400:kworker/u8:1.0 00000040:00080000:3.0:1772306132.080657:0:79514:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772306132.080662:0:79514:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772306132.081209:0:79514:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:3.0:1772306132.081222:0:79514:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:3.0:1772306132.360894:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772306132.360902:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772306132.361608:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:3.0:1772306132.361620:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:1.0:1772306132.680841:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1772306133.384833:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306133.384841:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306133.385295:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306133.385304:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:1.0:1772306133.442598:0:79565:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306133.442602:0:79565:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306133.443060:0:79565:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306133.443067:0:79565:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:2.0:1772306133.704780:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1772306134.084254:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772306134.084348:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772306134.084384:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306134.084387:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225439104 00000100:00100000:0.0:1772306134.084434:0:54689:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225439040 00000100:00100000:2.0:1772306134.084440:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772306134.084503:0:6308:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225439232 00000100:00100000:3.0:1772306134.084516:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 358 00000100:00100000:2.0:1772306134.084524:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306134.084543:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001c27fa0f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2216:x1858396225439104:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1772306134.084547:0:54689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 228 00000100:00100000:0.0:1772306134.084570:0:54689:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000324275e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2215:x1858396225439040:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1772306134.084601:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772306134.084629:0:6308:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225439168 00000100:00100000:1.0:1772306134.084724:0:6308:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225439360 00000100:00100000:2.0:1772306134.084739:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306134.084753:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001c27fa0f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2216:x1858396225439104:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 215us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306134.084753:0:54689:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000324275e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2215:x1858396225439040:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 185us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306134.084763:0:6308:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225439424 00000100:00100000:0.0:1772306134.084768:0:54689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 228 00000100:00100000:3.0:1772306134.084773:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 358 00000100:00100000:1.0:1772306134.084818:0:6308:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1390 00000100:00100000:3.0:1772306134.084823:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225439296 00000100:00100000:1.0:1772306134.084834:0:6308:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000326ce08d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2216:x1858396225439232:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1772306134.084868:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1391 00000100:00100000:0.0:1772306134.084896:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f8c4abc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2215:x1858396225439168:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1772306134.084907:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 359 00000100:00100000:3.0:1772306134.084918:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004dac6711 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2215:x1858396225439296:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1772306134.084927:0:6308:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000326ce08d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2216:x1858396225439232:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 95us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306134.084943:0:6308:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1390 00000100:00100000:0.0:1772306134.085029:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f8c4abc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2215:x1858396225439168:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 119us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306134.085037:0:6308:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1392 00000100:00100000:3.0:1772306134.085042:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004dac6711 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2215:x1858396225439296:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 121us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306134.085054:0:6308:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d82ebea7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2216:x1858396225439360:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1772306134.085055:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 359 00000100:00100000:0.0:1772306134.085055:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1391 00000100:00100000:0.0:1772306134.085090:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1393 00000100:00100000:1.0:1772306134.085094:0:6308:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d82ebea7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2216:x1858396225439360:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 46us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306134.085101:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006f23ed77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2215:x1858396225439424:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1772306134.085107:0:6308:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1392 00000100:00100000:0.0:1772306134.085161:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006f23ed77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2215:x1858396225439424:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 59us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306134.085175:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1393 00000040:00080000:1.0:1772306134.408741:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306134.408747:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306134.409187:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306134.409194:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:0.0:1772306134.728871:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1772306134.843626:0:79617:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306134.843635:0:79617:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306134.844254:0:79617:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306134.844264:0:79617:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:1.0:1772306135.432849:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306135.432860:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306135.433660:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306135.433673:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:1.0:1772306135.752928:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1772306136.166593:0:79668:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306136.166600:0:79668:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306136.167468:0:79668:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306136.167481:0:79668:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:1.0:1772306136.456847:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306136.456853:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306136.457260:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306136.457281:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:0.0:1772306136.520890:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003c5a199e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216629888:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1772306136.520909:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000004473942 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216629824:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1772306136.521004:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772306136.521064:0:6310:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216629888 00000100:00100000:0.0:1772306136.521094:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772306136.521131:0:6310:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216629824 00000100:00100000:2.0:1772306136.521168:0:6310:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 539 00000100:00100000:0.0:1772306136.521178:0:6309:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 540 00000100:00100000:2.0:1772306136.521180:0:6310:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ecbbf8d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216629888:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1772306136.521193:0:6309:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002d74ee2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216629824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1772306136.521226:0:6310:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 742981632 pending 0 free 3828350976 avail 3826253824 00002000:00000024:0.0:1772306136.521226:0:6309:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 695140352 pending 0 free 3606052864 avail 3603955712 00000100:00100000:0.0:1772306136.521291:0:6309:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002d74ee2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2994:x1858396216629824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306136.521301:0:6309:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 540 00000100:00100000:2.0:1772306136.521302:0:6310:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ecbbf8d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216629888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306136.521313:0:6310:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 539 00000100:00100000:0.0:1772306136.521370:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000004473942 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2994:1858396216629824:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1772306136.521411:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003c5a199e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216629888:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1772306136.776818:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1772306137.032859:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000282b51c2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:70aae467-c860-409f-ba1b-742f4d042da6:2991:1858396216629952:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1772306137.032878:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000030acc74c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:2992:1858396216630016:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1772306137.032898:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f50ff6e2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:2994:1858396216630144:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1772306137.032936:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008f3ff7b7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:2993:1858396216630080:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772306137.033035:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306137.033039:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772306137.033085:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216629952 00000100:00100000:2.0:1772306137.033127:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216630016 00000100:00100000:3.0:1772306137.033134:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772306137.033156:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1772306137.033167:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ad4fae50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2991:x1858396216629952:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1772306137.033208:0:71804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216630080 00000100:00100000:2.0:1772306137.033212:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1772306137.033225:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000924e9251 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:2992:x1858396216630016:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1772306137.033244:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ad4fae50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2991:x1858396216629952:12345-0@lo:400:kworker/u8:0.0 Request processed in 76us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306137.033252:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1772306137.033266:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000282b51c2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:70aae467-c860-409f-ba1b-742f4d042da6:2991:1858396216629952:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1772306137.033277:0:71804:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1772306137.033289:0:71804:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000873b4f3c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:2993:x1858396216630080:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1772306137.033309:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000924e9251 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:2992:x1858396216630016:12345-0@lo:400:kworker/u8:0.0 Request processed in 86us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306137.033326:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1772306137.033328:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772306137.033377:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000030acc74c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:2992:1858396216630016:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1772306137.033380:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216630144 00000100:00100000:0.0:1772306137.033393:0:71804:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000873b4f3c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:2993:x1858396216630080:12345-0@lo:400:kworker/u8:0.0 Request processed in 104us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306137.033402:0:71804:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1772306137.033421:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1772306137.033432:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000091689862 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:2994:x1858396216630144:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1772306137.033470:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008f3ff7b7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:2993:1858396216630080:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1772306137.033475:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000091689862 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:2994:x1858396216630144:12345-0@lo:400:kworker/u8:0.0 Request processed in 45us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306137.033482:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1772306137.033515:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f50ff6e2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:2994:1858396216630144:0@lo:400:kworker/u8:0.0 00000040:00080000:3.0:1772306137.468834:0:79719:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772306137.468840:0:79719:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772306137.469384:0:79719:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:3.0:1772306137.469395:0:79719:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:3.0:1772306137.480762:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772306137.480767:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772306137.481144:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:3.0:1772306137.481154:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:2.0:1772306137.800759:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1772306138.504782:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772306138.504788:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772306138.505191:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:3.0:1772306138.505199:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:2.0:1772306138.813760:0:79770:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306138.813767:0:79770:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306138.814159:0:79770:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306138.814168:0:79770:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772306138.824745:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1772306139.204529:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772306139.204607:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772306139.204702:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225439488 00000100:00100000:2.0:1772306139.204722:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772306139.204773:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306139.204783:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225439552 00000100:00100000:1.0:1772306139.204799:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 230 00000100:00100000:2.0:1772306139.204813:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772306139.204819:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000db950d37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2216:x1858396225439488:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1772306139.204870:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225439616 00000100:00100000:2.0:1772306139.204891:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306139.204980:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225439744 00000100:00100000:0.0:1772306139.205005:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225439680 00000100:00100000:3.0:1772306139.205074:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 363 00000100:00100000:0.0:1772306139.205078:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225439808 00000100:00100000:2.0:1772306139.205105:0:2984:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306139.205127:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003c5a199e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2215:x1858396225439552:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1772306139.205127:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000db950d37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2216:x1858396225439488:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 275us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306139.205154:0:10520:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225439872 00000100:00100000:1.0:1772306139.205183:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 230 00000100:00100000:0.0:1772306139.205234:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1394 00000100:00100000:0.0:1772306139.205246:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000843d6290 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2216:x1858396225439616:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1772306139.205292:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003c5a199e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2215:x1858396225439552:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 195us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306139.205310:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 363 00000100:00100000:0.0:1772306139.205318:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000843d6290 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2216:x1858396225439616:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 69us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306139.205330:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1395 00000100:00100000:0.0:1772306139.205354:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1394 00000100:00100000:1.0:1772306139.205367:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e6eb5d84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2215:x1858396225439680:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1772306139.205381:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 364 00000100:00100000:3.0:1772306139.205398:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c9f16044 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2216:x1858396225439744:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1772306139.205421:0:10520:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1396 00000100:00100000:0.0:1772306139.205449:0:10520:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000076169a73 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2215:x1858396225439808:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1772306139.205461:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e6eb5d84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2215:x1858396225439680:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 112us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306139.205475:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1395 00000100:00100000:1.0:1772306139.205511:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1397 00000100:00100000:1.0:1772306139.205517:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c8b46b0c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2216:x1858396225439872:12345-192.168.203.30@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1772306139.205593:0:10520:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000076169a73 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2215:x1858396225439808:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 162us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306139.205615:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c8b46b0c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2216:x1858396225439872:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 82us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306139.205621:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c9f16044 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2216:x1858396225439744:12345-192.168.203.30@tcp:400:kworker/u8:2.0 Request processed in 222us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306139.205680:0:10520:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1396 00000100:00100000:1.0:1772306139.205697:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1397 00000100:00100000:3.0:1772306139.205706:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 364 00000040:00080000:3.0:1772306139.528876:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772306139.528896:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772306139.529740:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:3.0:1772306139.529752:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:1.0:1772306139.849011:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1772306140.258277:0:79821:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1772306140.258282:0:79821:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:0.0:1772306140.258931:0:79821:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:0.0:1772306140.258953:0:79821:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:3.0:1772306140.553044:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772306140.553057:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772306140.553843:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:3.0:1772306140.553857:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:1.0:1772306140.872890:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1772306141.576771:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772306141.576777:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772306141.577282:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:3.0:1772306141.577289:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:3.0:1772306141.640415:0:79874:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772306141.640423:0:79874:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000100:00100000:2.0:1772306141.640803:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fca5ff81 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216630208:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1772306141.640877:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772306141.641008:0:7591:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216630208 00000100:00100000:0.0:1772306141.641023:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000004473942 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216630272:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1772306141.641061:0:7591:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 541 00000100:00100000:2.0:1772306141.641070:0:7591:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000054096887 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216630208:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1772306141.641080:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1772306141.641113:0:7591:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 742981632 pending 0 free 3828350976 avail 3826253824 00000100:00100000:0.0:1772306141.641131:0:6310:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216630272 00000100:00100000:0.0:1772306141.641169:0:6310:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 542 00000100:00100000:0.0:1772306141.641181:0:6310:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a1708fba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216630272:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1772306141.641182:0:7591:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000054096887 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216630208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306141.641199:0:7591:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 541 00002000:00000024:0.0:1772306141.641220:0:6310:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 695140352 pending 0 free 3606052864 avail 3603955712 00000100:00100000:0.0:1772306141.641258:0:6310:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a1708fba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216630272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306141.641266:0:6310:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 542 00000100:00100000:0.0:1772306141.641331:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000004473942 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216630272:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1772306141.641371:0:79874:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000100:00100000:0.0:1772306141.641378:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fca5ff81 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216630208:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1772306141.641385:0:79874:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:2.0:1772306141.896773:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1772306142.152901:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006ceb8211 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:2994:1858396216630400:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306142.152924:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c4cd8ffb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:70aae467-c860-409f-ba1b-742f4d042da6:2993:1858396216630336:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306142.152966:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a9ec63b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:2991:1858396216630464:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306142.153028:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c8771ec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216630528:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306142.153042:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1772306142.153048:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772306142.153098:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000032e68268 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216630592:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772306142.153105:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e43a966f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:2994:1858396216630656:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306142.153112:0:54696:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216630400 00000100:00100000:2.0:1772306142.153125:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772306142.153173:0:6306:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216630528 00000100:00100000:1.0:1772306142.153196:0:54696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1772306142.153200:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772306142.153213:0:54696:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000c3382b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:2994:x1858396216630400:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306142.153231:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1398 00000100:00100000:3.0:1772306142.153238:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a7458d21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216630528:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772306142.153263:0:54689:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216630336 00000100:00100000:2.0:1772306142.153272:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216630656 00000100:00100000:0.0:1772306142.153317:0:54689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1772306142.153321:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a7458d21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216630528:12345-0@lo:400:kworker/u8:1.0 Request processed in 83us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306142.153326:0:54689:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001c628d59 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70aae467-c860-409f-ba1b-742f4d042da6+18:2993:x1858396216630336:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306142.153328:0:54696:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000c3382b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:2994:x1858396216630400:12345-0@lo:400:kworker/u8:1.0 Request processed in 118us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306142.153339:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1398 00000100:00100000:2.0:1772306142.153345:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1772306142.153365:0:54696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1772306142.153367:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d0ab861f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:2994:x1858396216630656:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772306142.153376:0:54689:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001c628d59 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70aae467-c860-409f-ba1b-742f4d042da6+18:2993:x1858396216630336:12345-0@lo:400:kworker/u8:1.0 Request processed in 48us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306142.153389:0:54689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1772306142.153398:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c8771ec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216630528:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306142.153434:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772306142.153444:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772306142.153461:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d0ab861f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:2994:x1858396216630656:12345-0@lo:400:kworker/u8:1.0 Request processed in 100us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306142.153473:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1772306142.153491:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e43a966f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:2994:1858396216630656:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306142.153510:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c4cd8ffb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:70aae467-c860-409f-ba1b-742f4d042da6:2993:1858396216630336:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1772306142.153526:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006ceb8211 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:2994:1858396216630400:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306142.153562:0:18149:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216630592 00000100:00100000:2.0:1772306142.153565:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216630464 00000100:00100000:2.0:1772306142.153616:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1772306142.153621:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000030acc74c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:2991:x1858396216630464:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306142.153658:0:18149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1399 00000100:00100000:1.0:1772306142.153669:0:18149:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000918e2663 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216630592:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306142.153712:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000030acc74c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:2991:x1858396216630464:12345-0@lo:400:kworker/u8:1.0 Request processed in 89us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306142.153720:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1772306142.153743:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a9ec63b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:2991:1858396216630464:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306142.153757:0:18149:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000918e2663 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216630592:12345-0@lo:400:kworker/u8:1.0 Request processed in 89us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306142.153771:0:18149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1399 00000100:00100000:3.0:1772306142.153782:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000032e68268 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216630592:0@lo:400:kworker/u8:1.0 00000040:00080000:3.0:1772306142.600887:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772306142.600897:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772306142.601728:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:3.0:1772306142.601743:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:3.0:1772306142.920858:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1772306143.075716:0:79925:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306143.075725:0:79925:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306143.076447:0:79925:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306143.076462:0:79925:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:3.0:1772306143.624945:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772306143.624957:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772306143.625731:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:3.0:1772306143.625745:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:1.0:1772306143.944843:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1772306144.324192:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772306144.324249:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306144.324284:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225440000 00000100:00100000:2.0:1772306144.324294:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1772306144.324335:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1772306144.324337:0:54689:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225439936 00000100:00100000:1.0:1772306144.324364:0:18149:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225440128 00000100:00100000:3.0:1772306144.324373:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 368 00000100:00100000:2.0:1772306144.324384:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306144.324392:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b29332f6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2216:x1858396225440000:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:0.0:1772306144.324404:0:54689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 232 00000100:00100000:0.0:1772306144.324414:0:54689:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000248f02fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2215:x1858396225439936:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1772306144.324443:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1772306144.324443:0:18149:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225440064 00000100:00100000:1.0:1772306144.324479:0:18149:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225440256 00000100:00100000:0.0:1772306144.324502:0:54689:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000248f02fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b14e8ede-800c-4ffa-b394-54f2572c1ce9+12:2215:x1858396225439936:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 82us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306144.324519:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b29332f6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:370cd859-ca07-4cc9-a865-ed970d9eaddd+84:2216:x1858396225440000:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 121us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306144.324521:0:18149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1400 00000100:00100000:0.0:1772306144.324532:0:54689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 232 00000100:00100000:1.0:1772306144.324543:0:18149:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003bb53c21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2216:x1858396225440128:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1772306144.324556:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 368 00000100:00100000:2.0:1772306144.324586:0:2985:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1772306144.324601:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225440192 00000100:00100000:0.0:1772306144.324615:0:48470:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396225440320 00000100:00100000:1.0:1772306144.324622:0:18149:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003bb53c21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+230:2216:x1858396225440128:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 83us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306144.324678:0:18149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1400 00000100:00100000:1.0:1772306144.324715:0:18149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1401 00000100:00100000:3.0:1772306144.324725:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 369 00000100:00100000:1.0:1772306144.324732:0:18149:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000032e68268 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2215:x1858396225440064:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:0.0:1772306144.324735:0:48470:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1402 00000100:00100000:3.0:1772306144.324748:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006ceb8211 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2215:x1858396225440192:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:0.0:1772306144.324749:0:48470:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001a9ec63b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2216:x1858396225440256:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1772306144.324756:0:6306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1403 00000100:00100000:2.0:1772306144.324767:0:6306:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e43a966f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2215:x1858396225440320:12345-192.168.203.30@tcp:400:kworker/u8:4.0 00000100:00100000:1.0:1772306144.324797:0:18149:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000032e68268 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:370cd859-ca07-4cc9-a865-ed970d9eaddd+227:2215:x1858396225440064:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 73us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306144.324808:0:18149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1401 00000100:00100000:0.0:1772306144.324877:0:48470:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001a9ec63b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f935b4d0-e17f-49c8-8011-4be99ba75430+164:2216:x1858396225440256:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 128us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306144.324909:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006ceb8211 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f935b4d0-e17f-49c8-8011-4be99ba75430+67:2215:x1858396225440192:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 144us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306144.324918:0:6306:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e43a966f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f935b4d0-e17f-49c8-8011-4be99ba75430+143:2215:x1858396225440320:12345-192.168.203.30@tcp:400:kworker/u8:4.0 Request processed in 125us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1772306144.324918:0:48470:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1402 00000100:00100000:3.0:1772306144.324935:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 369 00000100:00100000:2.0:1772306144.324942:0:6306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1403 00000040:00080000:3.0:1772306144.422765:0:79976:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772306144.422770:0:79976:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772306144.423226:0:79976:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:3.0:1772306144.423233:0:79976:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:3.0:1772306144.648809:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1772306144.648815:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:3.0:1772306144.649212:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:3.0:1772306144.649220:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:1.0:1772306144.968950:0:38581:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1772306145.672841:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306145.672850:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306145.673334:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306145.673343:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000040:00080000:2.0:1772306145.824584:0:80027:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1772306145.824597:0:80027:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:2.0:1772306145.825376:0:80027:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:2.0:1772306145.825395:0:80027:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:2.0:1772306145.992777:0:5497:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1772306146.697048:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306146.697061:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306146.697739:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306146.697753:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00000100:00100000:0.0:1772306146.761069:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000022640fb5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216630720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1772306146.761101:0:2992:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003b46920d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216630784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1772306146.761188:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772306146.761269:0:2992:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772306146.761341:0:6309:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216630720 00000100:00100000:3.0:1772306146.761396:0:6310:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216630784 00000100:00100000:2.0:1772306146.761458:0:6309:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 543 00000100:00100000:2.0:1772306146.761474:0:6309:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008068be20 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216630720:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1772306146.761486:0:6310:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 544 00000100:00100000:3.0:1772306146.761498:0:6310:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000094f3bd7e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216630784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1772306146.761552:0:6309:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 695140352 pending 0 free 3606052864 avail 3603955712 00002000:00000024:3.0:1772306146.761571:0:6310:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 742981632 pending 0 free 3828350976 avail 3826253824 00000100:00100000:3.0:1772306146.761748:0:6310:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000094f3bd7e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2992:x1858396216630784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 248us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306146.761761:0:6310:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 544 00000100:00100000:3.0:1772306146.762028:0:2992:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003b46920d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2992:1858396216630784:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1772306146.762128:0:6309:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008068be20 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216630720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 658us (948us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306146.762138:0:6309:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 543 00000100:00100000:0.0:1772306146.762244:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000022640fb5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216630720:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1772306147.016993:0:6322:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1772306147.273981:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c4cd8ffb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:70aae467-c860-409f-ba1b-742f4d042da6:2993:1858396216630848:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306147.274037:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c8771ec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:2994:1858396216630912:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306147.274094:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1772306147.274094:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000077cfb39c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:2991:1858396216630976:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306147.274110:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772306147.274156:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006c142a39 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216631104:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306147.274165:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000903941fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:2994:1858396216631168:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306147.274217:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772306147.274229:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772306147.274261:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216630912 00000100:00100000:2.0:1772306147.274299:0:2991:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1772306147.274312:0:2991:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000047d67c26 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216631040:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306147.274331:0:55653:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216630976 00000100:00100000:3.0:1772306147.274339:0:54690:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216630848 00000100:00100000:2.0:1772306147.274378:0:2991:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1772306147.274380:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1772306147.274391:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003e43a9e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:2994:x1858396216630912:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306147.274397:0:54690:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1772306147.274412:0:54690:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000001ef4b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2993:x1858396216630848:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306147.274474:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216631104 00000100:00100000:1.0:1772306147.274496:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003e43a9e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:2994:x1858396216630912:12345-0@lo:400:kworker/u8:1.0 Request processed in 105us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306147.274502:0:54690:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000001ef4b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70aae467-c860-409f-ba1b-742f4d042da6+18:2993:x1858396216630848:12345-0@lo:400:kworker/u8:1.0 Request processed in 89us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306147.274519:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1772306147.274520:0:54690:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1772306147.274575:0:6307:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216631040 00000100:00100000:1.0:1772306147.274577:0:55653:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1772306147.274587:0:55653:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002254491d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:2991:x1858396216630976:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306147.274612:0:21400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1404 00000100:00100000:3.0:1772306147.274619:0:21400:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003b46920d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216631104:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306147.274725:0:21400:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003b46920d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:2993:x1858396216631104:12345-0@lo:400:kworker/u8:1.0 Request processed in 103us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1772306147.274745:0:55653:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002254491d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:2991:x1858396216630976:12345-0@lo:400:kworker/u8:1.0 Request processed in 146us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306147.274746:0:6307:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1405 00000100:00100000:1.0:1772306147.274763:0:55653:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1772306147.274767:0:21400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1404 00000100:00100000:2.0:1772306147.274775:0:6307:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cc3c0696 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216631040:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306147.274804:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1772306147.274826:0:55141:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858396216631168 00000100:00100000:1.0:1772306147.274851:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c8771ec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:2994:1858396216630912:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306147.274903:0:55141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1772306147.274913:0:55141:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000022640fb5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:2994:x1858396216631168:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1772306147.274936:0:6307:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cc3c0696 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:2991:x1858396216631040:12345-0@lo:400:kworker/u8:1.0 Request processed in 166us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1772306147.274961:0:6307:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1405 00000100:00100000:1.0:1772306147.274978:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000047d67c26 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2991:1858396216631040:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306147.274988:0:55141:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000022640fb5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:2994:x1858396216631168:12345-0@lo:400:kworker/u8:1.0 Request processed in 73us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1772306147.275003:0:55141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1772306147.275019:0:2991:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000077cfb39c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:2991:1858396216630976:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306147.275073:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006c142a39 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2993:1858396216631104:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1772306147.275099:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c4cd8ffb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:70aae467-c860-409f-ba1b-742f4d042da6:2993:1858396216630848:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1772306147.275103:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000903941fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:2994:1858396216631168:0@lo:400:kworker/u8:1.0 00000400:00000080:0.0:1772306147.580259:0:80077:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1772306147.580266:0:80077:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-hsm test_251: @@@@@@ FAIL: request on 0x200000402:0x338:0x0 is not STARTED on mds1 00000040:00080000:1.0:1772306147.720789:0:54732:0:(llog.c:731:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1772306147.720796:0:54732:0:(llog_cat.c:815:llog_cat_process_common()) processing log [0xf:0x1:0x0]:0 at index 4 of catalog [0x7:0xa:0x0] 00000040:00080000:1.0:1772306147.721268:0:54732:0:(llog.c:789:llog_process_thread()) stop processing plain 0xf:1:0 index 64768 count 1 00000040:00080000:1.0:1772306147.721275:0:54732:0:(llog.c:789:llog_process_thread()) stop processing catalog 0x7:10:0 index 5 count 2 00010000:00010000:1.0:1772306148.040733:0:5496:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 28119 lines, 28119 kept, 0 dropped, 0 bad.